cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

How to translate Apache Pig LOAD statement to Spark?

User15787040559
New Contributor III

If you have the following Apache Pig LOAD statement:

TOCCT = LOAD 'db_custbase.ods_corp_cust_t' using $HCatLoader;

the equivalent code in Apache Spark is:

TOCCT_DF = spark.read.table("db_custbase.ods_corp_cust_t")

1 REPLY 1

Kaniz
Community Manager
Community Manager

Hi @User15787040559729892342! My name is Kaniz, and I'm a technical moderator here. Great to meet you, and thanks for your question! Let's see if your peers on the Forum have an answer to your questions first. Or else I will follow up shortly with a response.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.