How to translate Apache Pig LOAD statement to Spark?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-18-2021 09:48 AM
If you have the following Apache Pig LOAD statement:
TOCCT = LOAD 'db_custbase.ods_corp_cust_t' using $HCatLoader;the equivalent code in Apache Spark is:
TOCCT_DF = spark.read.table("db_custbase.ods_corp_cust_t")
Labels:
- Labels:
-
Apache spark
-
ApachePig
-
Pyspark