- 1266 Views
- 1 replies
- 1 kudos
Resolved! If I write pandas code using koalas and have photon enabled, will my pandas code run on photon?
- 1266 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi there! Appreciate this reply is 3 years later than it was originally asked, but people might be coming across it still. A few things: Koalas was deprecated in spark 3.2 (runtime 10.4). Instead, the recommendation is to use pandas on spark with `im...
- 1 kudos
- 2213 Views
- 3 replies
- 2 kudos
Resolved! Py Spark Pandas Code diff
Hi Can you help me why Pandas code not working..but Pyspark is working..import pandas as pdpdf = pd.read_csv('/FileStore/tables/new.csv',sep=',')Error : No such file exists...below is worked..df = spark.read.csv("/FileStore/tables/new.csv", sep=",", ...
- 2213 Views
- 3 replies
- 2 kudos
- 2 kudos
It might has to do with the path as @Hubert Dudek​ already mentioned: df = spark.read.csv("dbfs:/FileStore/tables/new.csv", sep=",", header='True')
- 2 kudos