cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Krishscientist
by New Contributor III
  • 2309 Views
  • 3 replies
  • 2 kudos

Resolved! Py Spark Pandas Code diff

Hi Can you help me why Pandas code not working..but Pyspark is working..import pandas as pdpdf = pd.read_csv('/FileStore/tables/new.csv',sep=',')Error : No such file exists...below is worked..df = spark.read.csv("/FileStore/tables/new.csv", sep=",", ...

  • 2309 Views
  • 3 replies
  • 2 kudos
Latest Reply
RRO
Contributor
  • 2 kudos

It might has to do with the path as @Hubert Dudek​  already mentioned: df = spark.read.csv("dbfs:/FileStore/tables/new.csv", sep=",", header='True')

  • 2 kudos
2 More Replies
Labels