cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

User16752240150
by New Contributor II
  • 675 Views
  • 1 replies
  • 1 kudos
  • 675 Views
  • 1 replies
  • 1 kudos
Latest Reply
holly
New Contributor III
  • 1 kudos

Hi there! Appreciate this reply is 3 years later than it was originally asked, but people might be coming across it still. A few things: Koalas was deprecated in spark 3.2 (runtime 10.4). Instead, the recommendation is to use pandas on spark with `im...

  • 1 kudos
Krishscientist
by New Contributor III
  • 1286 Views
  • 4 replies
  • 2 kudos

Resolved! Py Spark Pandas Code diff

Hi Can you help me why Pandas code not working..but Pyspark is working..import pandas as pdpdf = pd.read_csv('/FileStore/tables/new.csv',sep=',')Error : No such file exists...below is worked..df = spark.read.csv("/FileStore/tables/new.csv", sep=",", ...

  • 1286 Views
  • 4 replies
  • 2 kudos
Latest Reply
Kaniz
Community Manager
  • 2 kudos

Hi @Rafael Rockenbach​  and @Hubert Dudek​ , It was so nice to have your response. Thank you for the time you put into our community. I really want you to know how much we appreciate that.

  • 2 kudos
3 More Replies
Labels