@kali.tummala@gmail.com in general though the answers you want are too complicated to be explained in a forum post, do you have a point of contact at Databricks that you could setup time with? If not, you can reach out to me at fish@databricks.com ...
@kali.tummala@gmail.com Databricks Runtime is very similar to open source spark, completely API compatible. Any open source Spark (OSS) code you've written will run the same against the equivalent Databricks Runtime version. There are some features ...
hi @Dominic Robinson I'm unable to create a simple reproduction of this issue. I was able to write out a file with the Euro symbol as the column using dataframe.write.csv(path), and the symbol was fine when I read the file back in using spark.read.c...
hi @Dominic Robinson​ , my colleague tells me that the CSV source should support UTF-16LE and UTF-16BE, but not plain UTF-16. It may be helpful to look at the test suite for the CSV source - it has simple examples of what is and isn't possible. It s...
