cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
lprevost
New Contributor II
since ‎08-27-2021
‎06-26-2023

User Stats

  • 2 Posts
  • 0 Solutions
  • 0 Kudos given
  • 1 Kudos received

User Activity

Schema inferrence CSV picks up \r carriage returns

08-09-2021
I'm using: frame = spark.read.csv(path=bucket+folder, inferSchema = True, header = True, multiLine=True ) to read in a series of CSV ...

Incremental updates to s3 csv files, autoloader, and delta lake updates

08-09-2021
I'm using the Databricks autoloader to incrementally load a series of csv files on s3 which I update with an API. My tyipcal work process is to update only the latest year file each night. But, there are ocassions where previous years also get update...
Kudos from