Expected no of lines is - 16400
Showing only 20 No of records
Script
spark.conf.set(
"REDACTED",
"REDACTED"
)
# File location
file_location = "REDACTED"
# Read in the data to dataframe df
df = spark.read.format("CSV").option("inferSchema",...
hi, pls look help mespark.conf.set( "REDACTED", "REDACTED")# File locationfile_location = "REDACTED"# Read in the data to dataframe dfdf = spark.read.format("CSV").option("inferSchema", "true").option("header", "true").option("delimiter", ",")...
I tried to read the file from ADLS datalake getting some errorerror - Failed to store the result. Try rerunning the command.Failed to upload command result to DBFS. Error message: Status code: 301 Moved Permanently, Error message: <?xml version="1.0...
i am also getting the same error while trying to load the Csv fileerror discription - StorageContextcom.databricks.backend storage. StorageContextType$DbfsRoots@42fa5c for workspace 4306807171088769 is not set in the Customer Storageinfo.