Databricks Community

rpl · 11-28-2023

I have a semicolon separated file in an ADLS container that's been added to Unity Catalog as an External location.When I run the following code on an all-purpose cluster, it runs ok and displays the schema.import dlt @dlt.table def test_data_csv(): ...

rpl · 11-27-2023

As far as I understand, Delta Live Tables should now support reading data from an external location, but I can’t get it to work. I’ve added an ADLS container to Unity Catalog as an external location. There’s a folder in the container containing an ex...

rpl · 12-01-2023

@Kaniz_Fatma can you confirm that .option("delimiter", ";") is ignored when run in a DLT pipeline? (please see the post above) My colleage confirmed the behavior.

rpl · 11-28-2023

As mentioned, the code runs just fine on an all-purpose cluster, therefore special characters can't be the problem.But i checked this further by making two versions of the file:a regular CSV with comma as separator and dot as decimal separator,the id...

rpl · 11-27-2023

I misspelled the folder name; I got it working now  The error message could have been more informative

Databricks Community

User Stats

User Activity

Bug report: the delimiter option does not work when run on DLT

Read file with Delta Live Tables from external location (Unity Catalog)

Re: Bug report: the delimiter option does not work when run on DLT

Re: Bug report: the delimiter option does not work when run on DLT

Re: Read file with Delta Live Tables from external location (Unity Catalog)