Is there a way to specify a header, set the delimiter, etc...in DLT?

[Chris_Shehu]

I was looking forward to using the Data Quality features that are provided with DLT but as far as I can the ingestion process is more restrictive than other methods. It doesn't seem like you can do much as far as setting delimiter type, headers or any other options really. Am I missing something? I've read through the documentation already.

Thanks,

[Anonymous · Accepted solution]

DLT uses Autoloader to ingest data. With autoloader, you can provide read options for the table. https://docs.databricks.com/ingestion/auto-loader/options.html#csv-options has the docs on CSV. I attached a picture of an example.

[Chris_Shehu]

That is exactly what I needed! Thanks Josephk. I guess when searching I needed to look for the auto loader options not DLT SQL options.

[Anonymous]

Glad to help!