cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Autoloader with SQLite db files

eva_mcmf
New Contributor II

Hi Everyone, 

Is it possible to ingest SQLite db files with Databricks Autoloader? Is it currently supported? If so, could you please share an example?

1 REPLY 1

lucasrocha
New Contributor III
New Contributor III

Hello @eva_mcmf , I hope this message finds you well.

As per the documentation, Auto Loader incrementally and efficiently processes new data files as they arrive in cloud storage. Auto Loader can load data files from AWS S3, Azure Data Lake Storage Gen2, Google Cloud Storage, Azure Blob Storage, ADLS Gen1, and Databricks File System. Auto Loader can ingest JSONCSVXMLPARQUETAVROORCTEXT, and BINARYFILE file formats.

Currently I couldn't find this possibility of directly ingesting from SQLite with Autoloader through the documentation.
How does Auto Loader workhttps://docs.databricks.com/en/ingestion/auto-loader/index.html#how-does-auto-loader-work

If you believe that ingesting SQLite db files with Auto Loader would be beneficial, you can submit an idea in Databricks' Ideas Portal.

Best regards,
Lucas Rocha

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!