- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-21-2024 10:13 AM - edited 05-21-2024 10:18 AM
Hello @Lea ,
I'd like to inform you that our platform does not currently provide a built-in feature for ingesting multiple or interchangeable file formats. However, we highly value your input and encourage you to share your ideas through Databricks' Ideas Portal.
Autoloader can discover files to process based on a Glob Pattern: https://docs.databricks.com/en/ingestion/auto-loader/patterns.html#filtering-directories-or-files-us.... Although this is not exactly generic file processing, this feature can help in some cases.
- At the moment, Autoloader supports the following file formats: File Format Options
- Common patterns: Common Data Loading Patterns
- Apache Spark DataFrames and SQL supported formats:Data Format Options
If you have any further questions, please don't hesitate to reach out.
Raphael Balogo
Sr. Technical Solutions Engineer
Databricks