cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to identify S3 object type (directory or file) created by Databricks?

ebyhry
New Contributor II

The issue context is Delta Lake connector in Trino https://github.com/trinodb/trino/issues/13017

Trino identifies S3 object as a directory or a file using Content-Type header. Other query engines set application/x-directory in case of directories, but Databricks sets application/octet-stream in the header. Is there an alternative solution to identifies the object type using com.amazonaws.services.s3.model.ObjectMetadata when we use Databricks? If not, is it possible to request the header change?

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group