cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

How to identify S3 object type (directory or file) created by Databricks?

ebyhry
New Contributor II

The issue context is Delta Lake connector in Trino https://github.com/trinodb/trino/issues/13017

Trino identifies S3 object as a directory or a file using Content-Type header. Other query engines set application/x-directory in case of directories, but Databricks sets application/octet-stream in the header. Is there an alternative solution to identifies the object type using com.amazonaws.services.s3.model.ObjectMetadata when we use Databricks? If not, is it possible to request the header change?

0 REPLIES 0
Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.