topic Re: DBFS for AutoML in Machine Learning

DBFS for AutoML

Verisk — Wed, 23 Feb 2022 17:55:03 GMT

Hi, for AutoML, I see that the data has to reside in dbfs to read and run AutoML on top of it. In my environment, dbfs is locked for security reasons. Is there a workaround or another way to access data or maybe from S3 bucket?

Re: DBFS for AutoML

-werners- — Thu, 24 Feb 2022 07:37:56 GMT

Too bad dbfs is locked out, because it makes things easier.

There is a way to access S3 directly, but I never did that so can´t say how good of a solution that is and if you can use it with autoML.

Re: DBFS for AutoML

Atanu — Tue, 08 Mar 2022 13:29:28 GMT

@Silky Sharad Shah please look into the doc https://docs.databricks.com/data/data-sources/aws/amazon-s3.html?&_ga=2.228395418.684786035.1646666830-480220406.1638459894#access-s3-buckets-directly . this might help you.