https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103568#M9041 <P>Thanks for your response. It helps. Also please suggest on unity catalog open api as well. As we are trying feasibility analysis because the data is huge, would like to have alternatives at hand to try further. Other options to do this use case are welcome as well. Thanks.</P> Mon, 30 Dec 2024 15:08:57 GMT Sa_1234 2024-12-30T15:08:57Z https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103549#M9039 <P>Please suggest best ways to get databricks unity catalog data to Aws s3 or sagemaker. Data could be around 1gb in some tables and 20gb in others.</P><P>currently sagemaker pipelines use data from s3 as batches in different parquet files. But now we would like to keep the sagemaker pipelines as is but get the data from unity catalog. Please suggest the best possible ways to do this. Thanks in advance.</P><P>What we tried earlier: delta sharing (unsure if it could work well with this huge data-kindly suggest on this and also the permissions to setup)</P> Mon, 30 Dec 2024 14:31:48 GMT https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103549#M9039 Sa_1234 2024-12-30T14:31:48Z https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103552#M9040 <P>You could try by using Delta Sharing with your provider as mentioned in doc&nbsp;<A href="https://docs.databricks.com/en/delta-sharing/set-up.html" target="_blank">https://docs.databricks.com/en/delta-sharing/set-up.html</A>&nbsp;</P> <P>&nbsp;</P> Mon, 30 Dec 2024 14:35:23 GMT https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103552#M9040 Walter_C 2024-12-30T14:35:23Z https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103568#M9041 <P>Thanks for your response. It helps. Also please suggest on unity catalog open api as well. As we are trying feasibility analysis because the data is huge, would like to have alternatives at hand to try further. Other options to do this use case are welcome as well. Thanks.</P> Mon, 30 Dec 2024 15:08:57 GMT https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103568#M9041 Sa_1234 2024-12-30T15:08:57Z https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103871#M9042 <P>Hi team any suggestions on the last comment please?</P> Thu, 02 Jan 2025 08:13:35 GMT https://community.databricks.com/t5/get-started-discussions/suggest-ways-to-get-unity-catalog-data-to-aws-s3-or-sagemaker/m-p/103871#M9042 Sa_1234 2025-01-02T08:13:35Z