Databricks Community

alwaysmoredata · 01-17-2025

hey guys, I am stuck on a loading task, and I simply can't spot what is wrong. The following query fails: COPY INTO `test`.`test_databricks_tokenb3337f88ee667396b15f4e5b2dd5dbb0`.`pipeline_state`FROM '/Volumes/test/test_databricks_tokenb3337f88ee6673...

alwaysmoredata · 12-30-2024

Is it possible to load data only using Databricks SDK?I have custom library that has to load data to a table, and I know about other features like autoloader, COPY INTO, notebook with spark dataframe... but I wonder if it is possible to load data dir...

alwaysmoredata · 12-30-2024

Currently using the Serverless compute but ideally my custom library shouldn't limit the cluster choice.It feels like I only have some options:- upload data to volume and run COPY INTO- upload data to DBFS and run COPY INTO- or leverage the pre-confi...

alwaysmoredata · 12-30-2024

SparkConnectGrpcException: (java.lang.SecurityException) Cannot use com.databricks.backend.daemon.driver.WorkspaceLocalFileSystem - local filesystem access is forbiddenCOPY INTO my_company.test.event_sampleFROM 'file:/Workspace/Users/alwaysmoredata@m...

alwaysmoredata · 12-30-2024

Thanks for the incredibly quick reply - you’re faster than any AI assistant on the market!I had a feeling this was the case, but it’s great to have it confirmed.What options do I have for loading data without using Spark? I’m working with a custom li...

Databricks Community

User Stats

User Activity

COPY INTO from Volume failure (rabbit hole)

Is it possible to load data only using Databricks SDK?

Re: Is it possible to load data only using Databricks SDK?

Re: Is it possible to load data only using Databricks SDK?

Re: Is it possible to load data only using Databricks SDK?