Databricks Community

Husky · 02-08-2024

Context:IDE: IntelliJ 2023.3.2Library: databricks-connect 13.3Python: 3.10Description:I develop notebooks and python scripts locally in the IDE and I connect to the spark cluster via databricks-connect for a better developer experience. I download a...

Husky

@jim12321 I got the same error with CLI version 0.223.1, but I could resolve it by escaping the quotation marks:databricks jobs run-now --json '{\"job_id\":85218616788189,\"notebook_params\": {\"demo\":\"parameter successful\"}}'Seems to be fixed by ...

Husky · 05-17-2024

I use target overrides to switch between branch and tags on different environments: resources: jobs: my_job: git_source: git_url: <REPO-URL> git_provider: gitHub targets: staging: resources: jobs: my_j...

Husky · 05-06-2024

Thanks, that's what I was looking for.Even though it would be nice to not read the binary but to provide just the path to the file to upload.

Husky · 05-06-2024

Hey @dbdude, I am facing the same error. Did you find a solution to access the AWS credentials on a Shared Cluster?This article describes a way of storing credentials in a Unity Catalog Volume to fetch by the Shared Cluster:https://medium.com/@amluci...

Husky · 02-12-2024

Thanks for your answer. But I want to upload the files/data programmatically and not manually with the Databricks UI.

Databricks Community

User Stats

User Activity

Upload file from local file system to Unity Catalog Volume (via databricks-connect)

Re: Databricks CLI how to start a job and pass the parameters?

Re: How to overwrite git_source configuration in Asset Bundles

Re: Upload file from local file system to Unity Catalog Volume (via databricks-connect)

Re: AWS Secrets Works In One Cluster But Not Another

Re: Upload file from local file system to Unity Catalog Volume (via databricks-connect)