Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forÂ
Databricks Community
Databricks Community is an open-source platform for data enthusiasts and professionals to discuss, share insights, and collaborate on everything related to Databricks. Members can ask questions, share knowledge, and support each other in an environment that ensures respectful interactions.
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
191 results
Sorted by:
Thursday
When launching a job via "Create and trigger a one-time run" (docs), when using a custom image (docs), what's the lifetime of the container? Does it create the cluster, start the container, run the j...
3 weeks ago
...enied error. This happens in the following code block: os.makedirs(f".tmp/{filename_base[:-4]}", exist_ok=True). There are no duplicates in filename_base[:-4]. Any idea why that is the c...
3 weeks ago
I ran a native Power BI query in DataBricks in import mode and query folding was not enabled. No query folding?
4 weeks ago
I'm using a customer container *and* init scripts. At runtime, I get this error: Cluster '...' was terminated. Reason: INIT_SCRIPT_FAILURE (CLIENT_ERROR). Parameters: instance_id:i-0440ddd3a2d5cce79...
a month ago
I am providing a custom Docker image to my Databricks/Spark job. I've created the image and uploaded it to our private ECR registry (the URL is `472542229217.dkr.ecr.us-west-2.amazonaws.com/tectonai/...
by
mrstevegross
in Community Platform Discussions
‎01-15-2025
11:07 AM
‎01-15-2025
11:07 AM
Currently, to investigate job performance, I can look at a job's information (via the UI) to see the "Event Log" (pictured below): I'd like to obtain this information programmatically, so I can ...
by
bvraravind
in Community Platform Discussions
‎10-27-2024
06:52 AM
‎10-27-2024
06:52 AM
I am following Microsoft documentation to connect from Databricks workspace to Azure blob storage. but it is not working. Any help is greatly appreciated. Below is the code spark.conf.set("fs.azure....
by
aonurdemir
in Community Platform Discussions
‎01-11-2025
12:22 PM
‎01-11-2025
12:22 PM
Hi everyone, I do not want to use 4 DBU/h XS warehouse since I have very tiny data on the new startup. I want to create a minimal cluster and run it as the underlying SQL engine for my dashboard. T...
by
OlehSemeniuk
in Community Platform Discussions
‎01-14-2025
12:20 AM
‎01-14-2025
12:20 AM
Hi, I need to ingest and transform historical climate data into a Delta table. The data is stored in .nc format (NetCDF). To work with this format, specific C libraries for Python are required, alon...
by
mrstevegross
in Community Platform Discussions
‎01-13-2025
01:24 PM
‎01-13-2025
01:24 PM
I'm exploring whether serverless (https://docs.databricks.com/en/jobs/run-serverless-jobs.html#create-a-job-using-serverless-compute) could be useful for our use case. I'd like to see an example of u...