Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forÂ
Databricks Community
Databricks Community is an open-source platform for data enthusiasts and professionals to discuss, share insights, and collaborate on everything related to Databricks. Members can ask questions, share knowledge, and support each other in an environment that ensures respectful interactions.
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
4,000 results
Sorted by:
by
bvraravind
in Community Platform Discussions
‎10-27-2024
06:52 AM
‎10-27-2024
06:52 AM
I am following Microsoft documentation to connect from Databricks workspace to Azure blob storage. but it is not working. Any help is greatly appreciated. Below is the code spark.conf.set("fs.azure....
Monday
2 Kudos
...'{source_dir}/schemaInfer')\ .option('header','true')\ .load(source_dir) ( df.writeStream.option("c...
by
boitumelodikoko
in Warehousing & Analytics
‎09-06-2024
01:02 AM
‎09-06-2024
01:02 AM
We are experiencing the following issues. Description: I encountered an issue while executing a Spark SQL query in Databricks, and it seems to be related to the query optimization phase. The error...
- Tags:
- sql
a week ago
When taking Data Engineer Learning Plan https://partner-academy.databricks.com/learn/learning-plans/10/data-engineer-learning-plan there are videos with demo notebooks - is there an option to do...
Friday
Hi, I am looking to build a ETL process for a incremental load silver table. This silver table, lets say "contracts_silver", is built by joining two bronze tables, "contracts_raw" and "custom...
Labels:
- Labels:
-
Delta Lake
-
Workflows
2 weeks ago
Hi everybody, I tested the temporary table credentials API. I works great, as long as I use the credentials outside of Databricks (e.g. in a local duckdb instance). But as soon as I try to use the ...
Labels:
- Labels:
-
Spark
by
igorstar
in Warehousing & Analytics
‎06-29-2023
09:17 AM
2 Kudos
‎06-29-2023
09:17 AM
2 Kudos
From the DLT documentation it seems that the LIVE TABLE is conceptually the same as MATERIALIZED VIEW. When should I use one over another?
2 weeks ago
Hi everyone, I do not want to use 4 DBU/h XS warehouse since I have very tiny data on the new startup. I want to create a minimal cluster and run it as the underlying SQL engine for my dashboard. T...
Thursday
I have a workflow in QA workspace that attached one notebook. I need to deploy the same workflow to PRD workspace , with all the notebooks in the azure devops repo and attche and run a different note...
Saturday
I have some legacy software that only runs on Windows, but that can be driven via Python. Is it possible to set up compute resources that run Databricks Container Service on a windows base image, so ...