- 972 Views
- 0 replies
- 3 kudos
DE61193D-D4AB-426A-B117-715BBCB67F5F
Excited to hear about Data mesh implementation patterns! Are you using data mesh alread?#summit22
- 972 Views
- 0 replies
- 3 kudos
Forum Posts
- 1572 Views
- 1 replies
- 6 kudos
Really excited about Delta Sharing Cleanrooms!
Really excited about Delta Sharing Cleanrooms!
- 1572 Views
- 1 replies
- 6 kudos
Latest Reply
- 6 kudos
As am I! Between the clean rooms and the platform-agnostic data marketplace, collaborating on a variety of datasets will become much easier than before!
- 6 kudos
- 9231 Views
- 7 replies
- 16 kudos
Resolved! What will happen if a driver or worker node fails?
What will happen if a driver node will fail?What will happen if one of the worker node fails?Is it same in Spark and Databricks or Databricks provide additional features to overcome these situations?
- 9231 Views
- 7 replies
- 16 kudos
Latest Reply
- 16 kudos
If the driver node fails your cluster will fail. If the worker node fails, Databricks will spawn a new worker node to replace the failed node and resumes the workload. Generally it is recommended to assign a on-demand instance for your driver and spo...
- 16 kudos
- 14395 Views
- 8 replies
- 4 kudos
Resolved! Unable to load Parquet file using Autoloader. Can someone help?
I am trying to load parquet files using Autoloader. Below is the code def autoload_to_table (data_source, source_format, table_name, checkpoint_path): query = (spark.readStream .format('cloudFiles') .option('cl...
- 14395 Views
- 8 replies
- 4 kudos
Latest Reply
- 4 kudos
Hi again @Mayank Srivastava​ Thank you so much for getting back to us and marking the answer as best.We really appreciate your time.Wish you a great Databricks journey ahead!
- 4 kudos
- 2028 Views
- 1 replies
- 2 kudos
- 2028 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
When you log in it should be on https://dataaisummit.com/downloads/ but there is nothing yet.
- 2 kudos
- 1007 Views
- 0 replies
- 0 kudos
 E-khool is an Online Learning Management System software for Industries with low cost and no extra charges. One stop solution for live classes, trai...
E-khool is an Online Learning Management System software for Industries with low cost and no extra charges. One stop solution for live classes, trainings, videos & materials, unlimited exams, corporate training & professional development, online int...
- 1007 Views
- 0 replies
- 0 kudos
- 2048 Views
- 1 replies
- 1 kudos
DeltaSharing
Hi, Databricks team,I created the share and provided access to the recipient, and the recipient is consuming or accessing the share. My question is who is going to bear the cost and how can we track the computation charges for it?As per the attached ...
- 2048 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @Kaniz Fatma​ , Thanks for your response on Delta sharing information, Could you please provide details about who is going to bear the cost[either provider/Consumer] and how can we track the computation charges for it?
- 1 kudos
- 21561 Views
- 23 replies
- 7 kudos
Resolved! Data AI Summit Training
Hi Team,I am asking a little off topic question here. I have been attending paid session for Data AI summit in last 2-3 years. Is it possible to get videos for sessions which we have not attended due to session conflicts at the same time. I mean to s...
- 21561 Views
- 23 replies
- 7 kudos
Latest Reply
- 7 kudos
@Juliet Wu​ Hi Juliet,Thank you so much for sharing the recording. Regards,Rajesh.
- 7 kudos
- 3758 Views
- 1 replies
- 2 kudos
Is it possible to alter the text in a Databricks Job Alert Email?
I have configured a Databricks job to send email alters to me whenever my job fails. However, I would very much like to alter the text in the Alert Email to something a little more bespoke. Is there any way to alter the text in email or even just t...
- 3758 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Hey there @Peter Mayers​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from yo...
- 2 kudos
- 15177 Views
- 1 replies
- 3 kudos
Resolved! How to Install Python packages from the own artifactory
We have created our own artifactory and we use this to install python dependencies or libraries.We would like to know how we can make use of our own artifactory to install dependencies or libraries on Databricks clusters..
- 15177 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
For private repos, you can find some good examples herehttps://kb.databricks.com/clusters/install-private-pypi-repo.htmlhttps://towardsdatascience.com/install-custom-python-libraries-from-private-pypi-on-databricks-6a7669f6e6fd
- 3 kudos
- 3064 Views
- 4 replies
- 5 kudos
Hello Databricks Community!  We are getting so excited about the upcoming event of the year Data & AI Summit!  If you still need to sign up, visit...
Hello Databricks Community! We are getting so excited about the upcoming event of the year Data & AI Summit! If you still need to sign up, visit our registration page [link]! We have an in-person and virtual option for attending this year. In prepara...
- 3064 Views
- 4 replies
- 5 kudos
Latest Reply
- 12081 Views
- 11 replies
- 5 kudos
Cluster terminated.Reason:Unexpected launch failure
Is there any known issues affecting the creation of clusters? I've been unable to get any clusters to start today so far!Have received this error "Cluster terminated.Reason:Unexpected launch failure"Help!
- 12081 Views
- 11 replies
- 5 kudos
Latest Reply
- 18815 Views
- 13 replies
- 13 kudos
Resolved! Spark streaming autoloader slow second batch - checkpoint issues?
I am running a massive history of about 250gb ~6mil phone call transcriptions (json read in as raw text) from a raw -> bronze pipeline in Azure Databricks using pyspark. The source is mounted storage and is continuously having files added and we do n...
- 18815 Views
- 13 replies
- 13 kudos
Latest Reply
- 3820 Views
- 4 replies
- 3 kudos
There is some issue in Column
I have loaded the csv file from my local PC to data bricks. Now, when i am trying to query the table over column its throwing error. Note - select * from table_name is working but select column_name from table_name is throwing error.
- 3820 Views
- 4 replies
- 3 kudos
Latest Reply
- 3 kudos
Thanks for the information, I will try to figure it out for more. Keep sharing such informative post keep suggesting such post.
- 3 kudos
- 2684 Views
- 1 replies
- 0 kudos
Unregistering / Removing A SparkListener
Hey, So currently I'm using Pyspark and utilizing SparkListener to track metrics of my spark jobs. The problem I can't seem to solve is why in databricks the listener cannot be removed with removeSparkListener as it still is attached to the context.#...
- 2684 Views
- 1 replies
- 0 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 553 | |
| 349 | |
| 287 |
