- 3214 Views
- 3 replies
- 3 kudos
- 3214 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @Soham Dhodapkar​ https://docs.databricks.com/lakehouse/index.html This document depicts the component of the lakehouse as described in the image shared by @Hubert Dudek​ .
- 3 kudos
- 1348 Views
- 0 replies
- 0 kudos
Our Python Code Examples covers basic concepts, control structures, functions, lists, classes, objects, inheritance, polymorphism, file operations, da...
Our Python Code Examples covers basic concepts, control structures, functions, lists, classes, objects, inheritance, polymorphism, file operations, data structures, sorting algorithms, mathematical functions, mathematical sequences, threads, exceptio...
- 1348 Views
- 0 replies
- 0 kudos
- 1680 Views
- 0 replies
- 8 kudos
Databricks Office Hours Register for Office Hours to participate in a LIVE Q&A session and receive technical support directly from Databricks expe...
Databricks Office HoursRegister for Office Hours to participate in a LIVE Q&A session and receive technical support directly from Databricks experts! Our next event is scheduled for July 27th from 8:00am - 9:00am PT | 3:00pm - 4:00pm GMT.Whether you ...
- 1680 Views
- 0 replies
- 8 kudos
- 2643 Views
- 1 replies
- 1 kudos
MergeSchema on Delta Streaming
Hi Guys,Quick thing can we do MergeSchema on update mode in streaming or it is overwrite schema while using update mode .
- 2643 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey @Shikher Singh​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 1 kudos
- 2664 Views
- 2 replies
- 1 kudos
Reasons for new Databricks driver
What are the reasons behind Databricks going for their own driver? What differences are made when switching between the previous Spark driver and the new Databricks driver?Is there any specific document I can look at or just the release notes?Also, w...
- 2664 Views
- 2 replies
- 1 kudos
- 1 kudos
Hey @Sriramkumar Thamizharasan​ Hope all is well! Just wanted to check in if you were able to resolve your issue would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from...
- 1 kudos
- 4301 Views
- 4 replies
- 1 kudos
How to perform UPCERTS and DELETE missing records from Target table using MERGE command?
Hi have the following case. I want to perform upcert operation. But along with upcert, I want to delete the records which are missing in source table, but present in the target table. You can think it as a master data update.Source table contains a f...
- 4301 Views
- 4 replies
- 1 kudos
- 1 kudos
Hey @Krishna Puthran​ Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.Cheers!
- 1 kudos
- 9320 Views
- 2 replies
- 1 kudos
How to remove old and unused Docker images
When running Docker for a long time, there are a lot of images in the system. How can I remove all unused Docker images at once safely to free up the storage?In addition, I also want to remove images pulled months ago, So, I'm not asking for removing...
- 9320 Views
- 2 replies
- 1 kudos
- 1 kudos
Hey there @william smith​ Hope everything is going great!Does @Prabakar Ammeappin​'s response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly? Else please let us know if you...
- 1 kudos
- 5677 Views
- 3 replies
- 3 kudos
Resolved! Orchestration Preview - Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified.
I've created a new job with the new UI / feature enabled. I managed to create one task with a new job cluster successfully but when adding a second task with a new job cluster and trying to save it I received the following error: Error updating [Job...
- 5677 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi, I have a similar issue.I'm using the 14 day free trial, setting up the default basic-starter cluster.Then I just followed the basic introduction of dbx with python. https://docs.databricks.com/dev-tools/dbx.htmlCommand Execute is working, but whe...
- 3 kudos
- 3245 Views
- 3 replies
- 0 kudos
Resolved! Databricks Academy - DataBricks SQL missing for standard users?
Hi there,I'm taking a class in Databricks academy on DataBricks SQL and my company dashboard and community dashboard both are missing the SQL dropdown option. How can those taking classes in the academy actually use the tools we are learning about if...
- 3245 Views
- 3 replies
- 0 kudos
- 0 kudos
https://community.databricks.com/s/question/0D58Y00008wA5klSAC/flatten-a-complex-json-file-and-load-into-a-delta-tableMyAARPMedicare.com
- 0 kudos
- 1289 Views
- 0 replies
- 0 kudos
Databricks Notebook Dashboard
I want to update one widget based on another widget. It gets updated but the dropdown shows the last selected in the dashboard view, but if I go to the notebook view from the dashboard view it updates. Any help? is it a bug?
- 1289 Views
- 0 replies
- 0 kudos
- 2702 Views
- 2 replies
- 5 kudos
- 2702 Views
- 2 replies
- 5 kudos
- 5 kudos
It will be attached to the same cluster, and both will see live the same situation (so it will be, in fact, not run two times but one shared)You can use Repos and branches so everyone will get their branch and own notebook.
- 5 kudos
- 2289 Views
- 1 replies
- 2 kudos
VPC status is BROKEN
Hi,AllWhen I check cloud resources, the VPC status is BROKEN.However, the cluster is runnning without any problems.What is the BROKEN state?And how can I get it healthy?Regards.
- 2289 Views
- 1 replies
- 2 kudos
- 2878 Views
- 2 replies
- 0 kudos
Analyzing 23 GB JSON file
Hey all, We're trying to analyze the data in a 23 GB JSON file. We're using the basic starter cluster - one node, 2 cpu x 8GB.We can read the JSON file into a spark dataframe and print out the schema but if we try and do any operations that won't c...
- 2878 Views
- 2 replies
- 0 kudos
- 6102 Views
- 5 replies
- 8 kudos
Resolved! How do I get information of aws cost?
Hi there.I can get Databricks cost(dbus) from usage_log. But, how do I get AWS cost information?I want to show Databricks and AWS cost in my Databricks SQL Dashborad.
- 6102 Views
- 5 replies
- 8 kudos
- 8 kudos
Hi @Kaniz Fatma​ @Prabakar Ammeappin​ Sorry for the late reply.Every answers was helpful for me! My problem has been solved. Thanks!
- 8 kudos
- 1378 Views
- 0 replies
- 0 kudos
How do I configure plot options through the `display` function as code (not through the interactive UI)?
How do I configure plot options through the `display` function as code (not through the interactive UI)? Specifically asking since when a notebook is scheduled to run in a databricks job there is no way of configuring the plot type.
- 1378 Views
- 0 replies
- 0 kudos
| User | Count |
|---|---|
| 1645 | |
| 793 | |
| 584 | |
| 349 | |
| 287 |
