- 1794 Views
- 1 replies
- 1 kudos
Resolved! Unique ID of table values is not unique anymore after merge every x-times
I have two tables with unique IDs:ID val ID val1 10 1 102 11 2 103 13 ...
- 1794 Views
- 1 replies
- 1 kudos
- 1 kudos
@Lukas Goldschmied​ :There are a few reasons why you might be experiencing this issue:Data Skew: Data skew is a common problem in distributed computing when one or more nodes in the cluster have more data to process than others. This can lead to long...
- 1 kudos
- 12661 Views
- 5 replies
- 1 kudos
Resolved! Databricks JDBC/ODBC write batch size
I have spent way too much time to find a solution to the problem of efficiently writing data to Databricks via JDBC/ODBC. I have looked into countless docs, blogs and repos and I cannot find one example where someone is setting some kind of batch/bul...
- 12661 Views
- 5 replies
- 1 kudos
- 6575 Views
- 4 replies
- 0 kudos
Unable to get or download fundamentals of databricks lake house platform badge download
Hi Team,I have completed the fundamentals of databricks lakehouse platform and received the certificate but unable to download or get the badge.When I login to website I am unbale to see the badge as well.Please help me on this.I haven't received any...
- 6575 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @Nupur Dogra​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so w...
- 0 kudos
- 2232 Views
- 6 replies
- 0 kudos
I have attended an event on certification preparation on databricks data engineer associate on 17th Jan 2023.I have filled the survey form and it was ...
I have attended an event on certification preparation on databricks data engineer associate on 17th Jan 2023.I have filled the survey form and it was mentioned that I will receive the voucher in early Feb.Still I have not received.Please update me as...
- 2232 Views
- 6 replies
- 0 kudos
- 0 kudos
Hi @Rituparna Das​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so...
- 0 kudos
- 8641 Views
- 11 replies
- 2 kudos
Exam issues
How to approach the databricks team if we facing any problem ​Some time question is not appearing properly so any one know the solution kindly tell me ​
- 8641 Views
- 11 replies
- 2 kudos
- 2 kudos
Hi @S Meghala​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 2 kudos
- 1725 Views
- 2 replies
- 0 kudos
Delta write stream to different folders dynamically based on input file
I have root folder and files are getting ingested in sub folders​ . Want to build a workflow which will write stream based on file being ingested
- 1725 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Krishnamoorthy Natarajan​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Y...
- 0 kudos
- 5198 Views
- 5 replies
- 0 kudos
The Academy training "Introduction to Delta Live Tables" data source error
Hi,I flow the databricks academy training for "Introduction to Delta Live Tables", but it is cannot setup the environment, when excute first notebook "1_DLT UI Walkthrough", below is the error, who can provide the new data source path for this traini...
- 5198 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @fan tian​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we c...
- 0 kudos
- 2475 Views
- 3 replies
- 0 kudos
Databricks-PowerBI-Architecture-Help
Hello Community,We are currently working designing Power BI reports, the data source is databricks. We have all our reporting data in bronze/silver layer of databricks. we want to create summarized/aggregated tables in Gold layer and we want to conne...
- 2475 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @bodempudi venkat​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...
- 0 kudos
- 2496 Views
- 2 replies
- 0 kudos
What is a good way to implement unit tests using github actions for databricks?
I am trying to use a git template for unit tests on a databricks project. The framework uses pylint, pytest and black to check the code. But I am having a lot of trouble getting the github actions vm to run the code without issues. I have had issues ...
- 2496 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Stian Arntsen​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so...
- 0 kudos
- 4114 Views
- 2 replies
- 0 kudos
Creating an external table reference vs creating a view
In a practical sense, what is the difference between creating an external table;create table my_catalog.my_schema.my_favourite_table location 'abfss://path/to/my/dataversus creating a view that references the same dataset;create view my_catalog.my_sc...
- 4114 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Nicholas Mead​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedbac...
- 0 kudos
- 2094 Views
- 3 replies
- 0 kudos
Performance b/w Managed Table and Un-Managed table
I am using Databricks in Azure. I want to mount ADLS Gen2 on Databricks and create unmanged (external) tables on the mount point. But before that I want to know which will give best performance, is it Managed table (stores data in DBFS root)or Un-ma...
- 2094 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Paramesh Malla​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedba...
- 0 kudos
- 1241 Views
- 2 replies
- 0 kudos
github to adb workspace linkage
i have a workspace in my adb and in that workspace i have folder contains lots of notebook , for backup purpoe i want to copy all the notebook in my github repo, how can i do that in one shot ?
- 1241 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @suman mukherjee​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedb...
- 0 kudos
- 7196 Views
- 2 replies
- 3 kudos
Getting error "User is not an owner of Account" when creating a storage credential in Azure Databricks
I'm using Azure Databricks.I've followed this guide to create an Azure Storage Account and an Access Connector for Azure Databricks. I've given the `Storage Blob Data Contributor` role to the Access Connector in the Storage Account. When I go to the ...
- 7196 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Alex Loddengaard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...
- 3 kudos
- 2609 Views
- 2 replies
- 0 kudos
Delta Live Table Merge/Upserts
Hello,I am trying to create a basic DLT pipeline which does an incremental load. First time it runs perfectly without any issues. However when there are records to be updated, the pipeline fails with the following error:"Flow silver has FAILED fatall...
- 2609 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Ram LH​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback will ...
- 0 kudos
- 7743 Views
- 14 replies
- 23 kudos
How to secure all clusters and then start running the code
When there are slow nodes, sometimes a job needs to resize its number of clusters to reach the required number of nodes. Is there any way to make sure no code is running before all nodes are secured? Thank you!
- 7743 Views
- 14 replies
- 23 kudos
- 23 kudos
Hi @Leo Bao​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ca...
- 23 kudos
| User | Count |
|---|---|
| 1611 | |
| 768 | |
| 348 | |
| 286 | |
| 252 |
