- 2861 Views
- 1 replies
- 1 kudos
Resolved! Unique ID of table values is not unique anymore after merge every x-times
I have two tables with unique IDs:ID val ID val1 10 1 102 11 2 103 13 ...
- 2861 Views
- 1 replies
- 1 kudos
- 1 kudos
@Lukas Goldschmied​ :There are a few reasons why you might be experiencing this issue:Data Skew: Data skew is a common problem in distributed computing when one or more nodes in the cluster have more data to process than others. This can lead to long...
- 1 kudos
- 20934 Views
- 5 replies
- 1 kudos
Resolved! Databricks JDBC/ODBC write batch size
I have spent way too much time to find a solution to the problem of efficiently writing data to Databricks via JDBC/ODBC. I have looked into countless docs, blogs and repos and I cannot find one example where someone is setting some kind of batch/bul...
- 20934 Views
- 5 replies
- 1 kudos
- 7918 Views
- 4 replies
- 0 kudos
Unable to get or download fundamentals of databricks lake house platform badge download
Hi Team,I have completed the fundamentals of databricks lakehouse platform and received the certificate but unable to download or get the badge.When I login to website I am unbale to see the badge as well.Please help me on this.I haven't received any...
- 7918 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @Nupur Dogra​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so w...
- 0 kudos
- 3751 Views
- 6 replies
- 0 kudos
I have attended an event on certification preparation on databricks data engineer associate on 17th Jan 2023.I have filled the survey form and it was ...
I have attended an event on certification preparation on databricks data engineer associate on 17th Jan 2023.I have filled the survey form and it was mentioned that I will receive the voucher in early Feb.Still I have not received.Please update me as...
- 3751 Views
- 6 replies
- 0 kudos
- 0 kudos
Hi @Rituparna Das​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so...
- 0 kudos
- 12445 Views
- 11 replies
- 2 kudos
Exam issues
How to approach the databricks team if we facing any problem ​Some time question is not appearing properly so any one know the solution kindly tell me ​
- 12445 Views
- 11 replies
- 2 kudos
- 2 kudos
Hi @S Meghala​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 2 kudos
- 2587 Views
- 2 replies
- 0 kudos
Delta write stream to different folders dynamically based on input file
I have root folder and files are getting ingested in sub folders​ . Want to build a workflow which will write stream based on file being ingested
- 2587 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Krishnamoorthy Natarajan​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Y...
- 0 kudos
- 8980 Views
- 5 replies
- 0 kudos
The Academy training "Introduction to Delta Live Tables" data source error
Hi,I flow the databricks academy training for "Introduction to Delta Live Tables", but it is cannot setup the environment, when excute first notebook "1_DLT UI Walkthrough", below is the error, who can provide the new data source path for this traini...
- 8980 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @fan tian​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we c...
- 0 kudos
- 4319 Views
- 3 replies
- 0 kudos
Databricks-PowerBI-Architecture-Help
Hello Community,We are currently working designing Power BI reports, the data source is databricks. We have all our reporting data in bronze/silver layer of databricks. we want to create summarized/aggregated tables in Gold layer and we want to conne...
- 4319 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @bodempudi venkat​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...
- 0 kudos
- 4032 Views
- 2 replies
- 0 kudos
What is a good way to implement unit tests using github actions for databricks?
I am trying to use a git template for unit tests on a databricks project. The framework uses pylint, pytest and black to check the code. But I am having a lot of trouble getting the github actions vm to run the code without issues. I have had issues ...
- 4032 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Stian Arntsen​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so...
- 0 kudos
- 6268 Views
- 2 replies
- 0 kudos
Creating an external table reference vs creating a view
In a practical sense, what is the difference between creating an external table;create table my_catalog.my_schema.my_favourite_table location 'abfss://path/to/my/dataversus creating a view that references the same dataset;create view my_catalog.my_sc...
- 6268 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Nicholas Mead​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedbac...
- 0 kudos
- 3418 Views
- 3 replies
- 0 kudos
Performance b/w Managed Table and Un-Managed table
I am using Databricks in Azure. I want to mount ADLS Gen2 on Databricks and create unmanged (external) tables on the mount point. But before that I want to know which will give best performance, is it Managed table (stores data in DBFS root)or Un-ma...
- 3418 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Paramesh Malla​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedba...
- 0 kudos
- 2150 Views
- 2 replies
- 0 kudos
github to adb workspace linkage
i have a workspace in my adb and in that workspace i have folder contains lots of notebook , for backup purpoe i want to copy all the notebook in my github repo, how can i do that in one shot ?
- 2150 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @suman mukherjee​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedb...
- 0 kudos
- 9569 Views
- 2 replies
- 3 kudos
Getting error "User is not an owner of Account" when creating a storage credential in Azure Databricks
I'm using Azure Databricks.I've followed this guide to create an Azure Storage Account and an Access Connector for Azure Databricks. I've given the `Storage Blob Data Contributor` role to the Access Connector in the Storage Account. When I go to the ...
- 9569 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Alex Loddengaard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...
- 3 kudos
- 4084 Views
- 2 replies
- 0 kudos
Delta Live Table Merge/Upserts
Hello,I am trying to create a basic DLT pipeline which does an incremental load. First time it runs perfectly without any issues. However when there are records to be updated, the pipeline fails with the following error:"Flow silver has FAILED fatall...
- 4084 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Ram LH​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback will ...
- 0 kudos
- 13272 Views
- 14 replies
- 23 kudos
How to secure all clusters and then start running the code
When there are slow nodes, sometimes a job needs to resize its number of clusters to reach the required number of nodes. Is there any way to make sure no code is running before all nodes are secured? Thank you!
- 13272 Views
- 14 replies
- 23 kudos
- 23 kudos
Hi @Leo Bao​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ca...
- 23 kudos
| User | Count |
|---|---|
| 1645 | |
| 793 | |
| 586 | |
| 349 | |
| 287 |
