- 10931 Views
- 2 replies
- 5 kudos
Resolved! Connecting to DataLake Gen2 from Azure Databricks with Private Endpoint
Hi,I have datalake gen2 with vnet and private endpoint. I do have databricks workspace in same vnet. I am trying to access the datalake from databricks but I keep getting error when I allow access only for selected network in datalake. I get error w...
- 10931 Views
- 2 replies
- 5 kudos
- 5 kudos
You can always check the tutorial regarding ADLS and private link under this link https://community.databricks.com/s/feed/0D53f00001eQGOHCA4
- 5 kudos
- 3932 Views
- 1 replies
- 3 kudos
Errors in notebooks of Scalable Machine Learning with Apache Spark course in Databricks academy.
HI there,I'm following the course mentioned from Databricks Academy. I downloaded the .dbc archiive and working along side the videos from academy. In ML-08 - Hyperopt notebook, I see the following error in cmd 13. best_hyperparam = fmin(fn=objectiv...
- 3932 Views
- 1 replies
- 3 kudos
- 3 kudos
Tagging @Kaniz Fatma​ as there was no response what so ever!By any chance, do you know how to resolve these errors in the notebook?Thanks!
- 3 kudos
- 874 Views
- 0 replies
- 0 kudos
Thanks for the information that you share with us, Grey Cup 2022. I really like your content about this.
Thanks for the information that you share with us, Grey Cup 2022. I really like your content about this.
- 874 Views
- 0 replies
- 0 kudos
- 18668 Views
- 9 replies
- 2 kudos
Resolved! Max job concurrency per workspace
Per the documentation, a workspace is limited to 1k concurrent job runs.Can somebody clarify how the concurrency limit is set i.e:Is it 1k concurrent runs across all jobs in the workspaceIs it 1k concurrent runs for a single jobAlso, is there any way...
- 18668 Views
- 9 replies
- 2 kudos
- 2 kudos
Hi @Kaniz Fatma​ Weners gave some great suggestions on the issue we are dealing with. But some confirmation on the question from data bricks side would be much appreciated
- 2 kudos
- 12263 Views
- 3 replies
- 5 kudos
Resolved! How can we alter table with auto increment column for a delta table
How can we alter table with auto increment column for a delta tableI have tried this but not working:ALTER TABLE dbgtpTest.student ADD COLUMN Student_Id identity(100,1)any Suggestions will be helpful
- 12263 Views
- 3 replies
- 5 kudos
- 5 kudos
@Rakesh Reddy Badam​ , For ALTER ... ADD COLUMN in doc is only SYNC IDENTITY.If you want to add an identity column to the existing table just create a new table with an identity column and then copy the data.
- 5 kudos
- 3013 Views
- 1 replies
- 1 kudos
Is there any way to use key vault on offline environment azure databricks?
We are working for client in offline environment(VM is private) azure databricks, we store some credentials in azure key vault, since azure databricks is run on offline environment, i am unable to create secret scopes on azure databricks, it always t...
- 3013 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Kaniz Fatma​ apologies for the delayed response, I earlier mentioned that the data bricks run in a private environment which means no connectivity to InterNet, I already followed the link you have shared but didn't get the result. Either I have t...
- 1 kudos
- 4278 Views
- 2 replies
- 12 kudos
Resolved! Error on using Databricks Account API - invalid endpoint
I'm trying to configure audit logs for databricks and as a part of it I need to configure S3 storage using endpoint storage-configurations.But for some reason I'm getting invalid endpoint. I'm using following URL with basicAuth.https://accounts.cloud...
- 4278 Views
- 2 replies
- 12 kudos
- 12 kudos
Hey there @Aman Sehgal​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you...
- 12 kudos
- 14082 Views
- 8 replies
- 2 kudos
cluster issue
I signed up with databricks free trial but I am not be able to create new cluster , could you help me in this regard ?When i create cluster nothing happens and it terminates automatically , I'm on aws
- 14082 Views
- 8 replies
- 2 kudos
- 4691 Views
- 5 replies
- 5 kudos
Resolved! Azure Databricks: AnalysisException: Database 'bf' not found
I wanted to save my delta tables in my Databricks database. When I saveAsTable, there is an error message Azure Databricks: AnalysisException: Database 'bf' not found​Ye, There is no database named "bf" in my database.Here is my full code:import os i...
- 4691 Views
- 5 replies
- 5 kudos
- 16182 Views
- 2 replies
- 2 kudos
Resolved! Run result unavailable: job failed with error message Library installation failed for library due to user error for jar: "dbfs:/my-jar.jar"
Run result unavailable: job failed with error message Library installation failed for library due to user error for jar: "dbfs:/my-jar.jar" . Error messages: Library installation attempted on the driver node of cluster 0510-013936-3cc6d9kw and failed...
- 16182 Views
- 2 replies
- 2 kudos
- 2 kudos
Hey there @manivannan p​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from yo...
- 2 kudos
- 4310 Views
- 1 replies
- 0 kudos
No module named dlt
Cluster version 10.5 on AWS.Trying to import dlt gave error above.​Am I missing something?​
- 4310 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey there @Cathy Low​ Does @Kaniz Fatma​ 's response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly? Else please let us know if you need more help. We'd love to hear from y...
- 0 kudos
- 5386 Views
- 2 replies
- 6 kudos
Resolved! How to pass a variable which holds a value to child notebook using run command
Hello,We have 3 notebooks as below. And trying to send a variable where we pass the value to it via job to child notebook with %run commandNotebooks:notebook_par,notebook_child1 and notebook_child2.In parent note book we are calling notebook_child1 u...
- 5386 Views
- 2 replies
- 6 kudos
- 6 kudos
Hey there @Sailaja B​ How's it going?Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Chee...
- 6 kudos
- 47658 Views
- 10 replies
- 8 kudos
When to use delta lake versus relational database as a source for BI reporting?
Assume all of your data exists in delta tables and also in SQL server so you have a choice to report from either. Can someone share thoughts on "In what scenario you would not want report created from delta table and instead use the traditional rel...
- 47658 Views
- 10 replies
- 8 kudos
- 8 kudos
Hi @Kaniz Fatma​ - I would like a follow-up on @prasad vaze​ question regarding unsupported referential integrity. How does one work around that, using best practices as Databricks sees it?
- 8 kudos
- 870 Views
- 0 replies
- 0 kudos
greycupwinner.livejournal.com
Thanks for the information that you share with us, GREY CUP 2022 I really like your content about this.
- 870 Views
- 0 replies
- 0 kudos
- 1578 Views
- 1 replies
- 0 kudos
In Databricks, when saving a query, the changes do no persist. Any advice?
When returning to the query, the changes have reverted.Is this because the query is open by another user?How can this be resolved? #databricks
- 1578 Views
- 1 replies
- 0 kudos
- 0 kudos
We ARE using the save feature. But we are still loosing changes. Is this because we have multiple Databricks tabs open in separate Chrome browsers? Across 2 users.
- 0 kudos
| User | Count |
|---|---|
| 1632 | |
| 791 | |
| 513 | |
| 349 | |
| 287 |
