- 2777 Views
- 4 replies
- 2 kudos
Migrating from Databricks Notebooks to IDE for Development
Hello, we are developers who have been creating a system in Databricks with Scala. We enabled the Git feature, so the project is in a repository. The project has a lot of notebooks and a lot of calls to other notebooks. Sometimes it is a little overw...
- 2777 Views
- 4 replies
- 2 kudos
- 2 kudos
it is true that we can't work without data bricks but we can develop an IDE and send the jar to databricks, this will allow us to create unit tests, and use the IDE capabilities (i.e fast navigation among classes).
- 2 kudos
- 5663 Views
- 3 replies
- 2 kudos
Resolved! is it possible to have multiple tabs in Dashboard? if not is there any workaround for this.
is it possible to have multiple tabs in Dashboard? if not is there any workaround for this.
- 5663 Views
- 3 replies
- 2 kudos
- 2 kudos
Hey @Janga Reddy​ Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.Cheers!
- 2 kudos
- 588 Views
- 0 replies
- 0 kudos
tersesayings.com
< a href="https://tersesayings.com/">Success</a>
- 588 Views
- 0 replies
- 0 kudos
- 1903 Views
- 2 replies
- 1 kudos
Plotly in python notebook- not seeing all graphs
Hello,I have written code that produces plotly charts in a python notebook (by facet) - each output is 4 line charts side-by-side with a few points highlighted.When I run this in a loop to produce more than 7 or 8 of my graphs, some of the features ...
- 1903 Views
- 2 replies
- 1 kudos
- 1 kudos
unfortunately I'm not able to share as it is in reference to proprietary company dataessentially, I can produce any one plotly graph like:[line graph with scatter]but if i produce, say, 8 of them (looping on a list of inputs), I get something like th...
- 1 kudos
- 1118 Views
- 0 replies
- 0 kudos
Differently named storage accounts in different environments
Hi,I have a solution design question on which I am looking for some help. We have 2 environments in azure (dev and prod), each env has its own ADLS storage account with a different name of course. Within Databricks code we are NOT leveraging the mou...
- 1118 Views
- 0 replies
- 0 kudos
- 6676 Views
- 2 replies
- 8 kudos
Resolved! How to get the list of all jobs available for a particular user?
As of now, if I try to list the jobs via "list job" API then there is a limit of 25 jobs only.Is there a way to list all the available/visible jobs to a user?
- 6676 Views
- 2 replies
- 8 kudos
- 8 kudos
Hello @Saurabh Verma​ Can the user generate the API token in the workspace and try to use the API?
- 8 kudos
- 11649 Views
- 9 replies
- 3 kudos
Databricks-connect invalid shard address
I want to use databricks inside vscode and I therefore need Databricks-connect I configure my settings using databricks-connect configure as follows: Databricks Host [https://adb-1409757184094616.16.azuredatabricks.net]Databricks Token [<my token>]Cl...
- 11649 Views
- 9 replies
- 3 kudos
- 3 kudos
In case it helps anyone, I ran into this issue and had to remove the trailing / from the host name. It used to work fine with the trailing / so something must have changed.
- 3 kudos
- 9604 Views
- 2 replies
- 5 kudos
Resolved! Connecting to DataLake Gen2 from Azure Databricks with Private Endpoint
Hi,I have datalake gen2 with vnet and private endpoint. I do have databricks workspace in same vnet. I am trying to access the datalake from databricks but I keep getting error when I allow access only for selected network in datalake. I get error w...
- 9604 Views
- 2 replies
- 5 kudos
- 5 kudos
You can always check the tutorial regarding ADLS and private link under this link https://community.databricks.com/s/feed/0D53f00001eQGOHCA4
- 5 kudos
- 3080 Views
- 1 replies
- 3 kudos
Errors in notebooks of Scalable Machine Learning with Apache Spark course in Databricks academy.
HI there,I'm following the course mentioned from Databricks Academy. I downloaded the .dbc archiive and working along side the videos from academy. In ML-08 - Hyperopt notebook, I see the following error in cmd 13. best_hyperparam = fmin(fn=objectiv...
- 3080 Views
- 1 replies
- 3 kudos
- 3 kudos
Tagging @Kaniz Fatma​ as there was no response what so ever!By any chance, do you know how to resolve these errors in the notebook?Thanks!
- 3 kudos
- 701 Views
- 0 replies
- 0 kudos
Thanks for the information that you share with us, Grey Cup 2022. I really like your content about this.
Thanks for the information that you share with us, Grey Cup 2022. I really like your content about this.
- 701 Views
- 0 replies
- 0 kudos
- 15210 Views
- 9 replies
- 2 kudos
Resolved! Max job concurrency per workspace
Per the documentation, a workspace is limited to 1k concurrent job runs.Can somebody clarify how the concurrency limit is set i.e:Is it 1k concurrent runs across all jobs in the workspaceIs it 1k concurrent runs for a single jobAlso, is there any way...
- 15210 Views
- 9 replies
- 2 kudos
- 2 kudos
Hi @Kaniz Fatma​ Weners gave some great suggestions on the issue we are dealing with. But some confirmation on the question from data bricks side would be much appreciated
- 2 kudos
- 10630 Views
- 3 replies
- 5 kudos
Resolved! How can we alter table with auto increment column for a delta table
How can we alter table with auto increment column for a delta tableI have tried this but not working:ALTER TABLE dbgtpTest.student ADD COLUMN Student_Id identity(100,1)any Suggestions will be helpful
- 10630 Views
- 3 replies
- 5 kudos
- 5 kudos
@Rakesh Reddy Badam​ , For ALTER ... ADD COLUMN in doc is only SYNC IDENTITY.If you want to add an identity column to the existing table just create a new table with an identity column and then copy the data.
- 5 kudos
- 2571 Views
- 1 replies
- 1 kudos
Is there any way to use key vault on offline environment azure databricks?
We are working for client in offline environment(VM is private) azure databricks, we store some credentials in azure key vault, since azure databricks is run on offline environment, i am unable to create secret scopes on azure databricks, it always t...
- 2571 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Kaniz Fatma​ apologies for the delayed response, I earlier mentioned that the data bricks run in a private environment which means no connectivity to InterNet, I already followed the link you have shared but didn't get the result. Either I have t...
- 1 kudos
- 3385 Views
- 2 replies
- 12 kudos
Resolved! Error on using Databricks Account API - invalid endpoint
I'm trying to configure audit logs for databricks and as a part of it I need to configure S3 storage using endpoint storage-configurations.But for some reason I'm getting invalid endpoint. I'm using following URL with basicAuth.https://accounts.cloud...
- 3385 Views
- 2 replies
- 12 kudos
- 12 kudos
Hey there @Aman Sehgal​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you...
- 12 kudos
- 12656 Views
- 8 replies
- 2 kudos
cluster issue
I signed up with databricks free trial but I am not be able to create new cluster , could you help me in this regard ?When i create cluster nothing happens and it terminates automatically , I'm on aws
- 12656 Views
- 8 replies
- 2 kudos
| User | Count |
|---|---|
| 1612 | |
| 768 | |
| 348 | |
| 286 | |
| 252 |
