- 8171 Views
- 3 replies
- 2 kudos
Resolved! Changing GCP billing account
Hello we need to change the billing account associated with our Databricks subscription. Is there any documentation available describing the procedure to be followed ? ThanksHoratiu
- 8171 Views
- 3 replies
- 2 kudos
- 2 kudos
Start by logging into the Google Cloud Platform. If you are a new user, you need to create an account before you subscribe to Data bricks. Once in the console, start by selecting an existing Google Cloud project, or create a new project, and confirm ...
- 2 kudos
- 2482 Views
- 1 replies
- 0 kudos
Infrastructure question
We've noticed that the GKE worker nodes which are automatically created when Databricks workspace is created inside GCP project are using the default compute engine SA which's not the best security approach, even Google doesn't recommend using defaul...
- 2482 Views
- 1 replies
- 0 kudos
- 1812 Views
- 0 replies
- 0 kudos
How do I add static tag values in the aws databricks-multi-workspace.template.yaml
Hello Team, I have a databricks workspace running on an AWS environment. I have a requirement where the team wanted to add a few customized tags as per the docs I see below the recommendationTagValue:Description: All new AWS objects get a tag with t...
- 1812 Views
- 0 replies
- 0 kudos
- 2778 Views
- 0 replies
- 0 kudos
Databricks cluster restarted inconsistantly causing job failure ( all purpose cluster)
"run failed with error message Driver of the cluster (0307-***-gpbwt) was restarted during the run.", "effectiveIntegrationRuntime": "vnet-ir-*-**** (East US) while performing merge operation.This error is not consistant. DB runtime: 11.3 LTS (inclu...
- 2778 Views
- 0 replies
- 0 kudos
- 4985 Views
- 1 replies
- 0 kudos
Recreating Unity Catalog object through different environments
Hi all! I am working on a DevOps project to automate the creation of UC objects through different environments (dev-test-prod). Each time we deploy our code to a different environment (using a Github workflow, not really relevant) we want to also cre...
- 4985 Views
- 1 replies
- 0 kudos
- 8279 Views
- 4 replies
- 2 kudos
CI/CD pipeline using Github
Hi Team,I've recently begun working with Databricks and I'm exploring options for setting up a CI/CD pipeline to pull the latest code from GitHub.I have to pull latest code(.sql) from Github whenever push is done to main branch and update .sql notebo...
- 8279 Views
- 4 replies
- 2 kudos
- 2 kudos
FWIW:we pull manually, but it is possible to automate that without any cost if you use Azure Devops. There is a free tier (depending on the number of pipelines/duration).
- 2 kudos
- 6084 Views
- 4 replies
- 1 kudos
Azure Databricks Workspace Editor - Cursor messed up - cannot edit code
I have been using the Azure Databricks Workspace Editor for a few weeks to put together a python script as well as a notebook.All was well, until yesterday evening. Since then I suddenly have the following issuethe cursor in the editor is misbehaving...
- 6084 Views
- 4 replies
- 1 kudos
- 1 kudos
Thanks @Chibberto - I will try the zoom level to see if it makes a difference.In the meantime, the latest issue is that the Autosave is not kicking in sometimes for several minutes. So, if I make a change and then re-run the job - the latest code is ...
- 1 kudos
- 4355 Views
- 0 replies
- 0 kudos
Databricks on Virtualization
Hi Team,Can you please direct me to any content on Databricks on Virtualization?Regards,Phanindra
- 4355 Views
- 0 replies
- 0 kudos
- 5705 Views
- 0 replies
- 3 kudos
What's new in Databricks for September 2023
Platform You can now use Structured Streaming to Stream Data from Apache Pulsar on Databricks. For more information : https://docs.databricks.com/en/structured-streaming/pulsar.html (DBR 14.1 required)Databricks Runtime 14.1 and 14.1 ML are now avail...
- 5705 Views
- 0 replies
- 3 kudos
- 1780 Views
- 0 replies
- 0 kudos
Bootstrap Timeout during cluster start on AWS cloud
Hi!We had bunch of strange failures for our jobs during 28-29 of September.Some jobs` runs could not start for some time (30-50 mins) and then were failed with an error:Unexpected failure while waiting for the cluster (0929-002141-2zkekhdj) to be rea...
- 1780 Views
- 0 replies
- 0 kudos
- 2022 Views
- 1 replies
- 1 kudos
Resolved! Databricks Contact us form not working
I got some issues with Databricks online certification. I filed twice at (https://help.databricks.com/s/contact-us?ReqType=training), but did not get any confirmation emails.@Cert-Team
- 2022 Views
- 1 replies
- 1 kudos
- 1 kudos
@Kaniz @Cert-Team Finally figured out why my request got dropped silently - I included a link in the form. Please indicate no link in the form submission section. Thanks a lot.
- 1 kudos
- 3951 Views
- 2 replies
- 0 kudos
om.microsoft.azure.storage.StorageException: The specifed resource name contains invalid characters.
Hi guys I'm relatively new to Databricks and struggling to implement an autoloader ( with trigger once = true ) in file notifications mode. I have CSV files in one container (landing zone). I would like the autoloader to pick up new and existing file...
- 3951 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi Kaniz, thank you for your reply. I initially made the mistake of using a capital letter in the queue as part of config files. I can now write, there is no error as a batch process. However, when I try to run the write stream, it says"Running Comma...
- 0 kudos
- 16332 Views
- 8 replies
- 1 kudos
My exam Datbricks Data Engineer Associate got suspended_need immediate help please (10/09/2023)
Hello Team,I encountered Pathetic experience while attempting my DataBricks Data engineer certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam.I want to file ...
- 16332 Views
- 8 replies
- 1 kudos
- 2156 Views
- 0 replies
- 0 kudos
xgboost.spark.core' has no attribute 'SparkXGBClassifierModel'
I got error: xgboost.spark.core' has no attribute 'SparkXGBClassifierModel' when attempting to load model. I have upgraded to xgboost-2.0.0.
- 2156 Views
- 0 replies
- 0 kudos
- 4421 Views
- 0 replies
- 0 kudos
Very large binary files ingestion error when using binaryFile reader
Hello, I am facing an error while trying to read a large binary file (rosbag format) using binaryFile reader. The file I am trying to read is approx 7GB large. Here's the error message I am getting:FileReadException: Error while reading file dbfs:/mn...
- 4421 Views
- 0 replies
- 0 kudos
