- 1194 Views
- 2 replies
- 1 kudos
Databricks CLI bundle run multiple jobs
Hi!I am using bundles to deploy various workflows, and as part of a CI pipeline, I want to run integration tests. They are in notebooks that I deploy and run with databricks CLI bundle with Azure DevOps.This allows me to run only one job at a time as...
- 1194 Views
- 2 replies
- 1 kudos
- 335 Views
- 0 replies
- 0 kudos
Can I load the files based on the data in my table as variable without iterating through each row?
Hi,I have created this table which contains the data that I need for my source path and target table. source_path: /data/customer/sid={sid}/abc=1/attr_provider={attr_prov}/source_data_provider_code={src_prov}/So basically, the value of each row are c...
- 335 Views
- 0 replies
- 0 kudos
- 817 Views
- 4 replies
- 0 kudos
Cannot sign-in at accounts.cloud.databricks.com
Hi,I have registered for Community Edition and can access it with no problems trough: https://community.cloud.databricks.com/login.htmlNow, I'm interested in completing the free "lakehouse fundamentals" training here and taking the quiz to get the ba...
- 817 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @slechtd , @qiuqiu You can't log in because this is login page for databricks customers. You should use login at community edition, like on the bottom left side of the below screen Furthermore, to get databricks fundamentals accreditation you need...
- 0 kudos
- 1167 Views
- 1 replies
- 0 kudos
Liquid clustering on and dynamic overwrites
I use the following option to write from multiple tasks to the same table with overwrite (in Pyspark).option("partitionOverwriteMode", "dynamic")The table was created with partition by so it works as expected.I read about liquid clustering and it's b...
- 1167 Views
- 1 replies
- 0 kudos
- 0 kudos
No it doesn't support partition overwrite.
- 0 kudos
- 848 Views
- 2 replies
- 1 kudos
Memory leak
I created a databricks JDBC connection class following the code ##https://docs.databricks.com/en/integrations/jdbc/authentication.htm I observed that after a number of execute SQL calls , there were 27000 instances of com.databricks.client.jdbc42.int...
- 848 Views
- 2 replies
- 1 kudos
- 1272 Views
- 2 replies
- 3 kudos
Resolved! UCX Installation Error
I'm getting the following error when trying to install UCX on my local machine using the databricks CLI v0.212.1. I've authenticated the CLI with the required workspace using databricks config with the host and PAT generated. I also have admin privil...
- 1272 Views
- 2 replies
- 3 kudos
- 3 kudos
Try to install ucx previous version 0.28.2databricks labs install ucx@v0.28.2
- 3 kudos
- 954 Views
- 1 replies
- 2 kudos
Resolved! Error While creating the Databricks workspace on the AWS cloudformation stack
Hello,I was trying to create a Databricks workspace using a CloudFormation template. During the process, I found that we need Databricks account information, such as the workspace account email and workspace password. However, since we use SSO for lo...
- 954 Views
- 1 replies
- 2 kudos
- 2 kudos
As @Retired_mod said, you just need to change authentication to token in your template or just change deployment to AWS::IAM::Role which has access. You can also consider switching to Terraform.
- 2 kudos
- 829 Views
- 1 replies
- 1 kudos
Question about Databricks Academy Labs
Hello, I am new to Databricks, and I would like to know what I can get from Databricks academy labs vs. blended learning, since the price difference is very steep.Here it says that academy labs alone would already provide me with hands-on and guided ...
- 829 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @fabuvel ,Yep, pretty much it. Some folks prefer learning with instructors. Added benefit of this approach is, when you have a question that isn't covered on self-pace learning course/lab you can always ask instructor to clarify any doubts.
- 1 kudos
- 3110 Views
- 5 replies
- 9 kudos
Resolved! Submit your feedback and win a $25 gift card!
Your feedback is crucial to us and directly influences how we innovate and improve our customer experience. To share your success and feedback with Databricks, please visit this link. The first 20 people to submit a completed survey response will ...
- 3110 Views
- 5 replies
- 9 kudos
- 9 kudos
I am looking for a free voucher for databricks data engineer certification. Please guide
- 9 kudos
- 1531 Views
- 4 replies
- 2 kudos
Databricks data engineer associate exam Suspended
@Cert-Team @Certificate @Cert-Bricks Hi Team,Please help me, I have just been suspended from my above exam. At first I was told I was looking around too much even though I was genuinely looking at the screen only. I had completed all questions and w...
- 1531 Views
- 4 replies
- 2 kudos
- 2 kudos
I've had it happen to myself the team if you work with can get you setup. My lesson learned was not to schedule it on halloween.
- 2 kudos
- 876 Views
- 3 replies
- 1 kudos
Databricks Certified Data Engineer Associate - Suspended
Hello Team,My Databricks exam was scheduled for 4:00 pm IST on 21st July. I was giving my exam peacefully and was focused on the screen all the time. I was done with almost all question and the moment I started reviewing few questions which were mark...
- 876 Views
- 3 replies
- 1 kudos
- 859 Views
- 2 replies
- 2 kudos
Databricks Certified Data Engineer Associate certification exam suspended_2024
Hi @Cert_Team,I am writing to request a review of my recently suspended exam. I believe that I have adhered to all exam rules and guidelines.I would like to provide some context for your understanding, I applied for Databricks Certified: Data Enginee...
- 859 Views
- 2 replies
- 2 kudos
- 1406 Views
- 2 replies
- 2 kudos
Resolved! Migrating dashboards from one workspace to another workspace
I'm exporting dashboard objects from an existing workspace to new workspace but after importing ,the underlying dashboards data is not coming to new workspace. I'm using the below code. Can anyone helpimport osimport requestsimport jsonimport logging...
- 1406 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi, you can use the workspace API to import the dashboard: https://learn.microsoft.com/en-us/azure/databricks/dashboards/tutorials/workspace-lakeview-api#step-3-import-a-dashboard A code example is available on this thread: https://community.databric...
- 2 kudos
- 1415 Views
- 5 replies
- 1 kudos
To trigger databricks workflow on defined frequency
Hi Databricks, I am trying to run a databricks workflow on scheduled basis (for e.g. the frequency is after every five mins). Here is the databricks.yaml file: bundle: name: dab_demo# include:# - resources/*.ymlvariables: job_cluster_key: desc...
- 1415 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi, let me explain you the current scenario, we have databricks workflows which has DS, DE and MLOps tasks. The workflows are meant to be triggered on a specific frequency i.e. Monthly and Quarterly and Quarterly workflow depends on the Monthly workf...
- 1 kudos
- 634 Views
- 1 replies
- 1 kudos
Cannot use Databricks VSCode extensions on repository with ".devcontainer" folder
Hi, I have a repository that contains a ".devcontainer" folder. I use VSCode and try to use the databricks extension following this guide When I run "Upload and Run File on Databricks" I have this error and then cannot run the python scriptSync Error...
- 634 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Retired_mod The folder lays plain in the repository. When logging on the databricks Web UI I can see that the folder (together with its content) was correctly copied But I still have the error messsage in VSCode
- 1 kudos
