cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

thibault
by Contributor II
  • 1194 Views
  • 2 replies
  • 1 kudos

Databricks CLI bundle run multiple jobs

Hi!I am using bundles to deploy various workflows, and as part of a CI pipeline, I want to run integration tests. They are in notebooks that I deploy and run with databricks CLI bundle with Azure DevOps.This allows me to run only one job at a time as...

  • 1194 Views
  • 2 replies
  • 1 kudos
Latest Reply
LettieTaylor
New Contributor II
  • 1 kudos

Thank you so much for the information.

  • 1 kudos
1 More Replies
zll_0091
by New Contributor III
  • 335 Views
  • 0 replies
  • 0 kudos

Can I load the files based on the data in my table as variable without iterating through each row?

Hi,I have created this table which contains the data that I need for my source path and target table. source_path: /data/customer/sid={sid}/abc=1/attr_provider={attr_prov}/source_data_provider_code={src_prov}/So basically, the value of each row are c...

zll_0091_2-1722958875477.png zll_0091_1-1722958858553.png zll_0091_3-1722958975973.png
  • 335 Views
  • 0 replies
  • 0 kudos
slechtd
by New Contributor II
  • 817 Views
  • 4 replies
  • 0 kudos

Cannot sign-in at accounts.cloud.databricks.com

Hi,I have registered for Community Edition and can access it with no problems trough: https://community.cloud.databricks.com/login.htmlNow, I'm interested in completing the free "lakehouse fundamentals" training here and taking the quiz to get the ba...

  • 817 Views
  • 4 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Contributor III
  • 0 kudos

Hi @slechtd , @qiuqiu You can't log in because this is login page for databricks customers. You should use login at community edition, like on the bottom left side of the below screen Furthermore, to get databricks fundamentals accreditation you need...

  • 0 kudos
3 More Replies
radix
by New Contributor II
  • 1167 Views
  • 1 replies
  • 0 kudos

Liquid clustering on and dynamic overwrites

I use the following option to write from multiple tasks to the same table with overwrite (in Pyspark).option("partitionOverwriteMode", "dynamic")The table was created with partition by so it works as expected.I read about liquid clustering and it's b...

  • 1167 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ranjeet1981
New Contributor II
  • 0 kudos

No it doesn't support partition overwrite. 

  • 0 kudos
Sameekshaji
by New Contributor II
  • 848 Views
  • 2 replies
  • 1 kudos

Memory leak

I created a databricks JDBC connection class following the code ##https://docs.databricks.com/en/integrations/jdbc/authentication.htm I observed that after a number of execute SQL calls , there were 27000 instances of com.databricks.client.jdbc42.int...

  • 848 Views
  • 2 replies
  • 1 kudos
Latest Reply
Sameekshaji
New Contributor II
  • 1 kudos

PLEASE revert ASAP

  • 1 kudos
1 More Replies
deane_h_s
by New Contributor III
  • 1272 Views
  • 2 replies
  • 3 kudos

Resolved! UCX Installation Error

I'm getting the following error when trying to install UCX on my local machine using the databricks CLI v0.212.1. I've authenticated the CLI with the required workspace using databricks config with the host and PAT generated. I also have admin privil...

  • 1272 Views
  • 2 replies
  • 3 kudos
Latest Reply
vidya_kothavale
New Contributor III
  • 3 kudos

 Try to install ucx previous version 0.28.2databricks labs install ucx@v0.28.2 

  • 3 kudos
1 More Replies
junaid-ahmed077
by New Contributor II
  • 954 Views
  • 1 replies
  • 2 kudos

Resolved! Error While creating the Databricks workspace on the AWS cloudformation stack

Hello,I was trying to create a Databricks workspace using a CloudFormation template. During the process, I found that we need Databricks account information, such as the workspace account email and workspace password. However, since we use SSO for lo...

  • 954 Views
  • 1 replies
  • 2 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 2 kudos

As @Retired_mod said, you just need to change authentication to token in your template or just change deployment to AWS::IAM::Role which has access. You can also consider switching to Terraform.

  • 2 kudos
fabuvel
by New Contributor
  • 829 Views
  • 1 replies
  • 1 kudos

Question about Databricks Academy Labs

Hello, I am new to Databricks, and I would like to know what I can get from Databricks academy labs vs. blended learning, since the price difference is very steep.Here it says that academy labs alone would already provide me with hands-on and guided ...

  • 829 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Contributor III
  • 1 kudos

Hi @fabuvel ,Yep, pretty much it. Some folks prefer learning with instructors. Added benefit of this approach is, when you have a question that isn't covered on self-pace learning course/lab you can always ask instructor to clarify any doubts.

  • 1 kudos
janelleglover
by Databricks Employee
  • 3110 Views
  • 5 replies
  • 9 kudos

Resolved! Submit your feedback and win a $25 gift card!

Your feedback is crucial to us and directly influences how we innovate and improve our customer experience.  To share your success and feedback with Databricks, please  visit this link.  The first 20 people to submit a completed survey response will ...

2023-08-instructor-led-training-community-post-image-358x250-2x (1).png
  • 3110 Views
  • 5 replies
  • 9 kudos
Latest Reply
roshanaroy
New Contributor II
  • 9 kudos

I am looking for a free voucher for databricks data engineer certification. Please guide

  • 9 kudos
4 More Replies
Marina_Shishkin
by New Contributor II
  • 1531 Views
  • 4 replies
  • 2 kudos

Databricks data engineer associate exam Suspended

@Cert-Team  @Certificate @Cert-Bricks Hi Team,Please help me, I have just been suspended from my above exam. At first I was told I was looking around too much even though I was genuinely looking at the screen only. I had completed all questions and w...

  • 1531 Views
  • 4 replies
  • 2 kudos
Latest Reply
jefflipkowitz
Databricks Employee
  • 2 kudos

I've had it happen to myself the team if you work with can get you setup. My lesson learned was not to schedule it on halloween. 

  • 2 kudos
3 More Replies
Pika
by New Contributor III
  • 876 Views
  • 3 replies
  • 1 kudos

Databricks Certified Data Engineer Associate - Suspended

Hello Team,My Databricks exam was scheduled for 4:00 pm IST on 21st July. I was giving my exam peacefully and was focused on the screen all the time. I was done with almost all question and the moment I started reviewing few questions which were mark...

  • 876 Views
  • 3 replies
  • 1 kudos
Latest Reply
Pika
New Contributor III
  • 1 kudos

@Cert-Team please help me out here , it is very frustrating.

  • 1 kudos
2 More Replies
Adyanka1999
by New Contributor III
  • 859 Views
  • 2 replies
  • 2 kudos

Databricks Certified Data Engineer Associate certification exam suspended_2024

Hi @Cert_Team,I am writing to request a review of my recently suspended exam. I believe that I have adhered to all exam rules and guidelines.I would like to provide some context for your understanding, I applied for Databricks Certified: Data Enginee...

  • 859 Views
  • 2 replies
  • 2 kudos
Latest Reply
Adyanka1999
New Contributor III
  • 2 kudos

Also, kindly resume the exam  from the last  question i attended. 

  • 2 kudos
1 More Replies
unity_Catalog
by New Contributor III
  • 1406 Views
  • 2 replies
  • 2 kudos

Resolved! Migrating dashboards from one workspace to another workspace

I'm exporting dashboard objects from an existing workspace to new workspace but after importing ,the underlying dashboards data is not coming to new workspace. I'm using the below code. Can anyone helpimport osimport requestsimport jsonimport logging...

  • 1406 Views
  • 2 replies
  • 2 kudos
Latest Reply
romy
Databricks Employee
  • 2 kudos

Hi, you can use the workspace API to import the dashboard: https://learn.microsoft.com/en-us/azure/databricks/dashboards/tutorials/workspace-lakeview-api#step-3-import-a-dashboard A code example is available on this thread: https://community.databric...

  • 2 kudos
1 More Replies
argl1995dbks
by New Contributor III
  • 1415 Views
  • 5 replies
  • 1 kudos

To trigger databricks workflow on defined frequency

Hi Databricks, I am trying to run a databricks workflow on scheduled basis (for e.g. the frequency is after every five mins). Here is the databricks.yaml file: bundle:  name: dab_demo# include:#   - resources/*.ymlvariables:  job_cluster_key:    desc...

  • 1415 Views
  • 5 replies
  • 1 kudos
Latest Reply
argl1995dbks
New Contributor III
  • 1 kudos

Hi, let me explain you the current scenario, we have databricks workflows which has DS, DE and MLOps tasks. The workflows are meant to be triggered on a specific frequency i.e. Monthly and Quarterly and Quarterly workflow depends on the Monthly workf...

  • 1 kudos
4 More Replies
mhasel
by New Contributor II
  • 634 Views
  • 1 replies
  • 1 kudos

Cannot use Databricks VSCode extensions on repository with ".devcontainer" folder

Hi, I have a repository that contains a ".devcontainer" folder. I use VSCode and try to use the databricks extension following this guide When I run "Upload and Run File on Databricks" I have this error and then cannot run the python scriptSync Error...

  • 634 Views
  • 1 replies
  • 1 kudos
Latest Reply
mhasel
New Contributor II
  • 1 kudos

Hi @Retired_mod The folder lays plain in the repository. When logging on the databricks Web UI I can see that the folder (together with its content) was correctly copied But I still have the error messsage in VSCode 

  • 1 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors