cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

zll_0091
by New Contributor III
  • 485 Views
  • 3 replies
  • 1 kudos

How to return the function result instead of the function syntax of a variable?

Hi,I'm trying to get the certain value of my variable in the for loop but it's returning the syntax instead of the value. Also, is it possible to covert this value to an integer? Thanks 

zll_0091_0-1723013056629.png
  • 485 Views
  • 3 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Contributor III
  • 1 kudos

Hi @zll_0091 ,Could you provide more code? What's inside dsfd variable? What's your expected outcome?

  • 1 kudos
2 More Replies
thibault
by Contributor II
  • 1170 Views
  • 2 replies
  • 1 kudos

Databricks CLI bundle run multiple jobs

Hi!I am using bundles to deploy various workflows, and as part of a CI pipeline, I want to run integration tests. They are in notebooks that I deploy and run with databricks CLI bundle with Azure DevOps.This allows me to run only one job at a time as...

  • 1170 Views
  • 2 replies
  • 1 kudos
Latest Reply
LettieTaylor
New Contributor II
  • 1 kudos

Thank you so much for the information.

  • 1 kudos
1 More Replies
zll_0091
by New Contributor III
  • 335 Views
  • 0 replies
  • 0 kudos

Can I load the files based on the data in my table as variable without iterating through each row?

Hi,I have created this table which contains the data that I need for my source path and target table. source_path: /data/customer/sid={sid}/abc=1/attr_provider={attr_prov}/source_data_provider_code={src_prov}/So basically, the value of each row are c...

zll_0091_2-1722958875477.png zll_0091_1-1722958858553.png zll_0091_3-1722958975973.png
  • 335 Views
  • 0 replies
  • 0 kudos
slechtd
by New Contributor II
  • 802 Views
  • 4 replies
  • 0 kudos

Cannot sign-in at accounts.cloud.databricks.com

Hi,I have registered for Community Edition and can access it with no problems trough: https://community.cloud.databricks.com/login.htmlNow, I'm interested in completing the free "lakehouse fundamentals" training here and taking the quiz to get the ba...

  • 802 Views
  • 4 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Contributor III
  • 0 kudos

Hi @slechtd , @qiuqiu You can't log in because this is login page for databricks customers. You should use login at community edition, like on the bottom left side of the below screen Furthermore, to get databricks fundamentals accreditation you need...

  • 0 kudos
3 More Replies
radix
by New Contributor II
  • 1145 Views
  • 1 replies
  • 0 kudos

Liquid clustering on and dynamic overwrites

I use the following option to write from multiple tasks to the same table with overwrite (in Pyspark).option("partitionOverwriteMode", "dynamic")The table was created with partition by so it works as expected.I read about liquid clustering and it's b...

  • 1145 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ranjeet1981
New Contributor II
  • 0 kudos

No it doesn't support partition overwrite. 

  • 0 kudos
Sameekshaji
by New Contributor II
  • 835 Views
  • 2 replies
  • 1 kudos

Memory leak

I created a databricks JDBC connection class following the code ##https://docs.databricks.com/en/integrations/jdbc/authentication.htm I observed that after a number of execute SQL calls , there were 27000 instances of com.databricks.client.jdbc42.int...

  • 835 Views
  • 2 replies
  • 1 kudos
Latest Reply
Sameekshaji
New Contributor II
  • 1 kudos

PLEASE revert ASAP

  • 1 kudos
1 More Replies
deane_h_s
by New Contributor III
  • 1254 Views
  • 2 replies
  • 3 kudos

Resolved! UCX Installation Error

I'm getting the following error when trying to install UCX on my local machine using the databricks CLI v0.212.1. I've authenticated the CLI with the required workspace using databricks config with the host and PAT generated. I also have admin privil...

  • 1254 Views
  • 2 replies
  • 3 kudos
Latest Reply
vidya_kothavale
New Contributor III
  • 3 kudos

 Try to install ucx previous version 0.28.2databricks labs install ucx@v0.28.2 

  • 3 kudos
1 More Replies
junaid-ahmed077
by New Contributor II
  • 902 Views
  • 1 replies
  • 2 kudos

Resolved! Error While creating the Databricks workspace on the AWS cloudformation stack

Hello,I was trying to create a Databricks workspace using a CloudFormation template. During the process, I found that we need Databricks account information, such as the workspace account email and workspace password. However, since we use SSO for lo...

  • 902 Views
  • 1 replies
  • 2 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 2 kudos

As @Retired_mod said, you just need to change authentication to token in your template or just change deployment to AWS::IAM::Role which has access. You can also consider switching to Terraform.

  • 2 kudos
fabuvel
by New Contributor
  • 805 Views
  • 1 replies
  • 1 kudos

Question about Databricks Academy Labs

Hello, I am new to Databricks, and I would like to know what I can get from Databricks academy labs vs. blended learning, since the price difference is very steep.Here it says that academy labs alone would already provide me with hands-on and guided ...

  • 805 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Contributor III
  • 1 kudos

Hi @fabuvel ,Yep, pretty much it. Some folks prefer learning with instructors. Added benefit of this approach is, when you have a question that isn't covered on self-pace learning course/lab you can always ask instructor to clarify any doubts.

  • 1 kudos
janelleglover
by Databricks Employee
  • 3075 Views
  • 5 replies
  • 9 kudos

Resolved! Submit your feedback and win a $25 gift card!

Your feedback is crucial to us and directly influences how we innovate and improve our customer experience.  To share your success and feedback with Databricks, please  visit this link.  The first 20 people to submit a completed survey response will ...

2023-08-instructor-led-training-community-post-image-358x250-2x (1).png
  • 3075 Views
  • 5 replies
  • 9 kudos
Latest Reply
roshanaroy
New Contributor II
  • 9 kudos

I am looking for a free voucher for databricks data engineer certification. Please guide

  • 9 kudos
4 More Replies
Marina_Shishkin
by New Contributor II
  • 1514 Views
  • 4 replies
  • 2 kudos

Databricks data engineer associate exam Suspended

@Cert-Team  @Certificate @Cert-Bricks Hi Team,Please help me, I have just been suspended from my above exam. At first I was told I was looking around too much even though I was genuinely looking at the screen only. I had completed all questions and w...

  • 1514 Views
  • 4 replies
  • 2 kudos
Latest Reply
jefflipkowitz
Databricks Employee
  • 2 kudos

I've had it happen to myself the team if you work with can get you setup. My lesson learned was not to schedule it on halloween. 

  • 2 kudos
3 More Replies
Pika
by New Contributor III
  • 863 Views
  • 3 replies
  • 1 kudos

Databricks Certified Data Engineer Associate - Suspended

Hello Team,My Databricks exam was scheduled for 4:00 pm IST on 21st July. I was giving my exam peacefully and was focused on the screen all the time. I was done with almost all question and the moment I started reviewing few questions which were mark...

  • 863 Views
  • 3 replies
  • 1 kudos
Latest Reply
Pika
New Contributor III
  • 1 kudos

@Cert-Team please help me out here , it is very frustrating.

  • 1 kudos
2 More Replies
Adyanka1999
by New Contributor III
  • 847 Views
  • 2 replies
  • 2 kudos

Databricks Certified Data Engineer Associate certification exam suspended_2024

Hi @Cert_Team,I am writing to request a review of my recently suspended exam. I believe that I have adhered to all exam rules and guidelines.I would like to provide some context for your understanding, I applied for Databricks Certified: Data Enginee...

  • 847 Views
  • 2 replies
  • 2 kudos
Latest Reply
Adyanka1999
New Contributor III
  • 2 kudos

Also, kindly resume the exam  from the last  question i attended. 

  • 2 kudos
1 More Replies
unity_Catalog
by New Contributor III
  • 1358 Views
  • 2 replies
  • 2 kudos

Resolved! Migrating dashboards from one workspace to another workspace

I'm exporting dashboard objects from an existing workspace to new workspace but after importing ,the underlying dashboards data is not coming to new workspace. I'm using the below code. Can anyone helpimport osimport requestsimport jsonimport logging...

  • 1358 Views
  • 2 replies
  • 2 kudos
Latest Reply
romy
Databricks Employee
  • 2 kudos

Hi, you can use the workspace API to import the dashboard: https://learn.microsoft.com/en-us/azure/databricks/dashboards/tutorials/workspace-lakeview-api#step-3-import-a-dashboard A code example is available on this thread: https://community.databric...

  • 2 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors