cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Ru
by New Contributor III
  • 898 Views
  • 0 replies
  • 0 kudos

Compatibility Issue Between Databricks Runtime and Delta Live Tables: Request for v15.2 Release Time

We are experiencing a compatibility issue between the Databricks Runtime version and the Delta Live Tables (DLT) Runtime. We need to upgrade to Databricks Runtime 15.2 to enable the auto schema evolution feature. However, Databricks Runtime 15.2 requ...

Get Started Discussions
Compatibility
dlt
Release Plan
  • 898 Views
  • 0 replies
  • 0 kudos
DavidKxx
by Contributor
  • 7572 Views
  • 4 replies
  • 0 kudos

Resolved! Have code stay hidden even when the notebook is copied

When I save a certain Python notebook where I have selected Hide Code and Hide Results on certain cells, those conditions persist.  For example, when I come back the next day in a new session, the hidden material is still hidden.When the notebook is ...

  • 7572 Views
  • 4 replies
  • 0 kudos
Latest Reply
Alok7661
New Contributor II
  • 0 kudos

In my situation we cannot split this notebook as ADF pipeline is already in PROD ,I have tried to use the option %%capture .It helps to ran the notebook within size limits but somehow it is corrupting the output. Also checked in the Databricks AI and...

  • 0 kudos
3 More Replies
canbirlik
by New Contributor
  • 1153 Views
  • 0 replies
  • 0 kudos

Databricks Asset Bundles - Failed to install provider

Hello All,When I try to deploy my bundle, I get the following error.I can't edit the bundle.tf.json, I suppose it is created automatically. Does anyone have a solution for the same problem?Many Thanks,Can$ databricks bundle deploy -t devBuilding my_p...

  • 1153 Views
  • 0 replies
  • 0 kudos
vanagnostopoulo
by New Contributor III
  • 1524 Views
  • 2 replies
  • 0 kudos

CLI is not helpful in exporting Error: expected to have the absolute path of the object or directory

I try to export a job as a DBA in order to create an Asset Bundle according to thishttps://community.databricks.com/t5/data-engineering/databricks-asset-bundle-dab-from-existing-workspace/td-p/49309I am on Windows 10 Pro x64 withDatabricks CLI v0.223...

  • 1524 Views
  • 2 replies
  • 0 kudos
Latest Reply
artsheiko
Databricks Employee
  • 0 kudos

To export an existing folder under /Workspace/... export-dir command could be used :  databricks workspace export-dir /Workspace/Applications/ucx/logs/migrate-tables/run-123-0/ /Users/artem.sheiko/logs  

  • 0 kudos
1 More Replies
Phani1
by Valued Contributor II
  • 2793 Views
  • 1 replies
  • 0 kudos

Databricks serverless Vs snowflake

Hi All,We want to switch from Snowflake to Databricks SQL Warehouse/serverless to simplify our data layers and reduce data copies before the reporting layer. Please share the benefits of using serverless over Snowflake and any limitations you see. We...

  • 2793 Views
  • 1 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

one big pro is that you do not need to copy data to the dwh. also your transformations and analytics queries reside on the same platform (databricks).If databricks can cover all the requirementsm compared to snowflakem is hard to tell.  Probably ther...

  • 0 kudos
Databricks_info
by New Contributor II
  • 15314 Views
  • 5 replies
  • 2 kudos

Concurrent Update to Delta - Throws error

Team,I get a ConcurrentAppendException: Files were added to the root of the table by a concurrent update when trying to update a table which executes via jobs with for each activity in ADF,I tried with Databricks run time 14.x and set the delete vect...

  • 15314 Views
  • 5 replies
  • 2 kudos
Latest Reply
rpiotr
New Contributor III
  • 2 kudos

In case of such an issue, I would like to suggest apply retry and try except logic (you can use one of existing libraries) in both concurrent updates - it should help, and jobs won't report any error.

  • 2 kudos
4 More Replies
PushkarDeole
by New Contributor III
  • 1356 Views
  • 3 replies
  • 0 kudos

Unable to set shuffle partitions on DLT pipeline

Hello,We are using a 5 worker node DLT job compute for a continuous mode streaming pipeline. The worker configuration is Standard_D4ads_v5 i.e. 4 cores so total cores across 5 workers is 20 cores.We have wide transformation at some places in the pipe...

  • 1356 Views
  • 3 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @PushkarDeole ,Each Delta Live Tables pipeline has two associated clusters:The updates cluster processes pipeline updates.The maintenance cluster runs daily maintenance tasks.According to docs, if you want to configure settings at the pipeline lev...

  • 0 kudos
2 More Replies
ramesh7598
by New Contributor II
  • 1343 Views
  • 1 replies
  • 0 kudos

Clarification on Acceptable ID Proof for Databricks Associate Exam

Hi,I am planning to take the Databricks Associate exam in the upcoming week. My current ID proof is my original driving license issued by the Tamil Nadu government; however, it is laminated rather than a hard plastic card.Could you please confirm if ...

  • 1343 Views
  • 1 replies
  • 0 kudos
Latest Reply
ramesh7598
New Contributor II
  • 0 kudos

Hi Databricks community and @Cert-Team,Can you please help me here? The reason I am asking is Microsoft certification doesn’t approve laminated id proof’s.

  • 0 kudos
lakshmikanth-01
by New Contributor II
  • 1478 Views
  • 1 replies
  • 0 kudos

Unable to access Community Edition

I'm trying to create community edition account but everytime i try it shows" An error has occurred. Please try again later."I have attached the screenshot.I also tried accesiing Databricks in a differenct pc based on the answers from previous threads...

  • 1478 Views
  • 1 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

By any chance is that email address already registered with another Databricks Tier (like company or paid)?  Can you try in incognito mode with all ad blockers/popup blockers disabled

  • 0 kudos
AcrobaticMonkey
by New Contributor II
  • 1045 Views
  • 1 replies
  • 1 kudos

Instance profiles are not working in Shared access mode

I’m trying to fetch billing data from an AWS account using boto3 to assume a role that has access to this information. This operation works fine in No Isolation and Single User access modes, but it fails in Shared access mode. Since I need to store t...

  • 1045 Views
  • 1 replies
  • 1 kudos
Latest Reply
gchandra
Databricks Employee
  • 1 kudos

Instance Profiles are open for all, they won't work in Shared access mode. Using Storage credentials, create  External Locations. Cleaner way to Govern the access.

  • 1 kudos
RahulChaubey
by New Contributor III
  • 4229 Views
  • 4 replies
  • 1 kudos

Resolved! Can we get notebook owner using notebook path as parameter in api ?

I need to get the notebook owner using api or some other way by passing notebook path as parameter.

  • 4229 Views
  • 4 replies
  • 1 kudos
Latest Reply
nkumar18
New Contributor II
  • 1 kudos

Hi @RahulChaubey Did you find any solution to your problem?

  • 1 kudos
3 More Replies
Kinger
by New Contributor II
  • 3782 Views
  • 2 replies
  • 2 kudos

Associating a Git Credential with a Service Principal using Terraform Provider (AWS)

I am attempting to create a Databrick Repo in a workspace via Terraform. I would like the Repo and the associated Git Credential to be associated with a Service Principal. In my initial run, the Terraform provider is associated with the user defined ...

  • 3782 Views
  • 2 replies
  • 2 kudos
Latest Reply
nicole_lu_PM
Databricks Employee
  • 2 kudos

Hi Kinger and Debi-Moha, Do the steps in the "Use a service principal with Databricks Git folders" documentation work for you?  Specifically for Terraform: https://docs.databricks.com/en/repos/ci-cd-techniques-with-repos.html#terraform-integration Th...

  • 2 kudos
1 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels