cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Kasen
by New Contributor III
  • 1539 Views
  • 1 replies
  • 0 kudos

Materialized view in DLT pipeline

When setting up DLT pipeline, there are 3 types of product edition, Core, Pro and Advanced. When I compare DLT Classic Core and DLT Classic Pro, the difference is that DLT Classic Pro can handle CDC. Does it means if I'm using DLT Classic Core, I hav...

Get Started Discussions
DLT pipeline
Materialized view
  • 1539 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kasen
New Contributor III
  • 0 kudos

Also, If I'm using DLT Classic Core for DLT pipeline, the materialized view will be doing a full refresh or just update on the rows that have changes? 

  • 0 kudos
traillog
by New Contributor
  • 1334 Views
  • 0 replies
  • 0 kudos

Unzip multiple zip files in databricks

I have a zip file which in turn has multiple zip files inside it. I tried to write a code in databricks notebook to unzip all these files at once, but I ran into an error. So I started to unzip these one by one, but the code which worked in unzipping...

  • 1334 Views
  • 0 replies
  • 0 kudos
SHASHANK2
by New Contributor III
  • 2239 Views
  • 4 replies
  • 2 kudos

Resolved! About resuming the test - [ ref:_00D61JGc4._500Vp6jMk5:ref ]

Hello @Cert-Team I am very glad to hear from you,in response of the ticket (00481969), I have received mail for rescheduling of my test to resume. I am very thankful for your quick response in this matter.I have replied in mail about the date and tim...

  • 2239 Views
  • 4 replies
  • 2 kudos
Latest Reply
SHASHANK2
New Contributor III
  • 2 kudos

@Cert-Team, My issue has been clear. my test has been rescheduled to the time I have mentioned.I am very grateful for your help.Thanks and Regards@SHASHANK2 

  • 2 kudos
3 More Replies
Kishor
by New Contributor II
  • 2654 Views
  • 1 replies
  • 1 kudos

Issue with Creating and Running Databricks Jobs with new databricks cli v0.214.0

Hi Databricks Support,I'm encountering an issue with creating and running jobs on Databricks. Here are the details:Problem Description:When attempting to create and run a job using the old JSON (which was successfully used to create and run jobs usin...

Get Started Discussions
Databricks CLI
databricks jobs
  • 2654 Views
  • 1 replies
  • 1 kudos
Latest Reply
Kishor
New Contributor II
  • 1 kudos

Hi @Retired_mod ,Thanks for the reference links for the solution.I found the solution mentioned in this https://github.com/databricks/databricks-sdk-go/discussions/384  GitHub. By using the get-run API, I was able to retrieve the running status of my...

  • 1 kudos
aarshps
by New Contributor
  • 2361 Views
  • 1 replies
  • 0 kudos

Microsoft PNP Azure Log Analytics

There is this com.microsoft.pnp.Util package that is used inside my Scala notebook used for Azure Databricks to Azure Log Monitoring tables push for my application logs. When I updated my Databricks Runtime from 10.4 to 14 in my clusters, it starts t...

  • 2361 Views
  • 1 replies
  • 0 kudos
Latest Reply
NandiniN
Databricks Employee
  • 0 kudos

Hi @aarshps , How were you installing the library for the package com.microsoft.pnp.Util? Was it a library, whl, init script etc?

  • 0 kudos
Mehdi-LAMRANI
by New Contributor II
  • 1533 Views
  • 2 replies
  • 0 kudos

REST API call throwing 403

Hi,  Calling curl works just fine from my workspace ```` %sh curl --request GET "https://${DATABRICKS_HOST}/api/2.0/clusters/list" --header "Authorization: Bearer ${DATABRICKS_API_TOKEN}"```But when I transpose the same logic to a script in javascrip...

  • 1533 Views
  • 2 replies
  • 0 kudos
Latest Reply
NandiniN
Databricks Employee
  • 0 kudos

Thanks for sharing your findings, you can archive the ticket from Options on the right hand side.  

  • 0 kudos
1 More Replies
young_sheldon
by New Contributor
  • 1156 Views
  • 0 replies
  • 0 kudos

How to optimize a View ?

I have create a view from my underlying delta live table. Generally delta live table get auto optimize with vaccum in place. If thats so why do my view take 1 hour to be queried ? Any other way to optimize it ?

  • 1156 Views
  • 0 replies
  • 0 kudos
baricado
by New Contributor
  • 1650 Views
  • 2 replies
  • 1 kudos

How to Determine Which CLI Methods to Use?

The Databricks CLI is considered Legacy for versions below 0.17 and is in Public Preview for versions above 0.20. I have access to documentation for both these versions separately. As I am developing a new project, I prefer not to use legacy options ...

  • 1650 Views
  • 2 replies
  • 1 kudos
Latest Reply
NandiniN
Databricks Employee
  • 1 kudos

While the legacy CLI (versions 0.18 and below) is still available, it is not receiving any non-critical updates and it is recommend migrating to the new CLI as soon as possible. "Databricks recommends that you use Databricks CLI version 0.205 or abov...

  • 1 kudos
1 More Replies
MSD
by New Contributor
  • 1971 Views
  • 1 replies
  • 0 kudos

Community version now shows only the MLpersona

hiI have been using the community version for sometime and had saved some notebooks. While the notebooks are there in the workspace the different personas are not available as seen today. Only machine learning persona is visible.  Would like to check...

Get Started Discussions
community edition
  • 1971 Views
  • 1 replies
  • 0 kudos
Latest Reply
NandiniN
Databricks Employee
  • 0 kudos

Hi MSD,  We removed the different personas that was observed earlier and now it is a flat system (It is not a recent change, been there for sometime). The notebooks would be saved in your workspace hence they are accessible. Irrespective of the perso...

  • 0 kudos
hossam
by New Contributor
  • 1736 Views
  • 0 replies
  • 0 kudos

dbdemo LLAM CHATBOT RAG

i have an issue when running the below code using the default dbdemos in the advanced preparation , i have reduced the chunk_size and max_batch_size and running the code in a proper compute resources , could anyone help on that please :(spark.readStr...

  • 1736 Views
  • 0 replies
  • 0 kudos
hong
by New Contributor II
  • 6509 Views
  • 4 replies
  • 0 kudos

pytest error

Hello,I have a quick question. If my source code call pysark collect() or any method related to rdd methods, then pytest on my local PC will report the following error. My local machine doesn't have any specific setting for pyspark and I used findspa...

  • 6509 Views
  • 4 replies
  • 0 kudos
Latest Reply
hong
New Contributor II
  • 0 kudos

Thank you very much, brockb. Probably I will try it in databricks. Thanks.

  • 0 kudos
3 More Replies
Mehdi-LAMRANI
by New Contributor II
  • 5333 Views
  • 0 replies
  • 0 kudos

SQL Statement Execution API w/ Javascript (REST)

I need to use Databricks SQL Statement Execution API w/ Javascript (see example post )For some reason, Curl Works, Python works, but Javascript fails.This works : (curl)______________________________curl --request POST \https://adb-5750xxxxxxx.azured...

  • 5333 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels