cancel
Showing results for 
Search instead for 
Did you mean: 
missing-QuestionPost
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

sanjay
by Valued Contributor II
  • 1991 Views
  • 3 replies
  • 3 kudos

maxFilesPerTrigger not working in bronze to silver layer

Hi,I am using Matillion architecture where autoloader picks files from AWS S3 and saves in delta lake. Next layer picks the changes from delta lake and does some processing. I am able to set batch size in autoloader and its working. But in bronze to...

  • 1991 Views
  • 3 replies
  • 3 kudos
Latest Reply
Lakshay
Esteemed Contributor
  • 3 kudos

Hi @Sanjay Jain​ , Could you try using a fresh checkpoint location if not already tried? Also, could you please check the logs what is the size of the micro batch it is currently processing?

  • 3 kudos
2 More Replies
Randomname
by New Contributor II
  • 1032 Views
  • 2 replies
  • 1 kudos

Grant Privileges to multiple tables/views in single schema

Is there a way to grant privileges to multiple tables/views using wild cards ?Example like Grant Select on *_views to user?

  • 1032 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @data guy​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.

  • 1 kudos
1 More Replies
carlosjrestr
by New Contributor III
  • 3567 Views
  • 3 replies
  • 4 kudos

Functional Difference between managed and external tables UC

Hi community,​Is there a summary or detail guidance on the functional differe​nce between managed and external tables in unity catalog? Looking at the documentation I can't find any specific functionality in databricks that is supported in managed ta...

  • 3567 Views
  • 3 replies
  • 4 kudos
Latest Reply
Anonymous
Not applicable
  • 4 kudos

Hi @Carlos Restrepo​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answe...

  • 4 kudos
2 More Replies
RV
by New Contributor II
  • 1195 Views
  • 1 replies
  • 2 kudos
  • 1195 Views
  • 1 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Ravi V​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.

  • 2 kudos
Vidisha
by New Contributor II
  • 2691 Views
  • 4 replies
  • 4 kudos

Automate Cluster creation

I am new to databricks and my lead told me that we create clusters for running the notebook manually. So please write one python script to do this automation i.e to create the clusters automatically.Can anyone help me to write the script using PySpa...

  • 2691 Views
  • 4 replies
  • 4 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 4 kudos

So you created interactive clusters which you want to use to run notebooks in a scheduled way?If so: you can schedule notebooks on an existing cluster (the schedule button) or in data factory use an existing cluster to run a notebook. So my answer s...

  • 4 kudos
3 More Replies
kll
by New Contributor III
  • 1170 Views
  • 2 replies
  • 3 kudos

Resolved! h3 hex ID using Databricks Mosaic is not the same as h3.geo_to_h3

I am testing the Databricks Mosaic Spatial Grid Indexing method to obtain the `h3 hex` of a given lat, long. # Get the latitude and longitude latitude = 37.7716736 longitude = -122.4485852   # Get the resolution resolution = 7   # Get the H3 hex ID h...

  • 1170 Views
  • 2 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Keval Shah​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...

  • 3 kudos
1 More Replies
ravin619
by New Contributor II
  • 2552 Views
  • 3 replies
  • 1 kudos

Resolved! dbutils command keeps on running

Hi All,Im running below command in my clusterdbutils.fs.ls("abfss://demo@###.dfs.core.window.net")I have done the spark.conf.set steps before running above command.It keeps on running for almost 30 mins and still shows as 'Running command'.I have res...

  • 2552 Views
  • 3 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Ravinder Singh​ We haven't heard from you since the last response from @Kaniz Fatma​  . Kindly share the information with us, and in return, we will provide you with the necessary solution.Thanks and Regards

  • 1 kudos
2 More Replies
karthik_p
by Esteemed Contributor
  • 1642 Views
  • 3 replies
  • 4 kudos

Unable to perform patch operation on users api which is in preview

Hi team,we would like to lock users from accessing workspace, we are able to get properties of user like groups etc..but when we are doing patch operation it is throwing 500 error while during post body in path we are providing entitlements

  • 1642 Views
  • 3 replies
  • 4 kudos
Latest Reply
karthik_p
Esteemed Contributor
  • 4 kudos

@Tyler Retzlaff​ our workspace is not UC enabled, only UC enabled need account level api. patch api we are using is from below linkhttps://docs.databricks.com/api/workspace/users/patch{"operations": [{"op": "update","path": "entitlements","value": "w...

  • 4 kudos
2 More Replies
Michelle_-_Devp
by New Contributor III
  • 2396 Views
  • 1 replies
  • 1 kudos

Resolved! How is everyone's project coming along?

There are a few more days until the deadline. Have you picked a project/topic? Has anyone started building yet or finishing things up? Don't forget about the demo video for your project submission here: https://devpost.com/submit-to/18245-so-you-thi...

  • 2396 Views
  • 1 replies
  • 1 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

@Hubert Dudek​ and @Werner Stinckens​ !

  • 1 kudos
AleksandraFrolo
by New Contributor III
  • 2923 Views
  • 3 replies
  • 4 kudos

Resolved! Access content in dataframe by loc/iloc or by [ ] [ ]?

Hello, Task: I am trying to understand, what approach is better to access the content in DataFrame.My piece of code:print("First approach: ", df["Purchase Address"][0])   print("Second approach: ", df.loc[0,"Purchase Address"])These lines are equal t...

  • 2923 Views
  • 3 replies
  • 4 kudos
Latest Reply
Anonymous
Not applicable
  • 4 kudos

@Aleksandra Frolova​ :Both approaches you mentioned are valid ways to access content in a DataFrame in pandas. Let's take a closer look at each approach:Using brackets []:df["Purchase Address"][0]Using loc or iloc:df.loc[0, "Purchase Address"]Both ap...

  • 4 kudos
2 More Replies
Gaurav007
by New Contributor III
  • 3513 Views
  • 3 replies
  • 2 kudos

Resolved! Certificate not received for Databricks Certified Associate Developer for Apache Spark 3.0.

Hi, I have passed the exam for Databricks Certified Associate Developer for Apache Spark 3.0 with 85% on 10 jun 2023. I received a mail where badge and credentials mentioned but didn't received any certificate with it. I raised a ticket also - #0033...

  • 3513 Views
  • 3 replies
  • 2 kudos
Latest Reply
Gaurav007
New Contributor III
  • 2 kudos

Hi vidula, got the cirtificate. Thanks

  • 2 kudos
2 More Replies
pradyumn9999
by New Contributor III
  • 3717 Views
  • 2 replies
  • 3 kudos

Resolved! When will I get Databricks Data Engineer associate voucher.

Its been a day since I passed the exam , still no badge recieved from Databricks​.

  • 3717 Views
  • 2 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Pradyumn Joshi​ We haven't heard from you since the last response from @Kaniz Fatma​ , and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to ot...

  • 3 kudos
1 More Replies
shan_chandra
by Esteemed Contributor
  • 2868 Views
  • 1 replies
  • 1 kudos

Resolved! multiple drivers for a sample jdbc client added to the Databricks cluster libraries?

How Databricks treats a jar when we upload multiple drivers for the same jdbc client (for example - oracle) how would databricks treat that jar and which would be considered in the class path?

  • 2868 Views
  • 1 replies
  • 1 kudos
Latest Reply
shan_chandra
Esteemed Contributor
  • 1 kudos

In the order, they were uploaded and the first JAR file with a matching name will be added to classpath. If you add multiple JAR files, Please ensure the desired version is uploaded first. so that it takes precedence.

  • 1 kudos
pg1
by New Contributor II
  • 3428 Views
  • 1 replies
  • 2 kudos

Resolved! I am not able to view Lakehouse Fundamental training videos, I just see menus, clicking does not open anything

I am not able to view Lakehouse Fundamental training videos, I just see menus, clicking does not open anything

  • 3428 Views
  • 1 replies
  • 2 kudos
Latest Reply
APadmanabhan
Moderator
  • 2 kudos

Hi, Can you confirm whether you are trying to access videos via Databricks academy? if so can you share the email address, alternatively, you could submit a ticket with us at

  • 2 kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!