by
sanjay
• Valued Contributor II
- 701 Views
- 3 replies
- 3 kudos
Hi,I am using Matillion architecture where autoloader picks files from AWS S3 and saves in delta lake. Next layer picks the changes from delta lake and does some processing. I am able to set batch size in autoloader and its working. But in bronze to...
- 701 Views
- 3 replies
- 3 kudos
Latest Reply
Hi @Sanjay Jain​ , Could you try using a fresh checkpoint location if not already tried? Also, could you please check the logs what is the size of the micro batch it is currently processing?
2 More Replies
- 798 Views
- 2 replies
- 1 kudos
Is there a way to grant privileges to multiple tables/views using wild cards ?Example like Grant Select on *_views to user?
- 798 Views
- 2 replies
- 1 kudos
Latest Reply
Hi @data guy​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
1 More Replies
- 1716 Views
- 3 replies
- 4 kudos
Hi community,​Is there a summary or detail guidance on the functional differe​nce between managed and external tables in unity catalog? Looking at the documentation I can't find any specific functionality in databricks that is supported in managed ta...
- 1716 Views
- 3 replies
- 4 kudos
Latest Reply
Hi @Carlos Restrepo​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answe...
2 More Replies
- 1159 Views
- 4 replies
- 4 kudos
I am new to databricks and my lead told me that we create clusters for running the notebook manually. So please write one python script to do this automation i.e to create the clusters automatically.Can anyone help me to write the script using PySpa...
- 1159 Views
- 4 replies
- 4 kudos
Latest Reply
So you created interactive clusters which you want to use to run notebooks in a scheduled way?If so: you can schedule notebooks on an existing cluster (the schedule button) or in data factory use an existing cluster to run a notebook. So my answer s...
3 More Replies
by
kll
• New Contributor III
- 866 Views
- 2 replies
- 3 kudos
I am testing the Databricks Mosaic Spatial Grid Indexing method to obtain the `h3 hex` of a given lat, long. # Get the latitude and longitude
latitude = 37.7716736
longitude = -122.4485852
# Get the resolution
resolution = 7
# Get the H3 hex ID
h...
- 866 Views
- 2 replies
- 3 kudos
Latest Reply
Hi @Keval Shah​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
1 More Replies
- 934 Views
- 3 replies
- 1 kudos
Hi All,Im running below command in my clusterdbutils.fs.ls("abfss://demo@###.dfs.core.window.net")I have done the spark.conf.set steps before running above command.It keeps on running for almost 30 mins and still shows as 'Running command'.I have res...
- 934 Views
- 3 replies
- 1 kudos
Latest Reply
Hi @Ravinder Singh​ We haven't heard from you since the last response from @Kaniz Fatma​ . Kindly share the information with us, and in return, we will provide you with the necessary solution.Thanks and Regards
2 More Replies
- 1113 Views
- 3 replies
- 4 kudos
Hi team,we would like to lock users from accessing workspace, we are able to get properties of user like groups etc..but when we are doing patch operation it is throwing 500 error while during post body in path we are providing entitlements
- 1113 Views
- 3 replies
- 4 kudos
Latest Reply
@Tyler Retzlaff​ our workspace is not UC enabled, only UC enabled need account level api. patch api we are using is from below linkhttps://docs.databricks.com/api/workspace/users/patch{"operations": [{"op": "update","path": "entitlements","value": "w...
2 More Replies
- 544 Views
- 1 replies
- 1 kudos
There are a few more days until the deadline. Have you picked a project/topic? Has anyone started building yet or finishing things up? Don't forget about the demo video for your project submission here: https://devpost.com/submit-to/18245-so-you-thi...
- 544 Views
- 1 replies
- 1 kudos
Latest Reply
@Hubert Dudek​ and @Werner Stinckens​ !
- 1358 Views
- 3 replies
- 4 kudos
Hello, Task: I am trying to understand, what approach is better to access the content in DataFrame.My piece of code:print("First approach: ", df["Purchase Address"][0])
print("Second approach: ", df.loc[0,"Purchase Address"])These lines are equal t...
- 1358 Views
- 3 replies
- 4 kudos
Latest Reply
@Aleksandra Frolova​ :Both approaches you mentioned are valid ways to access content in a DataFrame in pandas. Let's take a closer look at each approach:Using brackets []:df["Purchase Address"][0]Using loc or iloc:df.loc[0, "Purchase Address"]Both ap...
2 More Replies
- 1172 Views
- 3 replies
- 2 kudos
Hi, I have passed the exam for Databricks Certified Associate Developer for Apache Spark 3.0 with 85% on 10 jun 2023. I received a mail where badge and credentials mentioned but didn't received any certificate with it. I raised a ticket also - #0033...
- 1172 Views
- 3 replies
- 2 kudos
- 1179 Views
- 2 replies
- 3 kudos
Its been a day since I passed the exam , still no badge recieved from Databricks​.
- 1179 Views
- 2 replies
- 3 kudos
Latest Reply
Hi @Pradyumn Joshi​ We haven't heard from you since the last response from @Kaniz Fatma​ , and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to ot...
1 More Replies
- 737 Views
- 1 replies
- 1 kudos
How Databricks treats a jar when we upload multiple drivers for the same jdbc client (for example - oracle) how would databricks treat that jar and which would be considered in the class path?
- 737 Views
- 1 replies
- 1 kudos
Latest Reply
In the order, they were uploaded and the first JAR file with a matching name will be added to classpath. If you add multiple JAR files, Please ensure the desired version is uploaded first. so that it takes precedence.
by
pg1
• New Contributor II
- 919 Views
- 1 replies
- 2 kudos
I am not able to view Lakehouse Fundamental training videos, I just see menus, clicking does not open anything
- 919 Views
- 1 replies
- 2 kudos
Latest Reply
Hi, Can you confirm whether you are trying to access videos via Databricks academy? if so can you share the email address, alternatively, you could submit a ticket with us at
