Using unity catalog Add File following error is happening, is something to do with permissions that are recently changed, was working fine before (2 weeks ago), users have all required permissions (MODIFY, SELECT, EXECUTE,CREATE TABLE, USE CATALOG, U...
Hi,When caching a DataFrame, I always use "df.cache().count()".However, in this reference, it is suggested to save the cached DataFrame into a new variable:When you cache a DataFrame create a new variable for it cachedDF = df.cache(). This will allow...
In addition to other comments, I will just add that make sure you do the cache only when necessary. i.e. if you need to save a data frame for a time being to be referenced later in the code, then you should consider doing a cache. But if your code ha...
When can we expect the Databricks Community rewards portal to be up and running. The page shows the warning message as website is under construction. Attached the screen shot of the message for your reference. Kindly resolve the issue and reload the ...
Hi,I have a DataFrame and different transformations are applied on the DataFrame. I want to display DataFrame after several transformations to check the results. However, according to the Reference, every time I try to display results, it runs the e...
Thanks.In this reference, it is suggested to save the cached DataFrame into a new variable:When you cache a DataFrame create a new variable for it cachedDF = df.cache(). This will allow you to bypass the problems that we were solving in our example, ...
ExecutionException: java.nio.file.AccessDeniedException: s3a://bucketName: Forbidden;Hadoop 3.3.4, aws-sdk-java/1.12.189 Linux/5.15.0-1038-aws OpenJDK_64-Bit_Server_VM/25.362-b09 java/1.8.0_362 scala/2.12.14 kotlin/1.6.0 vendor/Azul_Systems,_Inc. cfg...
https://kb.databricks.com/en_US/security/forbidden-access-to-s3-datahttps://kb.databricks.com/en_US/delta/s3-permissions-delta You can check this two. see if this helps.
I attend the data bricks training on Apr 2023. I failed to submit the feedback survey on time for certification voucher. Will it be possible to get the offer voucher now?
I would like to catch and handle an exception in a structured streaming job.The databricks notebook still displays the exception, regardless of added exception handling (see attached screenshot)I guess that the exception is displayed by the cell outp...
Databricks Data+AI Summit has been very interesting. New(ish) user here with a background on healthcare. I see huge efficiency gains for healthcare providers in using specialized LLMs to get a synopsis of patient history. Would a provider need to tra...
Hey everyone! As a healthcare enthusiast, I completely agree with Dave-Griffith's point about the potential efficiency gains in using specialized LLMs for patient history. It's amazing how advanced technology like Dolly can revolutionize healthcare.T...
@Anonymous , @Retired_mod , Could you please help me?Several days ago I was able to log into Databricks Partner portal but now I can't and even resetting password is not helping.Thanks in advance.
Hi @asgalantsevepam Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...
I had an issue when I was answering an exam for a certification. The exam was interrupted due to an issue on secure browser software, the screen became black and I could not finish the exame because I could not see the rest of the questions in the qu...
Hi @ari_reyes Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
Hi I have signed up and looking to sign in the Course Generative AI in community, but when I log in using my correct password and username, it does not accept the information, so can't complete the course, can you please offer help for this.I have re...
Hi @Hydra We haven't heard from you since the last response from @yogu , and I was checking back to see if her suggestions helped you. Or else, If you have any solution, please share it with the community, as it can be helpful to others. Also, Plea...
Hi I completed Databricks Lakehouse Fundamentals exam but didn't got my badge
@saqib_rasool plz submit tikcit to support team https://help.databricks.com/s/contact-us?ReqType=training
I am trying to setup a recon activity between GCP Pub-Sub and databricks, Is there any way to fetch the last 24hrs record count from Pub-Sub?I tried but not got any direct solution for it, It will be great if any one can suggest me the way t#pubsub, ...
Hi @Ajay-Pandey Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Cheers!
I created a workspace and a metastore(following the long tedious instructions). I assigned the workspace to the metastore. workspace -> Data, I can see the metastore link on the top left of the page. Through it I configured the permissions (giving me...
Answering my own question - all that is needed is to refresh the Data web page!
Hi all,I hope you could help me to figure out what I am missing.I'm trying to do a simple thing. To read the data from the data ingestion zone (csv files saved to Azure Storage Account) using the Delta Live Tables pipeline and share the resulting tab...
Sorry, I think I've created the post in the wrong thread. Created the same post in the Community Cove.
