- 1850 Views
- 2 replies
- 1 kudos
Resolved! Databricks SQL warehouse best practices
How best we can design Databricks SQL warehouse for multiple environments, and multiple data marts, is there any best practices or guidelines?
- 1850 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Phani1 We haven't heard from you since the last response from @Vinay_M_R , and I was checking back to see if her suggestions helped you. Or else, If you have any solution, please share it with the community, as it can be helpful to others. Also...
- 1 kudos
- 1622 Views
- 2 replies
- 3 kudos
Amazing Women in Data AI session at Data AI Summit 2023
Great first time experience attending the keynotes, sessions, trainings and certifications. It was a great opportunity to connect with like minded individuals and women in Data AI panel and learn about the community.
- 1622 Views
- 2 replies
- 3 kudos
- 615 Views
- 0 replies
- 0 kudos
AWS S3 Bucket Access from Unity Catalog?
Asking for a new logo customer…Let's say my unity catalog is in account A of AWS. The buckets that I need to access are in account B of AWS. The unity catalog is unable to create an external location based of this bucket even though all the necessary...
- 615 Views
- 0 replies
- 0 kudos
- 926 Views
- 0 replies
- 1 kudos
Card billing issues
Does anybody know if this is an ongoing issue (see screenshot below)? Trying to do business here, but not able to go through. We tried using two different cards using different networks.
- 926 Views
- 0 replies
- 1 kudos
- 1641 Views
- 1 replies
- 0 kudos
Workflow UI not showing all jobs that were run
I found a scenario where the workflow UI seems to not list all the jobs that ran.The objective is to keep trying to run a job, using the job rest api, when the service returns a status of "skipped" while another run is currently running, until the jo...
- 1641 Views
- 1 replies
- 0 kudos
- 0 kudos
I resolved this issue as a client side coding error and withdraw the question.
- 0 kudos
- 16540 Views
- 19 replies
- 49 kudos
The updated Databricks Community welcomes you!
To ensure we continue to evolve and mature to deliver greater value to you, we are happy to unveil this revamped Databricks Community experience and platform with an improved user interface, content and discussion categories organised based on areas ...
- 16540 Views
- 19 replies
- 49 kudos
- 49 kudos
Does anyone know how to change the email address in the new community?
- 49 kudos
- 2681 Views
- 1 replies
- 4 kudos
Resolved! Raffle contest Swag recevied
Hello Everyone,Today i Recevied DAIS swag.Thank you databricks for providing such nice swag @Retired_mod @Sujitha
- 2681 Views
- 1 replies
- 4 kudos
- 4 kudos
Jealous! Need to get me some merch too
- 4 kudos
- 641 Views
- 0 replies
- 0 kudos
Unity Catalog - Add File Error (was working fine before volumes were added)
Using unity catalog Add File following error is happening, is something to do with permissions that are recently changed, was working fine before (2 weeks ago), users have all required permissions (MODIFY, SELECT, EXECUTE,CREATE TABLE, USE CATALOG, U...
- 641 Views
- 0 replies
- 0 kudos
- 15060 Views
- 5 replies
- 5 kudos
What are the best practices for spark DataFrame caching?
Hi,When caching a DataFrame, I always use "df.cache().count()".However, in this reference, it is suggested to save the cached DataFrame into a new variable:When you cache a DataFrame create a new variable for it cachedDF = df.cache(). This will allow...
- 15060 Views
- 5 replies
- 5 kudos
- 5 kudos
In addition to other comments, I will just add that make sure you do the cache only when necessary. i.e. if you need to save a data frame for a time being to be referenced later in the code, then you should consider doing a cache. But if your code ha...
- 5 kudos
- 2126 Views
- 0 replies
- 2 kudos
Databricks Community rewards portal is down
When can we expect the Databricks Community rewards portal to be up and running. The page shows the warning message as website is under construction. Attached the screen shot of the message for your reference. Kindly resolve the issue and reload the ...
- 2126 Views
- 0 replies
- 2 kudos
- 4448 Views
- 4 replies
- 3 kudos
Resolved! What is the best approach to display DataFrame without re-executing the logic each time we display?
Hi,I have a DataFrame and different transformations are applied on the DataFrame. I want to display DataFrame after several transformations to check the results. However, according to the Reference, every time I try to display results, it runs the e...
- 4448 Views
- 4 replies
- 3 kudos
- 3 kudos
Thanks.In this reference, it is suggested to save the cached DataFrame into a new variable:When you cache a DataFrame create a new variable for it cachedDF = df.cache(). This will allow you to bypass the problems that we were solving in our example, ...
- 3 kudos
- 1842 Views
- 1 replies
- 1 kudos
Uable to Connect to S3
ExecutionException: java.nio.file.AccessDeniedException: s3a://bucketName: Forbidden;Hadoop 3.3.4, aws-sdk-java/1.12.189 Linux/5.15.0-1038-aws OpenJDK_64-Bit_Server_VM/25.362-b09 java/1.8.0_362 scala/2.12.14 kotlin/1.6.0 vendor/Azul_Systems,_Inc. cfg...
- 1842 Views
- 1 replies
- 1 kudos
- 1 kudos
https://kb.databricks.com/en_US/security/forbidden-access-to-s3-datahttps://kb.databricks.com/en_US/delta/s3-permissions-delta You can check this two. see if this helps.
- 1 kudos
- 700 Views
- 0 replies
- 0 kudos
Failed to submit the feedback survey on time for certification voucher.
I attend the data bricks training on Apr 2023. I failed to submit the feedback survey on time for certification voucher. Will it be possible to get the offer voucher now?
- 700 Views
- 0 replies
- 0 kudos
- 1186 Views
- 0 replies
- 0 kudos
Not able to catch structured streaming exception
I would like to catch and handle an exception in a structured streaming job.The databricks notebook still displays the exception, regardless of added exception handling (see attached screenshot)I guess that the exception is displayed by the cell outp...
- 1186 Views
- 0 replies
- 0 kudos
- 926 Views
- 1 replies
- 0 kudos
Using Dolly for healthcare providers
Databricks Data+AI Summit has been very interesting. New(ish) user here with a background on healthcare. I see huge efficiency gains for healthcare providers in using specialized LLMs to get a synopsis of patient history. Would a provider need to tra...
- 926 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey everyone! As a healthcare enthusiast, I completely agree with Dave-Griffith's point about the potential efficiency gains in using specialized LLMs for patient history. It's amazing how advanced technology like Dolly can revolutionize healthcare.T...
- 0 kudos
