Databricks Community

Hi Ramanuj Trivedi,Thank you for bringing this issue to our attention. We understand the urgency and importance of completing your certification, especially with its impact on your project.Next Steps:Exam Review: We will escalate your case to the cer...

You would need to install the python library. You can either:1) Run %pip install datasets2) Put it as part of the PyPi packages to load in your cluster This should solve your issue

Any updates on this? I'm experiencing the same issue.

Hi,Databricks doesn't allow direct permissions management for Slack notification destinations. To control access:Create Private Channels: Use private Slack channels for notifications and only add relevant team members.Manage Roles: Use Databricks rol...

@jayj_us wrote:I have noticed that in the databricks SQL editor, the intellisense doesnt work most of the time. Official SiteIs there a setting for this to work always. Its very anti productive to go look for table columns manually.Hello,I understand...

Hi @leo-machado this is a very reasonable request. It's not feasible right now, but I'll pass it on to the product team as I'm sure you're not the only one. 

Hi @AmandaOhare ,You can use AWS Lambda to achieve that. You can setup queue trigger that will activate AWS lambda function. In that function you can call datbricks rest API that will launch workflow/job.

Hello,To access DBFS files or download from GCS bucket within a Databricks cluster's init script, consider the following approaches:Install Databricks Connect on your local machine. Connect to your Databricks cluster using Databricks Connect. Use the...

Hi @Meghana_Vasavad ,During initial setup of unity catalog you need to find a person with global administrator role of Entra ID tenant. It's one time action, because then he can give necessary permission to manage catalog to your account, or even bet...

@Gubbanoa wrote:What is currently the best way of doing unit testing from pycharm into databricks? I have previously used databricks connect. However after upgrades, and now that even unit catalog has become a requirement, it appears quirky. Is it po...

I did a full refresh from the delta tables pipeline and that fixed it. I guess it was remembering the first run where I just had the top level arrays as two columns in the table. 

your databricks SSO is messed up. Storing CPU Ids and browser Ids as part of data collection and not following CPPA regulations. I have seen some posts in social media about these issues with databricks.