cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

tyle_r
by New Contributor II
  • 1155 Views
  • 2 replies
  • 0 kudos

Lake house monitoring prodile_metrics and drift_metrics are empty

I am wondering why when i create a lakehouse monitor using either the API or UI, that my profile_metrics and data_drift tables are empty. This error came after i changed my date from type date to timestamp. Any information would be greatly appreciate...

  • 1155 Views
  • 2 replies
  • 0 kudos
Latest Reply
tyle_r
New Contributor II
  • 0 kudos

The issue comes where you don't include data with a timestamp that's within the last 30 days, as the analysis done on the table is only done within the last 30 days worth of data.

  • 0 kudos
1 More Replies
fridthoy
by New Contributor II
  • 328 Views
  • 0 replies
  • 0 kudos

deleteing old databricks workspace but keeping the data

Hi! I am currently working on a old databricks workspace where we have stored a lot of data, we have migrated over to a new workspace and i want to delete the old one. Before deleting the workspace i want to store the data in a blob storage in azure....

  • 328 Views
  • 0 replies
  • 0 kudos
marcuskw
by Contributor II
  • 5708 Views
  • 9 replies
  • 2 kudos

Create a Workflow Schedule with varying Parameters

We aim to reduce the amount of notebooks we create to a minimum and instead make these fairly flexible. Therefore we have a Factory setup that takes in a parameter to varies the logic.However when it comes to Workflows we are forced to create multipl...

  • 5708 Views
  • 9 replies
  • 2 kudos
Latest Reply
SamAdams
Contributor
  • 2 kudos

We're also running into this issue on my team where having multiple cron schedules would be handy. We have some pipelines that we want run on multiple schedules, say to refresh data "Run every Sunday at midnight" and "Run on the first day of the mont...

  • 2 kudos
8 More Replies
le_clemo
by New Contributor II
  • 959 Views
  • 0 replies
  • 1 kudos

Unable to login to community addition account

Hello, I created a community edition account yesterday. Earlier today, I was still able to sign in and everything worked as expected. Now, whenever I try to sign in, I get the following error: "We were not able to find a Community Edition workspace w...

  • 959 Views
  • 0 replies
  • 1 kudos
MLock
by New Contributor II
  • 633 Views
  • 0 replies
  • 1 kudos

Accessing data in Databricks/Unity Catalog from a SharePoint list

Our organization is moving all of it's corporate master data to Databricks.  Our business operations units need access to this data in various tools in the form of look-ups or drop-down lists in tools like Excel and SharePoint lists.  It's simple eno...

Get Started Discussions
SharePoint List
  • 633 Views
  • 0 replies
  • 1 kudos
joshbuttler
by New Contributor II
  • 564 Views
  • 1 replies
  • 1 kudos

Best Practices for Optimizing Delta Lake Performance

I’m currently working on a project using Delta Lake on Databricks and would like to optimize performance for both batch and streaming workloads.

  • 564 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @joshbuttler ,It's a big topic and it really depends on the use case. You can follow some guides/recommendations from databricks documentation:- Optimization recommendations on Databricks | Databricks on AWS- Use liquid clustering for Delta tables...

  • 1 kudos
Vadimalk
by New Contributor II
  • 1448 Views
  • 4 replies
  • 0 kudos

Has anyone being able to connect to Databricks using ODBC?

I'm trying to connect to the Databricks cluster from the Excel using ODBC and following this official guide:https://docs.databricks.com/en/integrations/excel.html#connect-from-microsoft-excelBut the authentication is always failing, returning "500 In...

  • 1448 Views
  • 4 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @Vadimalk ,Could you check if you have following options enabled in simba driver configuration: 

  • 0 kudos
3 More Replies
unseen007
by New Contributor
  • 391 Views
  • 0 replies
  • 0 kudos

Account Level API GET Call requiring User-Agent Header

We recently Enabled Unity Catalog so using Account Level API and little stuck on a GET call. For some reason, just the GET call requires a User-Agent header while POST, PUT, PATCH.. all work without it. For workspace API, there was no need for User-A...

  • 391 Views
  • 0 replies
  • 0 kudos
Rebecca
by New Contributor II
  • 952 Views
  • 1 replies
  • 1 kudos

Summit23

I have really enjoyed the summit so far! I am a biostatistics graduate student at Harvard and am learning so much here. 

  • 952 Views
  • 1 replies
  • 1 kudos
Latest Reply
Anushree_Tatode
Honored Contributor II
  • 1 kudos

Hi,If you had a great time at the Summit, be sure to visit our community events portal for upcoming events and join your regional user group for meetups.Thanks,Anushree

  • 1 kudos
natali
by New Contributor
  • 1090 Views
  • 1 replies
  • 0 kudos

Summit 2024

It has been an exciting event that brought together industry leaders, researchers, and practitioners to explore the latest advancements in artificial intelligence and data science. With cutting-edge presentations, hands-on workshops, and networking o...

  • 1090 Views
  • 1 replies
  • 0 kudos
Latest Reply
Anushree_Tatode
Honored Contributor II
  • 0 kudos

Hi,If you had a great time at the Summit, be sure to visit our community events portal for upcoming events and join your regional user group for meetups.Thanks,Anushree

  • 0 kudos
BeenA_33
by New Contributor
  • 2235 Views
  • 1 replies
  • 0 kudos
  • 2235 Views
  • 1 replies
  • 0 kudos
Latest Reply
wise_owl
New Contributor III
  • 0 kudos

You can leverage this code base. It works as expected using "next_page_token" parameter-Don't forget to mark this solution as correct if this helped you   import requests token = 'your token' url = 'your URL' params = {'expand_tasks': 'true'} heade...

  • 0 kudos
Nishat
by New Contributor
  • 737 Views
  • 1 replies
  • 0 kudos

Unity Catalog

Can MLflow Experiments be incorporated into Unity Catalog (may be in volume or somewhere in unity catalog) similar to models and feature tables?

  • 737 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

As of now Databricks supports DBFS, S3, and Azure Blob storage artifact locations. Our teams are working on intruducing Volumes as repository which might be coming soon 

  • 0 kudos
alliosns
by New Contributor
  • 770 Views
  • 1 replies
  • 1 kudos

Troubleshoot in Databricks

Hi everyone,I’m having trouble with a query in Databricks. My code seems correct, but I’m getting unexpected results. Can anyone help me troubleshoot this or provide tips for debugging in Databricks?Thanks in advance! locksmith

  • 770 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

It's hard to advice when you didn't provide any code. But you can try to use debugger inside notebook: 

  • 1 kudos
Arnold_Souza
by New Contributor III
  • 8682 Views
  • 7 replies
  • 1 kudos

How to move a metastore to a new Storage Account in unity catalog?

Hello, I would like to change the Metastore location in Databricks Account Console. I have one metastore created that is in an undesired container/storage account. I could see that it's not possible to edit a metastore that is already created. I coul...

1.JPG
  • 8682 Views
  • 7 replies
  • 1 kudos
Latest Reply
Bakkie
New Contributor II
  • 1 kudos

We ended up 1) deleting the metastore (which only contained catalogs/schemas/tables), 2) creating a new one in the desired storage account and 3) re-populating it by running all Delta Live Tables pipeline. All our underlying raw data is stored in ano...

  • 1 kudos
6 More Replies
HMSUM
by New Contributor III
  • 7805 Views
  • 13 replies
  • 3 kudos

Resolved! Unable to access Account console under Azure Databricks

I am the only user for the Azure enviornment and assigned global admin.For the resource group, I am the owner.For the Azure Databricks Service I am the service admin already.I would like to try to go into the Account console to make some changes for ...

HMSUM_0-1721817322692.png HMSUM_1-1721817364018.png HMSUM_2-1721817410580.png HMSUM_3-1721817433352.png
  • 7805 Views
  • 13 replies
  • 3 kudos
Latest Reply
dataeng42io
New Contributor III
  • 3 kudos

My issue was resolved with a recommendation of this article here  

  • 3 kudos
12 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels