cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

enhancederroruk
by New Contributor III
  • 6958 Views
  • 15 replies
  • 12 kudos

Chrome/Edge high memory usage for Databricks tabs.

Is it normal for Databricks tabs to be using such high memory?The Chrome example I just got a screenshot of was this (rounded up/down)...3 x Databricks tabs for one user, sized at6gb, 4.5gb, and 2gbTotal = 12.5gbI know it gets higher than this too, I...

  • 6958 Views
  • 15 replies
  • 12 kudos
Latest Reply
datadrivenangel
New Contributor III
  • 12 kudos

And the git folders have gotten progressively slower and slower as well, and sometimes the 'open in new tab' button requires several clicks to work.  The whole web interface feels vibecoded now.

  • 12 kudos
14 More Replies
Danial_Gohar
by New Contributor
  • 252 Views
  • 2 replies
  • 0 kudos

Structuring multi-hop architectures for sensor data normalization in energy platforms - Databricks

Energy platforms increasingly rely on high-frequency sensor telemetry to monitor assets, optimize performance, and drive predictive analytics. However, telemetry from field devices, substations, and distributed energy resources often arrives in incon...

  • 252 Views
  • 2 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Thanks for sharing

  • 0 kudos
1 More Replies
Danial_Gohar
by New Contributor
  • 247 Views
  • 1 replies
  • 0 kudos

Streaming anomaly detection in oil pipelines using ML models on Databricks Structured Streaming

Oil pipelines operate under extreme pressures and conditions, where even minor anomalies such as abrupt pressure shifts or irregular flow rates can signal leaks, blockages, or equipment failure. Traditional monitoring systems rely on batch data and s...

  • 247 Views
  • 1 replies
  • 0 kudos
Latest Reply
WiliamRosa
New Contributor III
  • 0 kudos

Hi @Danial_Gohar,Thanks for sharing. One tip for you, next time if you have something you'd like to share with community we have dedicated place for that: Community Articles.

  • 0 kudos
Kris2
by New Contributor II
  • 3405 Views
  • 2 replies
  • 0 kudos

Resolved! Unable to create a Managed table in Unity Catalog defaul location

We have setup the metastore with Manged Identity and when trying to create a managed table in the default location I am hitting below error. The storage is ADLS Gen2. AbfsRestOperationException: Operation failed: "This request is not authorized to pe...

  • 3405 Views
  • 2 replies
  • 0 kudos
Latest Reply
bjosh1
New Contributor II
  • 0 kudos

Hi,I am facing the same issue.  I am getting 403 error while creating a TABLE.The folder is getting created inside the metastore in the ADLS everytime I run the Create Table command.The permissions are  `Storage Blob Data Contributor` role assigned a...

  • 0 kudos
1 More Replies
giuseppe_esq
by Contributor
  • 724 Views
  • 6 replies
  • 0 kudos

Error when executing spark.readStream Script

Hi all,When I try to execute the script (as per the screenshot below), in a Notebook cell, I get an error message.  I am using Databricks Free Edition, and am not sure if the error relates to the compute cluster that I am using?Any guidance would be ...

giuseppe_esq_0-1756154296423.png
  • 724 Views
  • 6 replies
  • 0 kudos
Latest Reply
Sidhant07
Databricks Employee
  • 0 kudos

Hi @giuseppe_esq , Can you please share the DBR version, cluster configurations and log4 file containing the error stact trace to further review?

  • 0 kudos
5 More Replies
giuseppe_esq
by Contributor
  • 867 Views
  • 7 replies
  • 5 kudos

Resolved! Error when trying to Create a STREAMING TABLE using Databricks SQL

Hi all,I am currently using the Databricks Free Edition, and trying to create a streaming table, using the following SQL script:%sqlCREATE OR REFRESH STREAMING TABLE sql_csv_autoloaderSCHEDULE EVERY 1 WEEKASSELECT *FROM STREAM read_files(  '/Volumes/...

  • 867 Views
  • 7 replies
  • 5 kudos
Latest Reply
WayneRevenite
New Contributor III
  • 5 kudos

Yes - I was able to do it no problem on Free, with the exact steps above, using the default supplied compute.

  • 5 kudos
6 More Replies
DanielW
by New Contributor III
  • 631 Views
  • 4 replies
  • 1 kudos

Resolved! Writing to data to a .csv file ( in the Databricks free edition)

 I have been testing out a notebook. Is is possible to write any tabular outputs to a .csv file and if so would this be the filesystem or an S3 bucket.I get errrors when I try either approaches with the snippet below.#sort by match date to get the mo...

  • 631 Views
  • 4 replies
  • 1 kudos
Latest Reply
DanielW
New Contributor III
  • 1 kudos

Hi @ilir_nuredini ,Thanks very much for the advice as this really helped esp DFS not available on the free edtions.I ran into an errror and   I realised I needed to create a volume and schema first. So with with a little help from the AI assistant, -...

  • 1 kudos
3 More Replies
CT123456
by New Contributor II
  • 1818 Views
  • 5 replies
  • 0 kudos

Access S3 Tables from Databricks

Hi, When I was looking for how to access S3 Tables from Databricks, I came across this AWS blog post: https://aws.amazon.com/blogs/big-data/access-amazon-s3-iceberg-tables-from-databricks-using-aws-glue-iceberg-rest-catalog-in-amazon-sagemaker-lakeho...

  • 1818 Views
  • 5 replies
  • 0 kudos
Latest Reply
BS_THE_ANALYST
Esteemed Contributor
  • 0 kudos

Hi @zhouhaijia, Are you trying to access S3? What are you looking to solve in particular? All the best,BS

  • 0 kudos
4 More Replies
AshwinGujarathi
by New Contributor
  • 626 Views
  • 2 replies
  • 0 kudos

Issue with the SQL Server ingestion in Databricks Lakflow- Gateway Stuck at "Starting"

Context: I am working on a POC to explore Databricks Lakeflow ingestion feature. I have tried creating Ingestion pipeline with salesforce connector successfully and able to load the data into Delta table. However when I am trying to create ingestion ...

Sql server.png
Get Started Discussions
Databricks Lakeflow
  • 626 Views
  • 2 replies
  • 0 kudos
Latest Reply
dbernstein_tp
New Contributor II
  • 0 kudos

We were able to resolve the above issue by increasing the quotas for two separate compute families. One was the Standard F4s family, which apparently the worker uses and the other was the Standard EDV4 family which I guess is the driver node. Now we'...

  • 0 kudos
1 More Replies
Naveen_Sequeira
by New Contributor
  • 189 Views
  • 1 replies
  • 2 kudos

Need help in creating compute cluster

Hi everyone,I hope you’re doing well.I’m currently facing an issue while trying to create a cluster in Azure Databricks (Personal). Despite trying various approaches, I keep encountering the following error message:The VM size you are specifying is n...

  • 189 Views
  • 1 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

Hi @Naveen_Sequeira ,If you increased quota and it didn't help then just try to use different region. In Azure, some machines are sometimes unavailable due to regional capacity issue. They should be available in another region though.You can try with...

  • 2 kudos
NamrataHindujaG
by New Contributor
  • 134 Views
  • 1 replies
  • 0 kudos

Namrata Hinduja Geneva - Issues with slow performance during merge operations

Hi everyone! I'm Namrata Hinduja Geneva, Switzerland and I'm working on a Delta Lake project in Databricks and facing issues with slow performance during merge operations on large datasets. I’ve optimized the table and used ZORDER, but the queries st...

  • 134 Views
  • 1 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor
  • 0 kudos

Hello Namrata aka realnameHumble request, please stop spamming with HindujaG this is not right platform for you sir/madam. I hope you understand. 

  • 0 kudos
Andreyai
by New Contributor II
  • 183 Views
  • 1 replies
  • 0 kudos

Passing a list of images on AI_Query

HiI would like to know how can I pass a list of images to ai_query on the same call, It will be helpful to extract some metadata information on a multipage document, where I want to know if different images to see if it belongs to the same document.T...

  • 183 Views
  • 1 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor
  • 0 kudos

Hello @Andreyai  Has your issue got resolved?

  • 0 kudos
cotrariello
by New Contributor III
  • 3053 Views
  • 11 replies
  • 2 kudos

Issue with Non-Bulk Inserts Using JDBC on Databricks Runtime 14.1

Hello team,I am experiencing an issue with insert operations on Databricks using the JDBC driver. In my SAS Viya system, the DatabricksJDBC42.jar driver version 2.6.40 is configured. I’ve noticed that, up to Databricks Runtime version 13.1, insert op...

cotrariello_3-1731582128580.png cotrariello_2-1731582087923.png
  • 3053 Views
  • 11 replies
  • 2 kudos
Latest Reply
akreit
New Contributor II
  • 2 kudos

The PR looks closed for now, any news on this? Also, I was wondering if there's a code snippet available on using this functionality

  • 2 kudos
10 More Replies
Devanshu
by New Contributor III
  • 295 Views
  • 3 replies
  • 3 kudos

Resolved! Help to get the swags for the event.

Hello Team,I am hosting my first event on 13th September. The date is final, but the venue is something that I am working on, due to I am not creating the event. I'll be able to create it within a day or two.  Can you please help me understand how I ...

  • 295 Views
  • 3 replies
  • 3 kudos
Latest Reply
Rishabh_Tiwari
Databricks Employee
  • 3 kudos

Thank you for tagging @BS_THE_ANALYST !Hi @Devanshu ,Thanks for reaching out. I’ve sent you a DM with the swag request details, please share your response so we can move forward and support you better. ThanksRishabh

  • 3 kudos
2 More Replies
MohsenJ
by Contributor
  • 4473 Views
  • 1 replies
  • 0 kudos

the inference table table doesn't get updated

I setup a model serving endpoint and created a monitoring dashboard to monitor its performance. The problem is my inference table doesn't get updated by model serving endpoints. To test the endpoint I use the following codeimport random import time ...

  • 4473 Views
  • 1 replies
  • 0 kudos
Latest Reply
Amruth_Ashok
Databricks Employee
  • 0 kudos

If the inference table is renamed, schema changed, deleted, or if the creator loses data access/the permissions are missing or have recently changed (for the endpoint creator), inference tables may silently stop updating.

  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels