- 865 Views
- 1 replies
- 2 kudos
Resolved! How to update comments and constraints on Streaming Tables created by DLT outside the pipeline?
I have a Delta Live Tables (DLT) pipeline that creates a streaming table (e.g., dbrtdflite_catalog.demotest_silver.customer_profile).I want to update table-level and column-level comments as well as constraints on this table.When I try commands like:...
- 865 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Nexusss7 You can add a comment in the delta live tables, either the MV or the streaming table, in the tag - @Dlt.table() @Dlt.table( comment = "Delta live tables comment" )Here is the syntax for SQL: https://docs.databricks.com/aws/en/d...
- 2 kudos
- 1125 Views
- 1 replies
- 1 kudos
Blackduck scanning on Databricks Workflow
Does anyone know if its compatible scan in blackduck your json based files from Workflows? At least, when its come to the notebook its compatible as blackduck detects python based files but i am wondering why can workflow be scanned as well.
- 1125 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @fjrodriguez , Have you found your answer already? I hope I understand your question correctly. I think Databricks Asset Bundles (or Terraform) can be a useful tool to be added here, if you haven't looked at it already. Yes, you can and should s...
- 1 kudos
- 8415 Views
- 5 replies
- 1 kudos
Databricks Job Failure + Service now Integration
Hi Team,Could you please suggest how to raise the service now ticket, in case of Databricks job failure?Regards ,Phanindra
- 8415 Views
- 5 replies
- 1 kudos
- 1 kudos
JSON response from Databricks to ServiceNow, doesn't give enough details. Is there a way we can send customized json with additional details.
- 1 kudos
- 4886 Views
- 8 replies
- 0 kudos
Unable to install the Databricks in AWS
I have followed the instructions given in the following link https://docs.databricks.com/en/admin/workspace/quick-start.html#use-aws-quickstart-to-create-a-databricks-workspace%22There was an error in CFT while deploying the workspace. Please help[ER...
- 4886 Views
- 8 replies
- 0 kudos
- 0 kudos
Hi @rseshadri Please check the following two points:STS Endpoint Activation: Confirm whether the STS endpoint for the us-west-2 region is active. You can verify this from the IAM account settings.Resource Limits: Ensure that the limits for resources ...
- 0 kudos
- 2401 Views
- 2 replies
- 0 kudos
Resolved! How Important is High-Quality Data Annotation in Training ML Models?
I've been exploring the foundations of building robust AI/ML systems, and I keep circling back to one crucial element — data annotation. No matter how advanced our models are, the quality of labeled data directly impacts the accuracy and performance ...
- 2401 Views
- 2 replies
- 0 kudos
- 0 kudos
High-quality data annotation is crucial for training reliable ML models. It improves accuracy, reduces bias, saves costs, and is especially critical in sensitive fields like healthcare and autonomous driving. Clear guidelines, verification, and exper...
- 0 kudos
- 679 Views
- 4 replies
- 1 kudos
New datarbicks user group in San Antonio, Texas
I would like to formally request approval to initiate a Databricks User Community in San Antonio, Texas. The goal of this initiative is to create a collaborative space where professionals across various organizations can come together to share knowle...
- 679 Views
- 4 replies
- 1 kudos
- 7900 Views
- 5 replies
- 0 kudos
Adding NFS storage as external volume (Unity)
Can anyone share experience (or point me to another reference) that describes how to configure Azure Blob storage which has NFS enabled as an external volume to Databricks ?I've succeeded in adding SMB storage to Databricks but (if I understand prope...
- 7900 Views
- 5 replies
- 0 kudos
- 0 kudos
@phguk - how have you added SMB storage to Databricks ? usingazure.storage.fileshare -> ShareFileClient ? or is there any other way?
- 0 kudos
- 4204 Views
- 6 replies
- 1 kudos
Resolved! Test has been suspended
Hello guys,I was taking test for data bricks data analyst associate and irrespective of any solid reason they have suspended my test. saying i am not giving eyecontact to camera. how can i read questions and options while eyecontacting with camera. I...
- 4204 Views
- 6 replies
- 1 kudos
- 1 kudos
My exam has been suspended without proper reason even though the person said he is resuming the exam , I was giving exam through my office laptop , there was no issue , i am sharing support request number please help request support number : - 00738...
- 1 kudos
- 3025 Views
- 10 replies
- 27 kudos
Resolved! Study Groups / Study Space
Hi everyone, Not sure how practical this idea is to implement but I'd love to have a space / area where there's voice channels. It could be something like an "Official Databricks Community" Discord? Alternatively, it could be something that the websi...
- 3025 Views
- 10 replies
- 27 kudos
- 27 kudos
I love love love the idea of community based study groups. We definitely have regional based in person meetups right now, these are organized by customers in the online regional groups that you can monitor on the events page. I also appreciate that y...
- 27 kudos
- 1647 Views
- 1 replies
- 0 kudos
How to choose the right node type for my Databricks workload?
Hey all, I’m setting up a Databricks workspace to run data pipelines + ML training. I’m unsure which node types to pick (driver vs worker, instance size, memory vs CPU optimized) for different workloads. For example small ETL jobs vs large batch proc...
- 1647 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Ednexllc ,It really depends on many factor like workload type, size of your data, number of tables etc. You can check some recommendations given by Databricks here:Compute configuration recommendations | Databricks on AWSAnd also here - you shoul...
- 0 kudos
- 741 Views
- 3 replies
- 2 kudos
Incremental refresh issue in materialized views
i am facing the refresh issue . i am a trying to create a mv from a simple select query (select* from table where client="A") and the source table is a delta live table (streaming). The refresh is full recompute not incremental .
- 741 Views
- 3 replies
- 2 kudos
- 2 kudos
@hidden as per @szymon_dybczak 's screenshot, it needs to be serverlessAll the best,BS
- 2 kudos
- 1468 Views
- 6 replies
- 4 kudos
Resolved! Pass parameter value to sql query in databricks sql alert
Hi,I have created a sql query with the parameter.Now using that parameterized sql query in databricks legacy sql alert.And scheduling that databricks sql alert in databricks workflow/job using Sql task type.Now how should I pass the parameter value t...
- 1468 Views
- 6 replies
- 4 kudos
- 11041 Views
- 15 replies
- 15 kudos
Chrome/Edge high memory usage for Databricks tabs.
Is it normal for Databricks tabs to be using such high memory?The Chrome example I just got a screenshot of was this (rounded up/down)...3 x Databricks tabs for one user, sized at6gb, 4.5gb, and 2gbTotal = 12.5gbI know it gets higher than this too, I...
- 11041 Views
- 15 replies
- 15 kudos
- 15 kudos
And the git folders have gotten progressively slower and slower as well, and sometimes the 'open in new tab' button requires several clicks to work. The whole web interface feels vibecoded now.
- 15 kudos
- 690 Views
- 2 replies
- 0 kudos
Structuring multi-hop architectures for sensor data normalization in energy platforms - Databricks
Energy platforms increasingly rely on high-frequency sensor telemetry to monitor assets, optimize performance, and drive predictive analytics. However, telemetry from field devices, substations, and distributed energy resources often arrives in incon...
- 690 Views
- 2 replies
- 0 kudos
- 696 Views
- 1 replies
- 0 kudos
Streaming anomaly detection in oil pipelines using ML models on Databricks Structured Streaming
Oil pipelines operate under extreme pressures and conditions, where even minor anomalies such as abrupt pressure shifts or irregular flow rates can signal leaks, blockages, or equipment failure. Traditional monitoring systems rely on batch data and s...
- 696 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Danial_Gohar,Thanks for sharing. One tip for you, next time if you have something you'd like to share with community we have dedicated place for that: Community Articles.
- 0 kudos
