- 4045 Views
- 10 replies
- 0 kudos
Who's hiring? Latest Job Postings from the Databricks Community!
More than 10,000 organizations worldwide — including Block, Comcast, Condé Nast, Rivian, Shell and over 60% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to take control of their data and put it to work with AI. Use this thre...
- 4045 Views
- 10 replies
- 0 kudos
- 0 kudos
Job Title - Engineering Data Analyst LeadCompany name- Wartsila Location - Mumbai Required years of experience- 8 years Link to apply - https://careers.wartsila.com/job-invite/46999/Job description;ResponsibilitiesTransform raw data into meaningful i...
- 0 kudos
- 3299 Views
- 5 replies
- 0 kudos
Talend ETL code to Databricks
Hi Team,What is the best way to transfer Talend ETL code to Databricks and what are the best methods/practices for migrating Talend ETL's to Databricks (notebook, code conversion/migration strategy, workflow's etc)?Regards,Janga
- 3299 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @Phani1 ,Were you able to complete the migration from Talend to Databricks? If yes, please do let me know the process / tools that you have used for the migration and the challenges that you have encountered. ThanksVamsi.
- 0 kudos
- 557 Views
- 6 replies
- 5 kudos
Resolved! Databricks metastore
I have configured a new databricks workspace through my personal azure account. I cannot see the metastore. Since this is my personal account, I am the admin. Can you please guide me on how to enable the metastore. Thank you.
- 557 Views
- 6 replies
- 5 kudos
- 5 kudos
Hello @anipar Good day!!Can you please confirm again if you can see the metastore here?Log in to your Databricks workspace.Click your username in the top bar and select "Manage Account" to open the account console AZURE (https://accounts.azuredatabri...
- 5 kudos
- 241 Views
- 1 replies
- 1 kudos
Resolved! Dashboard embed: dashboard id is missing in token claim
We're trying to embed a dashboard following the example at https://learn.microsoft.com/en-us/azure/databricks/dashboards/embedding/external-embed#step-4-use-the-example-app-to-authenticate-and-generate-tokens The embed is displayed but with an error ...
- 241 Views
- 1 replies
- 1 kudos
- 1 kudos
Nevermind. I accidentally removed the external_viewer_id and external_value parameters. After adding them back it works as expected.
- 1 kudos
- 217 Views
- 0 replies
- 3 kudos
Understanding Databricks Clean Rooms: Design, Access, and Cost Model
Hi everyone,I wanted to share some insights and clarifications around Databricks Clean Rooms, especially regarding how they are designed and how costs are calculated — something that can be a bit confusing when onboarding collaborators.What Are Clean...
- 217 Views
- 0 replies
- 3 kudos
- 203 Views
- 1 replies
- 0 kudos
Resolved! Signed up for Customer Academy instead of Partner
Hello. Yesterday, I signed up for an account under my company email as a customer account. However, my intent was to sign up for a partner account and now it won't let me switch back. I sent a ticket to the academy team but have not received a reply ...
- 203 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @ericmedina! For issues with Academy access, the correct step is to raise a ticket with the Databricks support team. Since you’ve already submitted one, please allow some time for them to respond.
- 0 kudos
- 2829 Views
- 6 replies
- 1 kudos
Resolved! Spark connect client and server versions should be same for executing UDFs
I am trying to execute pandas UDF in databricks. It gives me the following error on serverless compute,File /local_disk0/.ephemeral_nfs/envs/pythonEnv-b11ff17c-9b25-4ccb-927d-06a7d1ca7221/lib/python3.11/site-packages/pyspark/sql/connect/client/core.p...
- 2829 Views
- 6 replies
- 1 kudos
- 1 kudos
@chinmay0924 - You can change the serverless client image by selecting the environment panel in a Databricks Notebook (on the right pane) or in the "Environment and Libraries" section while configuring a Databricks Job Task. The set of available serv...
- 1 kudos
- 309 Views
- 1 replies
- 0 kudos
Exam Suspended After Restarting the Exam — Ticket ID: 00744386
Hi Team,I am writing to raise a concern regarding my Databricks Certified Data Engineer Professional exam (Ticket ID: 00744386).During my exam session, the support representative initially requested me to show the entire room, including my bed, whi...
- 309 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @rajkishore028,Thank you for filing a ticket with our support team, Support team will respond shortly. Please note that we cannot provide support or handle exam suspensions via community. Thanks & Regards,@cert-ops
- 0 kudos
- 293 Views
- 1 replies
- 2 kudos
Resolved! How to update comments and constraints on Streaming Tables created by DLT outside the pipeline?
I have a Delta Live Tables (DLT) pipeline that creates a streaming table (e.g., dbrtdflite_catalog.demotest_silver.customer_profile).I want to update table-level and column-level comments as well as constraints on this table.When I try commands like:...
- 293 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Nexusss7 You can add a comment in the delta live tables, either the MV or the streaming table, in the tag - @Dlt.table() @Dlt.table( comment = "Delta live tables comment" )Here is the syntax for SQL: https://docs.databricks.com/aws/en/d...
- 2 kudos
- 475 Views
- 1 replies
- 1 kudos
Blackduck scanning on Databricks Workflow
Does anyone know if its compatible scan in blackduck your json based files from Workflows? At least, when its come to the notebook its compatible as blackduck detects python based files but i am wondering why can workflow be scanned as well.
- 475 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @fjrodriguez , Have you found your answer already? I hope I understand your question correctly. I think Databricks Asset Bundles (or Terraform) can be a useful tool to be added here, if you haven't looked at it already. Yes, you can and should s...
- 1 kudos
- 6981 Views
- 5 replies
- 1 kudos
Databricks Job Failure + Service now Integration
Hi Team,Could you please suggest how to raise the service now ticket, in case of Databricks job failure?Regards ,Phanindra
- 6981 Views
- 5 replies
- 1 kudos
- 1 kudos
JSON response from Databricks to ServiceNow, doesn't give enough details. Is there a way we can send customized json with additional details.
- 1 kudos
- 3451 Views
- 8 replies
- 0 kudos
Unable to install the Databricks in AWS
I have followed the instructions given in the following link https://docs.databricks.com/en/admin/workspace/quick-start.html#use-aws-quickstart-to-create-a-databricks-workspace%22There was an error in CFT while deploying the workspace. Please help[ER...
- 3451 Views
- 8 replies
- 0 kudos
- 0 kudos
Hi @rseshadri Please check the following two points:STS Endpoint Activation: Confirm whether the STS endpoint for the us-west-2 region is active. You can verify this from the IAM account settings.Resource Limits: Ensure that the limits for resources ...
- 0 kudos
- 863 Views
- 2 replies
- 0 kudos
Resolved! How Important is High-Quality Data Annotation in Training ML Models?
I've been exploring the foundations of building robust AI/ML systems, and I keep circling back to one crucial element — data annotation. No matter how advanced our models are, the quality of labeled data directly impacts the accuracy and performance ...
- 863 Views
- 2 replies
- 0 kudos
- 0 kudos
High-quality data annotation is crucial for training reliable ML models. It improves accuracy, reduces bias, saves costs, and is especially critical in sensitive fields like healthcare and autonomous driving. Clear guidelines, verification, and exper...
- 0 kudos
- 298 Views
- 4 replies
- 1 kudos
New datarbicks user group in San Antonio, Texas
I would like to formally request approval to initiate a Databricks User Community in San Antonio, Texas. The goal of this initiative is to create a collaborative space where professionals across various organizations can come together to share knowle...
- 298 Views
- 4 replies
- 1 kudos
- 6765 Views
- 5 replies
- 0 kudos
Adding NFS storage as external volume (Unity)
Can anyone share experience (or point me to another reference) that describes how to configure Azure Blob storage which has NFS enabled as an external volume to Databricks ?I've succeeded in adding SMB storage to Databricks but (if I understand prope...
- 6765 Views
- 5 replies
- 0 kudos
- 0 kudos
@phguk - how have you added SMB storage to Databricks ? usingazure.storage.fileshare -> ShareFileClient ? or is there any other way?
- 0 kudos
