Hi everyone,I wanted to share some insights and clarifications around Databricks Clean Rooms, especially regarding how they are designed and how costs are calculated — something that can be a bit confusing when onboarding collaborators.What Are Clean...
Hello. Yesterday, I signed up for an account under my company email as a customer account. However, my intent was to sign up for a partner account and now it won't let me switch back. I sent a ticket to the academy team but have not received a reply ...
Hello @ericmedina! For issues with Academy access, the correct step is to raise a ticket with the Databricks support team. Since you’ve already submitted one, please allow some time for them to respond.
I am trying to execute pandas UDF in databricks. It gives me the following error on serverless compute,File /local_disk0/.ephemeral_nfs/envs/pythonEnv-b11ff17c-9b25-4ccb-927d-06a7d1ca7221/lib/python3.11/site-packages/pyspark/sql/connect/client/core.p...
@chinmay0924 - You can change the serverless client image by selecting the environment panel in a Databricks Notebook (on the right pane) or in the "Environment and Libraries" section while configuring a Databricks Job Task. The set of available serv...
Hi Team,I am writing to raise a concern regarding my Databricks Certified Data Engineer Professional exam (Ticket ID: 00744386).During my exam session, the support representative initially requested me to show the entire room, including my bed, whi...
Hello @rajkishore028,Thank you for filing a ticket with our support team, Support team will respond shortly. Please note that we cannot provide support or handle exam suspensions via community. Thanks & Regards,@cert-ops
I have a Delta Live Tables (DLT) pipeline that creates a streaming table (e.g., dbrtdflite_catalog.demotest_silver.customer_profile).I want to update table-level and column-level comments as well as constraints on this table.When I try commands like:...
Hi @Nexusss7 You can add a comment in the delta live tables, either the MV or the streaming table, in the tag - @Dlt.table() @Dlt.table( comment = "Delta live tables comment" )Here is the syntax for SQL: https://docs.databricks.com/aws/en/d...
Does anyone know if its compatible scan in blackduck your json based files from Workflows? At least, when its come to the notebook its compatible as blackduck detects python based files but i am wondering why can workflow be scanned as well.
Hi @fjrodriguez , Have you found your answer already? I hope I understand your question correctly. I think Databricks Asset Bundles (or Terraform) can be a useful tool to be added here, if you haven't looked at it already. Yes, you can and should s...
Hi Team,Could you please suggest how to raise the service now ticket, in case of Databricks job failure?Regards ,Phanindra
JSON response from Databricks to ServiceNow, doesn't give enough details. Is there a way we can send customized json with additional details.
I have followed the instructions given in the following link https://docs.databricks.com/en/admin/workspace/quick-start.html#use-aws-quickstart-to-create-a-databricks-workspace%22There was an error in CFT while deploying the workspace. Please help[ER...
Hi @rseshadri Please check the following two points:STS Endpoint Activation: Confirm whether the STS endpoint for the us-west-2 region is active. You can verify this from the IAM account settings.Resource Limits: Ensure that the limits for resources ...
I've been exploring the foundations of building robust AI/ML systems, and I keep circling back to one crucial element — data annotation. No matter how advanced our models are, the quality of labeled data directly impacts the accuracy and performance ...
High-quality data annotation is crucial for training reliable ML models. It improves accuracy, reduces bias, saves costs, and is especially critical in sensitive fields like healthcare and autonomous driving. Clear guidelines, verification, and exper...
I would like to formally request approval to initiate a Databricks User Community in San Antonio, Texas. The goal of this initiative is to create a collaborative space where professionals across various organizations can come together to share knowle...
Can anyone share experience (or point me to another reference) that describes how to configure Azure Blob storage which has NFS enabled as an external volume to Databricks ?I've succeeded in adding SMB storage to Databricks but (if I understand prope...
@phguk - how have you added SMB storage to Databricks ? usingazure.storage.fileshare -> ShareFileClient ? or is there any other way?
Hello guys,I was taking test for data bricks data analyst associate and irrespective of any solid reason they have suspended my test. saying i am not giving eyecontact to camera. how can i read questions and options while eyecontacting with camera. I...
My exam has been suspended without proper reason even though the person said he is resuming the exam , I was giving exam through my office laptop , there was no issue , i am sharing support request number please help request support number : - 00738...
Hi everyone, Not sure how practical this idea is to implement but I'd love to have a space / area where there's voice channels. It could be something like an "Official Databricks Community" Discord? Alternatively, it could be something that the websi...
I love love love the idea of community based study groups. We definitely have regional based in person meetups right now, these are organized by customers in the online regional groups that you can monitor on the events page. I also appreciate that y...
Hey all, I’m setting up a Databricks workspace to run data pipelines + ML training. I’m unsure which node types to pick (driver vs worker, instance size, memory vs CPU optimized) for different workloads. For example small ETL jobs vs large batch proc...
Hi @Ednexllc ,It really depends on many factor like workload type, size of your data, number of tables etc. You can check some recommendations given by Databricks here:Compute configuration recommendations | Databricks on AWSAnd also here - you shoul...
i am facing the refresh issue . i am a trying to create a mv from a simple select query (select* from table where client="A") and the source table is a delta live table (streaming). The refresh is full recompute not incremental .
@hidden as per @szymon_dybczak 's screenshot, it needs to be serverlessAll the best,BS
