- 980 Views
- 3 replies
- 1 kudos
Resolved! Shipping Unity AI Gateway OTel to other collectors
We've enabled Open Telemetry logs in our Unity AI Gateway and have them shipped to Unity Catalog tables, but I am curious if we can configure the gateway to ship OTel to any other collector? I could swear at one time I saw documentation for that but...
- 980 Views
- 3 replies
- 1 kudos
- 1 kudos
Thanks for raising this. Based on the current public documentation, Unity AI Gateway’s documented OpenTelemetry path for coding-agent telemetry is to Databricks-managed Unity Catalog Delta tables, rather than to an arbitrary external OTel collector. ...
- 1 kudos
- 927 Views
- 1 replies
- 0 kudos
Guidance Needed on Publishing a Databricks App to the Databricks Marketplace
Hi everyone,We are a Databricks Partner now and Salesforce Partner with over 15 years of experience. We have developed a Databricks App using Free Edition and seek for publication of our App on the Databricks Marketplace. We would appreciate guidance...
- 927 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @pragya17s, I have just responded to your other post asking the same question. If you want to publish through Databricks Marketplace, you should plan around a paid Databricks environment rather than Free Edition. The Marketplace provider requireme...
- 0 kudos
- 417 Views
- 1 replies
- 0 kudos
Do databricks partners need to pay for databricks account?
Hi guys,Our company is new to databricks and we want to become marketplace provider, so for that we have become databricks partner.and now that we want to develop our app/accelarator that we will put on databricks marketplace, do we need to get a pai...
- 417 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Swapnil-sriv, Not a stupid question at all... It's a reasonable question when you're new to Databricks Marketplace. If your goal is to become a Databricks Marketplace provider and publish your own app or accelerator, a Free Edition account is gen...
- 0 kudos
- 362 Views
- 1 replies
- 0 kudos
Unable to Subscribe to the 14 day free trial
Hi Team,I recently spun up a Databricks (DBX) instance on GCP and added my billing information. While GCP is working as expected, I am encountering an issue when attempting to subscribe to the DBX 14-day free trial.The system blocks the subscription ...
- 362 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @sakkapeddi, Thanks for sharing the exact error message. What this usually means is that the Google Cloud billing account you selected is already associated with an existing Databricks Marketplace subscription flow, so Databricks can’t start a new...
- 0 kudos
- 413 Views
- 1 replies
- 0 kudos
Correlate Databricks App with Logs
I have a question about correlating Databricks system tables.We are currently using the outbound_network and audit system tables. When a Databricks App makes an outbound network request, the request appears in the outbound network table with details ...
- 413 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @discuss_darende, there's no join key today that ties an outbound_network row back to a specific app instance. network_source_type only tells you the request came from the "Apps" compute category, not which of your 100 apps made it. That's also wh...
- 0 kudos
- 5136 Views
- 4 replies
- 5 kudos
How are you deploying graphs?
Hi all, I have a couple of use cases that may benefit from using graphs. I'm interested in whether anyone has graph databases in Production and, if so, whether you're using GraphFrames, Neo4j or something else? What is the architecture you have the...
- 5136 Views
- 4 replies
- 5 kudos
- 5 kudos
Up to now the way to go is graphx or graphframes.There is also the possibility to use python libraries or others (single node that is), perhaps even Arrow-based.Another option is to load the data to a graph database and then move back to databricks a...
- 5 kudos
- 1386 Views
- 2 replies
- 0 kudos
Resolved! network security perimeter post-setup questions
I've set up the network security perimeter with Terraform using Configure an Azure network security perimeter for Azure resources - Azure Databricks | Microsoft Learn as my guide. All of the resources associated to the NSP, and the Status of each is...
- 1386 Views
- 2 replies
- 0 kudos
- 0 kudos
Hey Louis, I'm circling back after a few weeks of travel (including DAIS). I appreciate you researching this and the great answer. It took a few minutes after I created the NSP and logs to see entries, but they were flowing and systems were working...
- 0 kudos
- 467 Views
- 3 replies
- 0 kudos
Unable to create a Knowledge Assistant in an enterprise tier workspace
I am getting this error when I try to create a Knowledge Assistant agent in a workspace that is on an Enterprise tierErrors observed:1. INVALID_PARAMETER_VALUE:Vector index type DIRECT_ACCESS is not supported for this workspace.Request ID: bcabe324-f...
- 467 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @jnelson, Being on the Enterprise tier does not by itself guarantee this will work if the workspace still has an AI Search endpoint quota of 1 or does not support the Direct Access index type for this path. Those two errors usually point to AI Sea...
- 0 kudos
- 1566 Views
- 8 replies
- 4 kudos
Resolved! Dashboard sharing settings
When attempting to change sharing settings of published dashboards from Only people with access can view to anyone in my account can view or vice versa we get a "Failed to change permissions on dashboard..." error. This happens for all dashboards, bo...
- 1566 Views
- 8 replies
- 4 kudos
- 4965 Views
- 3 replies
- 1 kudos
Resolved! Databricks Connect: Enabling Arrow on Serverless Compute
I recently upgraded my Databricks Connect version to 15.4 and got set up for Serverless, but ran into the following error when I ran the standard code to enable Arrow on Pyspark: >>> spark.conf.set(key='spark.sql.execution.arrow.pyspark.enabled', val...
- 4965 Views
- 3 replies
- 1 kudos
- 1 kudos
When might this limitation be lifted? Is it due to security concerns that serverless doesn't support this?
- 1 kudos
- 637 Views
- 1 replies
- 0 kudos
Account does not exists error
I am writing to request assistance with a login issue I am experiencing with Databricks.I am attempting to create a Databricks account on AWS using my email address. Although I already have an active AWS account associated with this email, I am unabl...
- 637 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, For this kind of issue you should email onboarding-help@databricks.com with your account details and they should be able to help. You should have received an onboarding email, which you would have needed to accept before the workspace setup. If y...
- 0 kudos
- 1240 Views
- 4 replies
- 3 kudos
Resolved! Setting timezone at a workspace level
So all our on-prem datasources have timezones set to local (US East) and all timestamps stored in the table are in US East. As we're ETLing them to Databricks we're noticing that the same timestamp is now stored in UTC. So what was 6am in EST is now ...
- 1240 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @MDAtl, The short answer is no workspace-wide timezone setting for all Databricks compute. The long answer is that... this is expected TIMESTAMP behaviour. The timestamp values represent an absolute point in time, are normalised and persisted in U...
- 3 kudos
- 1436 Views
- 2 replies
- 0 kudos
Resolved! Serverless NCC Private Endpoint ESTABLISHED but traffic routes via eth0 instead of PrivateLink (AWS
Hi community,I've been trying to connect Databricks Serverless to a SQL Serverrunning on an EC2 instance using NCC Private Endpoint, but trafficis not being routed through PrivateLink.## Setup- Databricks Serverless (AWS, us-east-1)- NCC attached to ...
- 1436 Views
- 2 replies
- 0 kudos
- 0 kudos
Louis thanks,My issue was with the NLB. The Databricks documentation does not specify some of the required settings for this configuration. I found the solution in this post:https://medium.com/databricks-platform-sme/aws-databricks-serverless-private...
- 0 kudos
- 991 Views
- 2 replies
- 0 kudos
Resolved! You have hit your free daily limit
Hello!I'm getting "Error while starting SQL warehouse. Sorry, cannot run the resource because you have hit your free daily limit. Please come back again tomorrow."Do you know when exactly the reset happens?Thank you!
- 991 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @mark_lenders, Hi, I don’t believe there’s a publicly documented exact reset time for this limit. The Databricks Free Edition limitations page shared by @balajij8 explains that if you exceed your quota, compute resources can become unavailable for...
- 0 kudos
- 2077 Views
- 5 replies
- 2 kudos
Resolved! How to run black code-formating on the notebooks using custom configurations in UI
Hi all,I’m currently exploring how we can format notebook code using Black (installed via libraries) with specific configurations.I understand that we can configure Black locally using a pyproject.toml file. However, I’d like to know if there’s a way...
- 2077 Views
- 5 replies
- 2 kudos
- 2 kudos
I followed this description (black, pyproject.toml) and it worked for months.But now we found that the "format code" task does not consider pyproject.toml-defined line-length anymore.Is there any change in availability?
- 2 kudos
