- 659 Views
- 1 replies
- 1 kudos
Schedule & Triggers
Hi guys, having some issue when I use Schedule and trigger in workflow when file arrives condition, if a place a file with same name it won't trigger is there any configuration I need to do in databricks? thanks
- 659 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Leog Thank you for reaching out and for your sending your question. Per the documentation: https://docs.databricks.com/gcp/en/jobs/file-arrival-triggers Only new files trigger runs. Overwriting an existing file with a file of the same name does ...
- 1 kudos
- 1370 Views
- 4 replies
- 0 kudos
Unable to connect to the cluster
Container launch failure:An unexpected error was encountered while launching containers on worker instances for the cluster. Please retry and contact Databricks if the problem persists.Instance ID: i-02aadc9a7c3532af0Internal error message: Failed to...
- 1370 Views
- 4 replies
- 0 kudos
- 12012 Views
- 8 replies
- 3 kudos
[Azure Databricks] Create an External Location to Microsoft Fabric Lakehouse
Hi,I want to create an external location from Azure Databricks to a Microsoft Fabric Lakehouse, but seems I am missing something.What did I do:I created an "Access Connector for Azure Databricks" in Azure PortalI created a storage credential for the ...
- 12012 Views
- 8 replies
- 3 kudos
- 3 kudos
@stefanberreiter were you able to access Fabric onelake data from databricks unity catalog using Service prinicipal?
- 3 kudos
- 1875 Views
- 3 replies
- 4 kudos
Materialized view resources created after creation query failed
Hello, Im testing with Materialized Views and I ran the following query:create materialized view `xx`.`xx`.`stg_sales` PARTITIONED BY (id, external_id, tenant_id) TBLPROPERTIES ('cluster_by' = 'id') as with stg_accounts_events as ( select * from ...
- 1875 Views
- 3 replies
- 4 kudos
- 4 kudos
You are always welcome, Vitor. Do let me know for any queries. Good day.
- 4 kudos
- 1282 Views
- 1 replies
- 0 kudos
How to Configure a Policy in Job Cluster Using Databricks Linked Service in ADF?
I am trying to configure a policy in a job cluster using Databricks Linked Service in Azure Data Factory (ADF). The goal is to restrict access to a specific group or individuals who can use this cluster.I want to know:How to define and enforce a clus...
- 1282 Views
- 1 replies
- 0 kudos
- 0 kudos
In the Linked Services panel in the Azure Data Factory UI, find your Databricks Linked Service and click the squiggly braces {} to edit the service. From here, you'll see a definition in JSON. Create a new key: properties.typeProperties.policyId and ...
- 0 kudos
- 16885 Views
- 5 replies
- 5 kudos
Resolved! JDBC Driver support for OpenJDK 17
Connecting to Databricks using OpenJDK 17 I got the exception below. Are there any plans to fix the driver for OpenJDK17?java.sql.SQLException: [Databricks][DatabricksJDBCDriver](500540) Error caught in BackgroundFetcher. Foreground thread ID: 44. Ba...
- 16885 Views
- 5 replies
- 5 kudos
- 5 kudos
I still see the above error with databricks jdbc driver 2.6.33. Anyone aware of fix available either in driver or java?
- 5 kudos
- 847 Views
- 1 replies
- 0 kudos
Resolved! My databricks Exam still suspended request: 00635015
My exam has been suspended, and I received an email to schedule it. But I see that there is a delay of 10 to 15 days. Is it possible to schedule it for 19 March at 11 a.m.?because I have a deadline that I must not exceed to obtain this certificate.o...
- 847 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @saraM! Thank you for reaching out to us again and confirming.As you requested, the support team has rescheduled your exam for March 19, 2025, at 11:00 AM in Europe/Paris.Please log into your account and confirm. The rescheduled exam will be re...
- 0 kudos
- 1627 Views
- 1 replies
- 1 kudos
Lakehouse monitoring metrices tables not created automatically
Hello,I have an external table created in databricks unity catalog workspace and trying to "Create a monitor" for the same from quality tab.While creating the same the dashboard is getting created however the two metrices tables "profile" & "drift" a...
- 1627 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi Nikhil,How are you doing today?, As per my understanding, It looks like the monitoring setup isn't fully completing, likely due to permissions, external table limitations, or system settings. First, check if your Unity Catalog schema has the right...
- 1 kudos
- 756 Views
- 1 replies
- 0 kudos
Liquid Clustering with Derived / Generated Fields
I'm having issues with liquid clustering not working when creating derived/generated fields in an asset bundle. Are there any known limitations here?
- 756 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Lottiejanedev,How are you doing today?, As per my understanding, Yes, Liquid Clustering works best with directly stored columns, and it might not behave as expected when clustering on derived or generated fields. One possible issue is that generat...
- 0 kudos
- 2697 Views
- 2 replies
- 2 kudos
Capturing notebook return codes in databricks jobs
Hi, I currently am running a number of notebook jobs from Azure Data Factory. A new requirement has come up where I need to capture a return code in ADF that has been generated from the note. I tried using dbutils.notebook.exit(json.dumps({"return_v...
- 2697 Views
- 2 replies
- 2 kudos
- 2 kudos
I tried dbutils.notebook.exit(<value>) where value is 0 and 1. I also tried sys.exit(<value>). None of this produces a difference in the output of the databricks CLI commanddatabricks jobs run-now --json '{"job_id": <JOB_ID>, "job_parameters": {"will...
- 2 kudos
- 6936 Views
- 4 replies
- 1 kudos
Databricks CLI how to start a job and pass the parameters?
I try to start a job ID 85218616788189 and pass one parameters 'demo' in Windows Shell.This works:databricks jobs run-now 85218616788189 If I try this one,databricks jobs run-now --json '{"job_id":85218616788189,"notebook_params": {"demo":"parameter...
- 6936 Views
- 4 replies
- 1 kudos
- 1 kudos
If the job itself has parameters you have to use 'job_parameters' instead. No need for escaping as of version 0.243.0databricks jobs run-now --json '{"job_id": <JOB_ID>, "job_parameters": {"will_exit": "yes"}}'
- 1 kudos
- 591 Views
- 1 replies
- 0 kudos
My databricks exam got suspened on 18th march and it is still in the suspened state.
My databricks exam got suspened on 18th march and it is still in the suspened state. I have raised a support request using the below link.https://help.databricks.com/s/contact-us?ReqType=trainingand my request id : #00635015 I would really like to ge...
- 591 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @saraM! It looks like this post duplicates the one you recently posted. The Original post has already been answered. I recommend continuing the discussion there to keep the conversation focused and organised.
- 0 kudos
- 5662 Views
- 3 replies
- 2 kudos
Resolved! Databricks apps (streamlit) not able to install python libs
So, I have a databricks streamlit app that is not able to install any python lib defined on the requirements.txt.Issue is not specific to one lib, tried other ones but no python lib can be installed. Anyone with similar issue to help ? [2025-02-19 10...
- 5662 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi, returning to inform how the issue was solved. A bit of context, looks like the databricks apps runs on the databricks/microsoft backend, and not on our clusters. The control of the network ingress rules is done via SEG (https://www.databricks.com...
- 2 kudos
- 1695 Views
- 3 replies
- 0 kudos
ON-Prem SQL Server Direct Connection with Azure Databricks
Hi All,I have SSMS installed and have some data there which i want to export to Databricks and process it there. Databricks is hosted on Azure Cloud and I am wondering if it is possible. I have tested it using JDBC connection but i am getting error: ...
- 1695 Views
- 3 replies
- 0 kudos
- 0 kudos
If you want to play with SQL Server the easy way is to use Azure SQL that will be visuable for Databricks. Alternativly you can use ADF with slef-hosted run time to extract data to Azure from SQL Server.Network configuration requires many steps and i...
- 0 kudos
- 8376 Views
- 5 replies
- 1 kudos
Resolved! Usage of forum: How to find the threads where I commented on and my bookmarks
Hi quick questions, 1) the other day I commented on a thread and cannot find it. Is there a feature to find all my posts? I cannot find it under my profile.2) I find interesting threads and want to watch (in the sense: email me when updates occure) t...
- 8376 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi @Jan St.​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your ...
- 1 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 555 | |
| 349 | |
| 287 |
