Databricks Community

PabloCSD

I have a process in DBX/DAB and I am using Service Principal for generating a token for reaching the artifacts feed, for security this token lasts 1 hour.import requests YOUR_AZURE_TENANT_ID = ... YOUR_SERVICE_PRINCIPAL_CLIENT_ID = ... YOUR_SECRET_S...

PabloCSD · 10-14-2024

Hello, I currently have a Service Principal (SP) Client_Id and its associated secret, I generated it directly from my workspace in Databricks, i was following this post: https://github.com/databricks/cli/issues/1722, but I don't know how to generate ...

PabloCSD · 10-14-2024

I have a CI/CD process that after a Pull Request (PR) to main it deploys to staging.It works using a Personal Access Token using Azure Pipelines.From local, deploying using Service Principal works (https://community.databricks.com/t5/administration-a...

PabloCSD · 09-30-2024

Context:Hello, I was using a workflow for a periodic process, with my team we were using a Job Compute, but the libraries were not working (even though we had a PIP_EXTRA_INDEX_URL defined in the Environment Variables of the Cluster, so we now use a ...

PabloCSD · 09-24-2024

How can I connect using a Service Principal Token, I did this, but it is not a PAT: databricks configure Databricks host: https:// ... Personal access token: **** I also tried this, but didn't work either: [profile] host = <workspace-url> client_id ...

PabloCSD

Hello @agallardrivilla,I tried with the first solution but the workflow tries to install the dependencies used in the second workflow but it didn't work (in the posted .yaml I already have a depends_on).The workflow runs when the user requieres it, t...

PabloCSD · 10-16-2024

When I have worked with Databricks Asset Bundles (DAB), I left the databricks.yaml file in the root, and just one databricks.yaml file.I also made a simple functional DAB project, the file system structure is like this, if it helps you:dab_test_repo/...

PabloCSD · 10-15-2024

I needed to deploy a job using CI/CD Azure Pipelines without using the OAuth, this is the way:First you need to have configured the Service Principal, for that you need to generate it in your workspace with this you will have:A host: Which is your wo...

PabloCSD · 10-03-2024

Hello @ipreston,In my team right now we are using Databrick Asset Bundle (DAB) and for solving a similar issue which is: retrieving private libraries hosted in Azure DevOps Artifact Feed, we added:To the databricks.yml: targets: dev: mode: deve...

PabloCSD · 09-30-2024

I installed in the cluster this library:spark_mssql_connector_2_12_1_4_0_BETA.jarA colleague passed me this .jar file. It seems that can be obtained from here: https://github.com/microsoft/sql-spark-connector/releases.This allows the task to end succ...

Databricks Community

User Stats

User Activity

Generate a Workflow that Waits for Library Installation

How to generate an Azure Subscription from a Databricks Generated Service Principal?

How to deploy to Databricks Assets Bundle from Azure DevOps using Service Principal?

[DATA_SOURCE_NOT_FOUND] Failed to find data source

Use a Service Principal Token instead of Personal Access Token for Databricks Asset Bundle

Re: Generate a Workflow that Waits for Library Installation

Re: Asset Bundles - path is not contained in bundle root path

Re: How to deploy to Databricks Assets Bundle from Azure DevOps using Service Principal?

Re: Configuring pip index-url and using artifacts-keyring

Re: [DATA_SOURCE_NOT_FOUND] Failed to find data source