Databricks Community

thiagoawstest

Hello, there is documentation for integrating Azure Devops CI/CD pipeline with AWS Databricks.Thanks.

thiagoawstest

Hi, I still have some questions, I have a Databricks on AWS and I need to mount S3 bucksts.According to the documentation, it is recommended to do it through the Unity Catalog, but how would I go about reading data from a notebook that would be mount...

thiagoawstest

Hello, I need to read secrets_value from AWS Secrets Manager, reading via python using boto3 I can retrieve the secret.I need to run it on a notebook, is it possible to read without informing the credentials, only through the IAM role? I tried to add...

thiagoawstest

Hi, I have datbricks on AWS, I created some secrets in AWS Secrets Manger, I would need to create the scopes based on AWS secrets manager.When I use Azure's Key Vault, when creating the scope, it uses the option -scope-backend-type AZURE_KEYVAULT, bu...

thiagoawstest

Hi, I have Databricks configured on AWS, I need to mount some S3 buckets on Databricks in /mnt, but I have some questions:- How can a bucket be mounted for all clusters and users to have access to, so as not to need to mount it every time the cluster...

thiagoawstest

I understood that the integration would be direct with Databricks, but I will check.Thank you for your help.

thiagoawstest

Yes, it implements notebooks, jobs, etc....But the integration of Azure Devops would be done via token, service principal, what is the best practice, is there any documentation?, because I don't want to define a personal token, if the user is removed...

thiagoawstest

Hi, today I already have a CI/CD pipeline between Azure Devops + Azure Databricks, now I need to integrate my Azure Devops with AWS Databricks, to run a CI/CD pipeline, this is what I want to achieve.

thiagoawstest

Returning, I already understood, I'm marking it as resolved.

thiagoawstest

That wouldn't be it, I created secrets within the AWS secret manager, when I use Azure Key Vault when creating the scope in Databricks, I pass a parameter that reads the key vault, but for AWS I didn't find it to read the AWS secrets manager .I wante...

Databricks Community

User Stats

User Activity

Azure Devops CI/CD - AWS Databricks

Unity Catalog mount S3

read AWS Secret Manager boto3

create databricks scope by reading AWS secrets manager

mount bucket s3

Re: Azure Devops CI/CD - AWS Databricks

Re: Azure Devops CI/CD - AWS Databricks

Re: Azure Devops CI/CD - AWS Databricks

Re: Unity Catalog mount S3

Re: create databricks scope by reading AWS secrets manager