Databricks Community

Mohit_m · 09-09-2022

In previous days all notebooks containing : 'import anomalydetection' worked just fine. There was no change in any configuration of the cluster, notebook or our imported library.However recently notebooks just crashed with below errorSame happen also...

Mohit_m · 07-12-2022

ClientAuthenticationError: DefaultAzureCredential failed to retrieve a token from the included credentials.Attempted credentials:EnvironmentCredential: EnvironmentCredential authentication unavailable. Environment variables are not fully configured.V...

Mohit_m · 07-05-2022

Databricks jobs create API throws unexpected errorError response :{"error_code": "INVALID_PARAMETER_VALUE","message": "Cluster validation error: Missing required field: settings.cluster_spec.new_cluster.size"}Any idea on this?

Mohit_m · 06-27-2022

User is running a job triggered from ADF in Databricks. In this job they need to use custom libraries that are in jars. Most of the times jobs are running fine, however sometimes it fails with:java.lang.NoClassDefFoundError: Could not initializeAny s...

Mohit_m · 06-27-2022

We have created our own artifactory and we use this to install python dependencies or libraries.We would like to know how we can make use of our own artifactory to install dependencies or libraries on Databricks clusters..

Mohit_m · 09-09-2022

Solution: This is due to the latest version of protobuf library, please try to downgrade the library which should solve the issuepip install protobuf==3.20.*protobuf library versions which works: 3.20.1 if it does not work then try 3.18.1

Mohit_m · 07-15-2022

There are two ways in Databricks to read from S3. You can either read data using an IAM Role or read data using Access Keys.you can find some examples here:https://docs.databricks.com/_static/notebooks/data-import/s3.htmlhttps://docs.databricks.com/a...

Mohit_m · 07-12-2022

Below docs are for reference:https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/identity/azure-identity/migration_guide.mdthere was a suggestion given to usefrom azure.common.credentials import ServicePrincipalCredentialsinstead offrom azure...

Mohit_m · 07-05-2022

To avoid delay in downloading the libraries from the internet repositories, you can cache the libraries in DBFS or S3.You can find example here in the following KB: https://kb.databricks.com/libraries/library-install-latency.html

Mohit_m · 07-05-2022

One more example herehttps://www.youtube.com/watch?v=H2FS4ijpFZA

Databricks Community

User Stats

User Activity

Databricks - python error when importing wheel distribution package

Job is failing with exception ClientAuthenticationError: DefaultAzureCredential failed to retrieve a token from the included credentials.

Databricks jobs create API throws unexpected error

Could not initialize class error

How to Install Python packages from the own artifactory

Re: Databricks - python error when importing wheel distribution package

Re: I would like to access S3 data in databricks

Re: Job is failing with exception ClientAuthenticationError: DefaultAzureCredential failed to retrieve a token from the included credentials.

Re: What's the beat way to define the libraries for cluster as it always take a lot of time for me.

Re: Databricks Workflows