Databricks

Giorgi · 08-30-2022

I've followed instructions and did gitlab integration:Generated Personal Access Token from GitLabAdd token (from step 1) to User settings (GitLab, email, token)In Admin console -> Repos Git URL Allow List permissions: Disabled (no restrictions)In Adm...

Giorgi · 08-30-2022

I'm using Azure Data Factory to create pipeline of Databricks notebooks, something like this:[Notebook 1 - data pre-processing ] -> [Notebook 2 - model training ] -> [Notebook 3 - performance evaluation].Can I write some config file, that would allow...

Giorgi · 06-12-2022

Hello, can I programmatically access artifact file (csv), via artifact_uri and read it?Tried the following, but didn't work, says no such file or directory:mlflow.pyfunc.pandas.read_csv(artifact_uri+'/xgb-classifier-test-8/dataset_statistics.csv')pan...

Giorgi · 08-31-2022

Thanks for your answer! Different cluster per notebook does what I need, for now.Solution with REST API 2.0 to resize cluster seems more flexible way to go. I guess it should be possible to create clusters on demand, from JSON configs, via curl comma...

Giorgi · 06-12-2022

Maybe there are better solutions, here is what I've found:from mlflow.tracking import MlflowClient client = MlflowClient() pd.read_csv(client.download_artifacts(run_id, "xgb-classifier-test-8/dataset_statistics.csv"))

Databricks

User Stats

User Activity

GitLab integration

Azure Data Factory: allocate resources per Notebook

How to read artifact file (CSV) programmatically?

Re: Azure Data Factory: allocate resources per Notebook

Re: How to read artifact file (CSV) programmatically?