- 12572 Views
- 6 replies
- 6 kudos
Local Development on Databricks
How to Develop Locally on Databricks with your Favorite IDEdbx is a Databricks Labs project that allows you to develop code locally and then submit against Databricks interactive and job compute clusters from your favorite local IDE (AWS | Azure | GC...
- 12572 Views
- 6 replies
- 6 kudos
- 6 kudos
I'm actually not a fan of dbx. I prefer the AWS Glue interactive sessions way of using the IDE. It's exactly like the web notebook experience. I can see the reason why dbx exists, but I'd still like to use a regular notebook experience in my IDE.
- 6 kudos
- 1902 Views
- 3 replies
- 4 kudos
Resolved! cannot list all tokens with account admin
I'm trying to list all tokens (both user and service principal) for a given workspace; using an Account level admin I've tried both the CLI as well as the API endpoint to list tokens, however each time, only the admin's tokens are returned.I've confi...
- 1902 Views
- 3 replies
- 4 kudos
- 8175 Views
- 2 replies
- 7 kudos
Resolved! Databricks Notebook Export error - Error: InvalidConfigurationError: You haven't configured the CLI yet! Please configure by entering `/databricks/python3/bin/databricks configure`
I have Databricks notebook which have some SQL code. I want to export it to Ipython notebook. Export should be automated and I am using below command%shdatabricks workspace export --overwrite --format JUPYTER "/Users/USERNAME/SQL_Automate" /Users/USE...
- 8175 Views
- 2 replies
- 7 kudos
- 7 kudos
Hi @Abhishek Jain , We haven’t heard from you since the last response from @Pat Sienkiewicz , and I was checking back to see if his suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpfu...
- 7 kudos
- 852 Views
- 0 replies
- 0 kudos
Is it possible to specify a specific branch commit when deploying repo to a workspace via the Databricks CLI?
I would like to know if it is possible to include a specific commit identifier when updating a repo in a workspace via the Databricks CLI.Why? Currently we use the repos CLI to push updates to code throughout dev, test and prod (testing along the wa...
- 852 Views
- 0 replies
- 0 kudos
- 4194 Views
- 4 replies
- 4 kudos
Resolved! Can I use Databricks CLI with community edition?
I installed the CLI but unable to configure it to connect to my instance -- as I am unable to find the "Generate Access tokens" option under User Settings page.Documentation does not say whether this feature is disabled for community edition.
- 4194 Views
- 4 replies
- 4 kudos
- 4 kudos
Hi @al_joe (Customer), We haven't heard from you on the last response from @Prabakar.Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.
- 4 kudos
- 13324 Views
- 6 replies
- 9 kudos
Error with databricks workspace
Hi,I have the following error :Error: b'{"error_code":"TEMPORARILY_UNAVAILABLE","message":"The service at /api/2.0/workspace/get-status is temporarily unavailable. Please try again later."}'when I do :databricks workspace export_dir path .ordatabrick...
- 13324 Views
- 6 replies
- 9 kudos
- 9 kudos
Please try to reconfigure cli. Please double check databricks hostdatabricks configure --tokenRegarding second command which you shared (%sh ls /Workspace) it will not work on free community edition. There you can use only native function like - dbu...
- 9 kudos
- 1864 Views
- 3 replies
- 5 kudos
Resolved! Databricks Feature Store in MLFlow run CLI command
Hello!I am attempting to move some machine learning code from a databricks notebook into a mlflow git repository. I am utilizing the databricks feature store to load features that have been processed. Currently I cannot get the databricks library to ...
- 1864 Views
- 3 replies
- 5 kudos
- 5 kudos
Hi @Alex Graff , Just a friendly follow-up. Do you still need help, or @Sean Owen 's response help you to find the solution? Please let us know.
- 5 kudos
- 3701 Views
- 5 replies
- 0 kudos
Resolved! How to access the virtual environment directory where the databricks notebooks are running?
How to get access to a separate virtual environment space and its storage location on databricks so that we can move our created libraries into it without waiting for their installation each time the cluster is brought up.What we want basically is a ...
- 3701 Views
- 5 replies
- 0 kudos
- 0 kudos
Hey there @Aman Gaurav Thank you for posting your question.Just wanted to check in if you were able to resolve your issue or do you need more help? We'd love to hear from you.Thanks!
- 0 kudos
- 10763 Views
- 13 replies
- 4 kudos
Resolved! Not able to move files from local to dbfs through dbfs CLI
Hi Folks,I have installed and configured databricks CLI in my local machine. I tried to move a local file from my personal computer using dbfs cp to dbfs:/ path. I can see the file is copied from local, and is only visible in local. I am not able to ...
- 10763 Views
- 13 replies
- 4 kudos
- 4 kudos
Hi, Could you try to save the file from your local machine to dbfs:/FileStore location?# Put local file test.py to dbfs:/FileStore/test.pydbfs cp test.py dbfs:/FileStore/test.py
- 4 kudos
- 653 Views
- 0 replies
- 0 kudos
Image Display in Dockerized Cluster
I am using a docker recipe for configuring my databricks cluster. It is working fine for everything else however when I tried to display any image data using any python utility such as matplotlib, PIL or Opencv etc. the image does not get displayed o...
- 653 Views
- 0 replies
- 0 kudos
- 1896 Views
- 4 replies
- 2 kudos
Resolved! scheduling tasks through CLI
Is there a way to schedule tasks or jobs through the Databricks CLI instead of the GUI? I want to be able to create a job flow with different notebook through the CLI.
- 1896 Views
- 4 replies
- 2 kudos
- 2 kudos
I agreed with @Kaniz Fatma https://docs.databricks.com/dev-tools/cli/jobs-cli.html?_ga=2.101966982.684786035.1646666830-480220406.1638459894 this is the job CLI we currently support @Shreya Gupta
- 2 kudos
- 2486 Views
- 2 replies
- 0 kudos
Resolved! Can't enable CLI 2.1 on CI
Hi! this is my CI configuration, I added the databricks jobs configure --version=2.1 command but it stills showing this error, any idea of what can I be doing wrong?Error:Resetting Databricks Job with job_id 1036...WARN: Your CLI is configured to use...
- 2486 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Alejandro Martinez , To set up and use the Databricks jobs CLI (and the job runs CLI) to call the Jobs REST API 2.1, Update the CLI to version 0.16.0 or above.Run pip install databricks-cli --upgrade using the appropriate version of pip for your...
- 0 kudos
- 11919 Views
- 4 replies
- 0 kudos
Resolved! Command prompt won't let me type the Databricks token
Hi, I am trying to set up Databricks CLI using the command prompt on my computer. I downloaded the Python 3.9 app and successfully ran the command pip install databricks-cliWhen I try to set up the Databricks token, I am able to type my Databricks Ho...
- 11919 Views
- 4 replies
- 0 kudos
- 5580 Views
- 8 replies
- 3 kudos
Resolved! How to export a Databricks repos in dbc format with databricks CLI
Hi,How can I export a Databricks repository in dbc format with databricks CLI ?It is possible to make databricks workspace export_dir path/to/dir .but notdatabricks repos export_dir path/to/dir .Thanks for you answers
- 5580 Views
- 8 replies
- 3 kudos
- 3 kudos
@Bertrand BURCKER Is your requirement to do it only from the CLI? Or to export the repos?If it is to export the repos, you can export it as DBC format from the UI.
- 3 kudos
- 7491 Views
- 7 replies
- 2 kudos
CLI Command <databricks fs cp> Not Uploading Files to DBFS
Hi all, So far I have been successfully using the CLI interface to upload files from my local machine to DBFS/FileStore/tables. Specifically, I have been using my terminal and the following command: databricks fs cp -r <MyLocalDataset> dbfs:/FileStor...
- 7491 Views
- 7 replies
- 2 kudos
- 2 kudos
hi @Ignacio Castineiras ,If Arjun.kr's fully answered your question, would you be happy to mark their answer as best so that others can quickly find the solution?Please let us know if you still are having this issue.
- 2 kudos