- 6513 Views
- 7 replies
- 1 kudos
Resolved! Can't run a job that use GitHub as source
I have a list of jobs that are using the code in GitHub as source.Everything worked fine until yesterday. Yesterday, I noticed that all the job that were using GitHub as source were failing. Because of the following error: ``` Run result unavailable:...
- 6513 Views
- 7 replies
- 1 kudos
- 1 kudos
Just an update, to round this out. We investigated further internally, and found that although we have a cleanup process in place to remove the internal repos that are being checked out for workflows, it was failing to catch up due to the sheer volum...
- 1 kudos
- 3374 Views
- 2 replies
- 0 kudos
Jobs REST Api - Create new Job with a new Cluster, and install a Maven Library on the Cluster
I would need to use the Job REST API to create a Job on our databrick Cluster.At the Job Creation, is possible to specify an existing cluster, or, create a new one.I can forward alot of information to the Cluster, but what I would like to specify is ...
- 3374 Views
- 2 replies
- 0 kudos
- 0 kudos
@Antonio Davide Cali​ You can use the existing cluster in your json to use it for the job.To update or push libraries to the job, you can use the JobsUpdate API. As you want to push libraries to the cluster, you can push them using the new setting an...
- 0 kudos
- 1644 Views
- 0 replies
- 2 kudos
Cannot load spark-avro jars with databricksversion 10.4
Currently, I am facing an issue since the `databricks-connect` runtime on our cluster was updated to 10.4. Since then, I cannot load the jars for spark-avro anymore. By Running the following code from pyspark.sql import SparkSession spark = SparkSe...
- 1644 Views
- 0 replies
- 2 kudos
- 874 Views
- 0 replies
- 5 kudos
www.databricks.com
New and Exciting! Databricks and Jupyter: Announcing ipywidgets in the Databricks NotebookBringing the interactivity of the Jupyter ecosystem into the LakehouseWe are excited to announce a deeper integration between the Databricks Notebook and the e...
- 874 Views
- 0 replies
- 5 kudos
- 4126 Views
- 6 replies
- 4 kudos
Hello, I runn a notebook with datafactory and I have this error:Failure starting repl. Try detaching and re-attaching the notebook. But my notebook is...
Hello, I runn a notebook with datafactory and I have this error:Failure starting repl. Try detaching and re-attaching the notebook.But my notebook is attachingCan I attach notebook with a comand o r code ?
- 4126 Views
- 6 replies
- 4 kudos
- 4 kudos
Hey @oscar alvarez​ Thank you so much for getting back to us. It's really great of you to send in the solution. Would you be happy to mark it as best so that other members can find the solution more quickly?We really appreciate your time.Wish you a g...
- 4 kudos
- 1178 Views
- 0 replies
- 1 kudos
Integrating Databricks repos with Azure DevOps
Hi, Databricks community. I am trying to integrate Databricks shared folder notebooks with Azure DevOps GIT repositories. Can someone please point me to a basic training tutorial (or video) on how to get started and best practices?
- 1178 Views
- 0 replies
- 1 kudos
- 3603 Views
- 2 replies
- 0 kudos
Resolved! Cluster configuration / notebook panel
Hi,Is it possible to let regular users to see all running notebooks (in the notebook panel of the cluster) on a specific cluster they can use (attach and restart).by default admins can see all running notebooks and users can see only their own notebo...
- 3603 Views
- 2 replies
- 0 kudos
- 0 kudos
hi @Philippe CRAVE​ a user can see a notebook only if they have permission to that notebook. Else they won't be able to see it. Unfortunately there is no possibility for a normal user to see the notebooks attached to a cluster if they do not have per...
- 0 kudos
- 2611 Views
- 0 replies
- 2 kudos
Data unloading to S3 bucket from Databricks.
Hi,I am completely new to the Databricks & have a task to unload the data from Databricks table to the S3 location using java/sql. Is this possible? If yes can you please help me?
- 2611 Views
- 0 replies
- 2 kudos
- 6176 Views
- 1 replies
- 2 kudos
How to restart a cluster on databricks using databricks-CLI?
I'm trying to restart an existing cluster in Databricks on Azure using databricks-cli.I'm using the following command:databricks clusters restart {"cluster_id": "0710-121255-liner30"}But it gives giving me this error:Error: Missing option "--cluster-...
- 6176 Views
- 1 replies
- 2 kudos
- 2 kudos
Can you try:databricks clusters restart --cluster-id <the-cluster-id>$ databricks clusters restart --help Usage: databricks clusters restart [OPTIONS] Restarts a Databricks cluster given its ID. If the cluster is not currently in a RUNNING st...
- 2 kudos
- 1484 Views
- 0 replies
- 0 kudos
Is it possible to specify a specific branch commit when deploying repo to a workspace via the Databricks CLI?
I would like to know if it is possible to include a specific commit identifier when updating a repo in a workspace via the Databricks CLI.Why? Currently we use the repos CLI to push updates to code throughout dev, test and prod (testing along the wa...
- 1484 Views
- 0 replies
- 0 kudos
- 20009 Views
- 2 replies
- 6 kudos
Resolved! Create a Dashboard: How do I visualize data with Databricks SQL or my BI tool?
Databricks SQL helps query and visualize data so you can share real-time business insights with built-in dashboards or your favorite BI tools.This post helps you create queries, visualizations and dashboards and connect to your BI tools for deeper da...
- 20009 Views
- 2 replies
- 6 kudos
- 6 kudos
Thanks for the information, I will try to figure it out for more. Keep sharing such informative post keep suggesting such post.
- 6 kudos
- 1441 Views
- 0 replies
- 3 kudos
Register for Databricks Office HoursAugust 17 & August 31 from 8:00am - 9:00am PT | 3:00pm - 4:00pm GMT. Databricks Office Hours connects you dire...
Register for Databricks Office HoursAugust 17 & August 31 from 8:00am - 9:00am PT | 3:00pm - 4:00pm GMT.Databricks Office Hours connects you directly with experts to answer your Databricks questions.Join us to: • Troubleshoot your technical questions...
- 1441 Views
- 0 replies
- 3 kudos
- 2062 Views
- 2 replies
- 1 kudos
Databricks and AWS Cloud watch agent issue
I'm facing problem while connecting Data bricks with AWS cloud watch, I want to send certain logs to cloud watch but seems like there is some connectivity issue between the 2 parties
- 2062 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Tushar Dua​ , please follow the below blog which has details on how to monitor Databricks using Cloudwatch.How to Monitor Databricks with AWS CloudWatch
- 1 kudos
- 5643 Views
- 3 replies
- 3 kudos
- 5643 Views
- 3 replies
- 3 kudos
- 3 kudos
@RonVBrown (Customer)​ : Could you please refer below linkhttps://docs.databricks.com/data/data-sources/elasticsearch.htmlPlease try to use opens search library instead of the ES jar if it does not work.https://search.maven.org/artifact/org.opensearc...
- 3 kudos
- 1012 Views
- 0 replies
- 0 kudos
Use databricks-sync import to migrate to new workspace
Hello,We are using the databricks-sync tool in an attempt to migrate from a legacy workspace into a new E2 account workspace. The tool exports json files successfully, but when I try to import, I receive various Terraform errors referencing undeclar...
- 1012 Views
- 0 replies
- 0 kudos
| User | Count |
|---|---|
| 1616 | |
| 790 | |
| 466 | |
| 349 | |
| 287 |
