- 8674 Views
- 6 replies
- 6 kudos
Resolved! Executing Notebooks - Run All Cells vs Run All Below
Due to dependencies, if one of our cells errors then we want the notebook to stop executing.We've noticed some odd behaviour when executing notebooks depending on if "Run all cells in this notebook" is selected from the header versus "Run All Below"....
- 8674 Views
- 6 replies
- 6 kudos
- 6 kudos
Has this been implemented? I have created a job using notebook. My notebook has 6 cells and if the code in first cell fails it should not run the rest of the cells
- 6 kudos
- 4501 Views
- 2 replies
- 4 kudos
Resolved! how can I export dashboard to HTML?
Now I can successfully export notebook view to HTML using job api (run export).However how can I export dashboard view which is generated by the tab of 'show in dashboard view' to HTML? the tab is on the right top of the corner in the cell.I want an ...
- 4501 Views
- 2 replies
- 4 kudos
- 4 kudos
Hi @Kaniz_Fatma ! I am wondering how to export a dashboard tab from a notebook and I found this old topic.I am not able to find the "views_to_export" parameter that @Hubert-Dudek refers to in docs. May the docs have been updated and now the parameter...
- 4 kudos
- 3059 Views
- 3 replies
- 6 kudos
How can I customize the Notebook Job # while using dbutils.notebook.run method?
When running multiple notebooks parallelly using dbutils.notebook.run from a parent notebook, an url to that running notebook is printed, like belowNotebook job #211371132480519Is there a way I can print the notebook name or some customized string in...
- 3059 Views
- 3 replies
- 6 kudos
- 6 kudos
Hi @Debayan Thank you for your reply.However, the answer I am looking for is : how to print/get a more meaningful name of the jobs when running multiple notebooks parallelly using dbutils.notebook.run from a parent notebook.Now in the parent notebook...
- 6 kudos
- 2148 Views
- 1 replies
- 0 kudos
Getting JsonParseException: Unexpected character ('<' (code 60))
I have a scheduled job that is executed using a notebook. Within one of the notebook cells, there is a check to determine if a table exists. However, even when the table does exist, it incorrectly identifies it as non-existent and proceeds to execut...
- 2148 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Mahesh Chahare​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos
- 13640 Views
- 1 replies
- 2 kudos
Best way to make a scrollable DataFrame in a ipywidgets.Output?
I have a pretty complex Jupyter widgets UI in a databricks notebook that has a dataframe that1. will be modified by some Jupyter widget callbacks2. needs to be displayed to the user and updated as it is modified3. is large and needs to support vertic...
- 13640 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Yushi Homma​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...
- 2 kudos
- 6058 Views
- 3 replies
- 0 kudos
How to extract the start and end time of the command line cell of the notebook using REST API in Azure Databricks?
HiI have a notebook with many command line cells in it.I want to extract the execution time of each cell using Databricks REST API? How can I do that?Please note - I managed to get the Start & End time of the Job using REST API (/2.1/jobs/runs/get) f...
- 6058 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Milind Keer​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...
- 0 kudos
- 2382 Views
- 3 replies
- 0 kudos
Notebook connectivity issue with aws s3 bucket using mounting
When connecting to aws s3 bucket using dbfs, application throws error like org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 7864387.0 failed 4 times, most recent failure: Lost task 0.3 in stage 7864387.0 (TID 1709732...
- 2382 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Amrendra Kumar​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us s...
- 0 kudos
- 12279 Views
- 8 replies
- 6 kudos
Databricks notebook ipywidgets not working as expected ( button click issue)
I am working on Azure databricks(IDE). I wanted to create a button which takes a text value as input and on the click of a button a function needed to be run which prints the value entered.For that I created this code:from IPython.display import disp...
- 12279 Views
- 8 replies
- 6 kudos
- 6 kudos
Hi @Shubham Ringne​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us s...
- 6 kudos
- 2172 Views
- 3 replies
- 0 kudos
Display Html from dbfs files
Hi,I want to display some content from dbfs inside my notebook. Let's say I have a image under: /dbfs/mnt/test-bucket/test-custom/sample.pngI want to embed that into my Notebook Html Output like this:displayHTML("""<img src ='/dbfs/mnt/test-bucket/te...
- 2172 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Vidula Khanna​ ,unfortunately not. I can access the file through the notebook via e.g. !ls /dbfs/mnt/test-bucket/test-custom/ but it cannot be displayed via the displayHTML, with the 401.
- 0 kudos
- 3000 Views
- 2 replies
- 1 kudos
Resolved! DLT Notebook Error - Queries with streaming sources must be executed with writeStream.start();
I'm trying to parse incoming stream files in DLT which have variable length records. I'm getting the error:Queries with streaming sources must be executed with writeStream.start();Notebook code@dlt.table ( comment="xAudit Parsed" ) def b_table_pa...
- 3000 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Jason Johnson​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Than...
- 1 kudos
- 4274 Views
- 6 replies
- 2 kudos
Resolved! Notebooks cells limit
Dear Team,is there a limit in notebook cells in a single notebook in community edition ?
- 4274 Views
- 6 replies
- 2 kudos
- 3147 Views
- 4 replies
- 4 kudos
Resolved! Databricks notebook run
How to run the databricks notebook through ADF ???
- 3147 Views
- 4 replies
- 4 kudos
- 4 kudos
Hi @Punit Chauhan​ you can use databricks notebook activity in ADF to trigger you databricks notebook via ADF-
- 4 kudos
- 6527 Views
- 4 replies
- 2 kudos
Resolved! Error when importing PyDeequ package
Hi everyone,I want to do some tests regarding data quality and for that I pretend to use PyDeequ on a databricks notebook. Keep in mind that I'm very new to databricks and Spark.First I created a cluster with the Runtime version "10.4 LTS (includes A...
- 6527 Views
- 4 replies
- 2 kudos
- 2 kudos
I assumed I wouldn't need to add the Deequ library. Apparently, all I had to do was add it via Maven coordinates and it solved the problem.
- 2 kudos
- 8326 Views
- 1 replies
- 6 kudos
Resolved! Databricks Notebook Export error - Error: InvalidConfigurationError: You haven't configured the CLI yet! Please configure by entering `/databricks/python3/bin/databricks configure`
I have Databricks notebook which have some SQL code. I want to export it to Ipython notebook. Export should be automated and I am using below command%shdatabricks workspace export --overwrite --format JUPYTER "/Users/USERNAME/SQL_Automate" /Users/USE...
- 8326 Views
- 1 replies
- 6 kudos
- 6 kudos
Hi @Abhishek Jain​ ,the error says that you need to configure databricks cli, by executing: databricks configurehttps://docs.databricks.com/dev-tools/cli/index.html#set-up-authenticationRunning the command with configure option will create .databrick...
- 6 kudos
- 8386 Views
- 2 replies
- 3 kudos
Resolved! Error : MALFORMED_REQUEST
Hello,I get error for below json. Can you please advice what am I missing here?{ "error_code": "MALFORMED_REQUEST", "message": "Invalid JSON given in the body of the request - failed to parse given JSON"_________________________________________...
- 8386 Views
- 2 replies
- 3 kudos
- 3 kudos
Thank you Pat. I just realised I had copy pasted the code and it didnt quite copy 1:1. In copy paste double quotes were appeared to be copied but behind the scene, it was some other character. Nothing wrong with the code. It works
- 3 kudos