- 25941 Views
- 4 replies
- 3 kudos
Resolved! install dbutils locally
So. Since I would run a git_source as a notebook_task inside a databricks Job, I read that it's possible to forward to the notebook_task (and of course now to git_source) a bunch of parameters via the `base_parameters` field on Rest API.But, on my gi...
- 25941 Views
- 4 replies
- 3 kudos
- 3 kudos
The way I was able to fix, was installing on my local dev environment `databricks-connect` as a pip library. This would emulate the whole databricks `dbutils` package, even if wouldn't work locally. But since I just needed to develop to have the func...
- 3 kudos
- 2723 Views
- 2 replies
- 1 kudos
Getting error after try to start cluster
When we try to start any cluster, we get this message, in event log:{"reason": {"code": "UNEXPECTED_LAUNCH_FAILURE","parameters": {"databricks_error_message": "Unexpected failure during launch."}}}All the clusters in this workspace have the same beha...
- 2723 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Leo Lira​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 1 kudos
- 2192 Views
- 2 replies
- 0 kudos
Cannot sign in at databricks partner-academy portal
Hi thereI have used my company email to register an account for customer-academy.databricks.com a while back.Now what I need to do is create an account with partner-academy.databricks.com using my company email too.However when I register at partner-...
- 2192 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Mandira Mukhopadhyay​ Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
- 0 kudos
- 1937 Views
- 1 replies
- 0 kudos
Cannot sign in at databricks customer-academy portal
Hi thereI have used my company email to register an account for partner-academy.databricks.com a while back.Now what I need to do is create an account with customer-academy.databricks.com using my company email too.However when I register at customer...
- 1937 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Abhiram Ambadipudi​ Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
- 0 kudos
- 6844 Views
- 6 replies
- 0 kudos
How do I get my notebooks displayed in the order that they were last modified
I use databricks for analytic work, and I have a lot of notebooks looking at different things. Right now they are listed in alphabetic order by the name of the notebook. How do I make the order display the most recently created/modified notebooks at...
- 6844 Views
- 6 replies
- 0 kudos
- 0 kudos
Hi @Barb Krienke​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 0 kudos
- 4147 Views
- 4 replies
- 2 kudos
Access workflow settings from within a notebook.
I have a notebook used for a dlt pipeline. The pipeline should perform an extra task if the pipeline is run as a full refresh. Right now, I have to set an extra configuration parameter when I run a full refresh. Is there a way to programmatically...
- 4147 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Ben Bogart​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 2 kudos
- 7407 Views
- 5 replies
- 6 kudos
Resolved! Where does Python "import" statement in a Notebook search (on Azure) for libraries?
I know that import can find installed cluster libraries, workspace libraries etc. as well as how to create wheel libraries externally and upload them.However, in a project I came across the feature that import was able to find the folder in, if I rem...
- 7407 Views
- 5 replies
- 6 kudos
- 6 kudos
Hi @Jonas Mellin​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 6 kudos
- 6532 Views
- 4 replies
- 0 kudos
Blank page after logging into community cloud
After logging in on community.cloud.databricks.com. A blank white page appears as if still loading. Does not open even when I refresh. Not an internet connectivity issue. How do I access the page ? I'm running on safari
- 6532 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @Vashista Thakuri​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.T...
- 0 kudos
- 2273 Views
- 1 replies
- 0 kudos
"assertion failed: Invalid batch"
My autoloader based streaming use microbatch process. I can not pass the following error. "java.lang.AssertionError: assertion failed: Invalid batch: payrollOutputs#217439260,meta#217439261,_metadata#217439267 != payrollOutputs#217484957,meta#2174849...
- 2273 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Julian.He​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 0 kudos
- 9020 Views
- 6 replies
- 4 kudos
Databricks job/task shows success but original notebook is not updated
I have uploaded parquet files to hive meta store tables then performed some transformations on data and generated some visualizations. All this is done in a notebook. I have scheduled the notebook for every morning so that I get a refreshed view of d...
- 9020 Views
- 6 replies
- 4 kudos
- 4 kudos
Hi @Sneha Mulrajani​ Does @Prabakar Ammeappin​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 4 kudos
- 16091 Views
- 7 replies
- 5 kudos
Resolved! autoML' is not found when using databricks.automl with runtime 112.ML (and runtime 10.4 LTS ML).
I have tried to set up a autoML experiment with runtime 11.2ML and data from a delta table. However I receive the error "ModuleNotFoundError: No module named 'databricks.automl'" and "AutoML not available: Use Databricks Runtime 8.3 ML or above." tho...
- 16091 Views
- 7 replies
- 5 kudos
- 5 kudos
I deleted the cluster and created a new with runtime 9.1 LTS ML which solved the problem.
- 5 kudos
- 3439 Views
- 2 replies
- 2 kudos
While exporting Dashboard as HTML displaying image as blank (during Job Run).
During Job run, am trying to convert the dashboard to HTML form. Images in notebook are displayed as blank. am able to see the images displayed in Result only or Dashboard mode. Only during export to HTML, there is an issue with images. Could you p...
- 3439 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Siva K​,Just a friendly follow-up. Did you have time to check Atanu's docs? did it help to resolve your question? please let us know if you need any help.
- 2 kudos
- 3880 Views
- 1 replies
- 0 kudos
ERROR - Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues. Check driver logs for WARN messages.
I get the below error when trying to run multi-threading - fails towards the end of the run. My guess is it's related to memory/worker config. I've seen some solutions involving modifying the number of workers or CPU on the cluster - however that's n...
- 3880 Views
- 1 replies
- 0 kudos
- 0 kudos
Since I don't have permissions to change cluster configurations, the only solution that ended up working was setting a max thread count to about half of the actual max so I don't overload the containers. However, open to any other optimization ideas!
- 0 kudos
- 7651 Views
- 6 replies
- 4 kudos
Resolved! How do I import class/functions so it work in Databricks and in my IDE
I already saw this postI want my code to work on both platforms (Databricks and PyCharm), is there any way to do it?
- 7651 Views
- 6 replies
- 4 kudos
- 4 kudos
yes.one way is to develop everything locally on your pc, so you also need to have spark installed.This is of course not ideal as you will not have some interesting stuff that databricks provides.But it can be done. What you have to do is create a whl...
- 4 kudos
- 2849 Views
- 2 replies
- 1 kudos
How to avoid losing dbutils.widgets parameters when connecting databricks repos folder with azure dev ops?
Hi guys We want to move from databricks workspace to databricks repos. Now when we create a new folder under repos and connect to our azure dev ops repository all our dbutils.widget parameters are lost. How to avoid this? We want to fully depend on a...
- 2849 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Kevin Peter M. Marti​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from y...
- 1 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 581 | |
| 349 | |
| 287 |
