- 5367 Views
- 1 replies
- 1 kudos
How to display shap waterfall plot
Hi,I have managed to display force plot for a single observation using the advice from this thread:Solved: How to display SHAP plots? - Databricks - 28315But is there anyway to display the newer "waterfall"-plot shap.plots.waterfall — SHAP latest doc...
- 5367 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for the swift response. I made a minimal example and it does work as you said. However when I try with my own model it does not work, the only output is<Figure size 576x468 with 3 Axes>I tried to save the figure as a file and then I do get ...
- 1 kudos
- 1258 Views
- 0 replies
- 0 kudos
How to write test code in databricks
from databricks.connect import DatabricksSession from data.dbx_conn_info import DbxConnInfo class SparkSessionManager: _instance = None _spark = None def __new__(cls): if cls._instance is None: cls._instance = s...
- 1258 Views
- 0 replies
- 0 kudos
- 12063 Views
- 3 replies
- 4 kudos
- 12063 Views
- 3 replies
- 4 kudos
- 4 kudos
Use Lakehouse Monitoring: https://docs.databricks.com/en/lakehouse-monitoring/index.html Specifically: https://docs.databricks.com/en/lakehouse-monitoring/monitor-output.html#drift-metrics-table
- 4 kudos
- 7100 Views
- 2 replies
- 2 kudos
InputWidgetNotDefined exception when running a notebook as a job
I have a notebook that reads a value of a text input in a Scala command:var startTimeStr = dbutils.widgets.get("Run Date")What doesn't make any sense that this notebook fails with InputWidgetNotDefined error when being scheduled as a job, but works j...
- 7100 Views
- 2 replies
- 2 kudos
- 13703 Views
- 4 replies
- 1 kudos
Connection to Azure SQL Server: ODBC Driver 18 for SQL Server
Task: Setup connection to Azure SQL Server.A couple things have changed...*We've started using Unity Catalog, so need Unity Catalog -enabled clusters*Legacy init scripts have been deprecated, and this is how we had our pyodbc setup, etc. defined.Code...
- 13703 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @js54123875 did you manage to find a solution for this? I'm facing a similar problem.ThanksDiego
- 1 kudos
- 2499 Views
- 1 replies
- 1 kudos
How to allow non-ASCII characters to be stored in the view definition?
I've tried to create a view with a simple conditional statement containing Polish characters. The view is created without errors, but select on the view returns question marks in place of the non-ASCII characters. Why? How to fix it?Below on screens ...
- 2499 Views
- 1 replies
- 1 kudos
- 1 kudos
Any solutions on this?We have the same problem with Greek characters.
- 1 kudos
- 3870 Views
- 2 replies
- 2 kudos
Live dashboard
Hello,I have a streaming dataset -I used delta live tables-, and I want to create a live dashboard that shows the changes instantly without the need to query the table every specific time -without the need to refresh-, What would be the best solution...
- 3870 Views
- 2 replies
- 2 kudos
- 6889 Views
- 3 replies
- 2 kudos
How to attach multiple libraries to a cluster terraform in Databricks
I'm currently trying to attach more than one maven artifact to my terraform configuration of a cluster.How can we add more than one artifact in my terraform configuration ?
- 6889 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @KunalGaurav,This can be done by using a dynamic configuration block inside your databricks_cluster resource definition.In variable.tf make a library block as:-variable "listOfMavenPackages" { type = list(string) default = [ "com.google.gua...
- 2 kudos
- 8096 Views
- 2 replies
- 0 kudos
WORKSPACE IP RANGE
Hello, everybody! I need to know whats the IP range of my azure databricks workspace. My region is East US. Can anyone help me?
- 8096 Views
- 2 replies
- 0 kudos
- 0 kudos
this is located in the azure portal (I hope you have access to it), in your Databricks Workspace settings.there you have 'virtual network' and 'private subnet name'.If you click on these, you get the address range (in CIDR notation, you can do a web ...
- 0 kudos
- 1692 Views
- 2 replies
- 0 kudos
Failed_to_convert_the_JSON_string_'interval_day_to_second'_to_a_data_type
I am trying to access a delta share table which has a field of datatype interval day to second below.Sample data in the table:- The above table while accessing through delta share giving error as below.Any help in resolving this issue will be appreci...
- 1692 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Sambit_S , did you have time to check Kaniz's response? could you please verity it and let us know if you still need help
- 0 kudos
- 1006 Views
- 0 replies
- 0 kudos
Notebook of Databricks's result
If there is no data abnormality in redshift connecting to spark from shared in databricks, and the data suddenly decreases, what cause should I check? Also, is there any way to check the variables in widget or code on each execution?
- 1006 Views
- 0 replies
- 0 kudos
- 5974 Views
- 1 replies
- 1 kudos
Resolved! ANALYZE TABLE is not updating columns stats
Hello everyone,So I am having an issue when running "ANALYZE TABLE COMPUTE STATISTICS FOR ALL COLUMNS". The way I understand it this should update the min/max value for a column when you run it for all or one column. One way to verify it from what I ...
- 5974 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @vlado101 The ANALYZE TABLE COMPUTE STATISTICS FOR ALL COLUMNS command in Databricks is used to compute statistics for all columns of a table. This information is persisted in the metastore and helps the query optimizer make decisions such as ...
- 1 kudos
- 2294 Views
- 1 replies
- 1 kudos
Structured Streaming Aggregation
Utilizing structured streaming to read the change data feed from your Delta table empowers you to execute incremental streaming aggregations, such as counting and summing.
- 2294 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for sharing @Hubert-Dudek !!!
- 1 kudos
- 6399 Views
- 2 replies
- 2 kudos
Resolved! Paramiko SFTP Get fails on databricks file system
I have an SFTP server I need to routinely download Excel files from and put into GCP cloud storage buckets.Every variation of the filepath to either my GCP path or just the dbfs in-built file system is giving an error of " [Errno 2] No such file or d...
- 6399 Views
- 2 replies
- 2 kudos
- 2 kudos
Thank you for sharing the solution. Many more users will find this information very useful.
- 2 kudos
- 2584 Views
- 1 replies
- 0 kudos
Connecting Power BI to Delta Share: Error on data retrieval
Hi everybody,sharing data with an access token and Databricks Connector works fine in Power BI (desktop). Now we wanted to switch to Delta Sharing.We setup a delta share to distribute data via open share to anyone outside our organization. Unity Cata...
- 2584 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi everybody,for anybody running into the same issue.It is a bug in the current Power Bi version (2.121.644.0). I reverted back to the April release (2.116.404.0), which does work as expected.
- 0 kudos
| User | Count |
|---|---|
| 1624 | |
| 790 | |
| 506 | |
| 349 | |
| 287 |
