When referencing a Technical Blog in a LinkedIn Post, the image of the author is displayed and not the image/picture of the blog itself - annoying.Example: Linkedin Post: https://www.linkedin.com/posts/axelschwanke_star-struct-the-secret-life-of-t...
Hello everyone,I would like to know if it was possible to transform, with PySpark, a flat file stored in a directory in Azure Blob storage into bytes format to be able to parse it, while using the connection already integrated into the cluster betwee...
Hello everyone!I was reading VCF files using the glow library (Maven: io.projectglow:glow-spark3_2.12:1.2.1).The last version of this library only works with the spark's version 3.3.2 so if I need to use a newer runtime with a more recent spark versi...
I want to add an explicit time delay between databricks workflow job tasks, any help would be greatly appreciated. Thanks
@Milliman - you could add min_retry_interval_millis to add delay between start of the failed run and the subsequent retry run. Reference is here
We have enabled workspace level sso , and have V2.0 version of databricks using azure EntraID groups and azure applications.Values in both databricks and azure application matchStill we get sso auth failed error.How can this be resolved , SAML tracer...
After creating a Databricks job using CLI v0.214.0 from a JSON input.I see the following message in the UI: "This job uses a format which has been deprecated since 2016, update it to dependent libraries automatically or learn more"When I update it, I...
Hi Team,Is there any way in data bricks to track the changes that happen at notebook level. I know using system tables we can track the changes that happen at table/view/function/ other objects. However, is there any way to track all those changes in...
Hi @ManiTejaG , Hope you are doing well! You can use the Audit logs to capture the notebook events that are logged at the workspace level. Please refer to this for more details : https://docs.databricks.com/en/administration-guide/account-settings/a...
I am getting the same below error message while trying to use Bamboolib in a databricks notebook.Error: Could not display the widget. Please re-run the cell.I have installed the pypi libraries for bamboolib on the cluster and the databricks runtime v...
Trying to run bamboolib via command bamI get: Error: Could not display the widget. Please re-run the cell.I get this sometimes. Not others.Other times bam UI works. Help
I am getting the same below error message while trying to use Bamboolib in a databricks notebook.Error: Could not display the widget. Please re-run the cell.I have installed the pypi libraries for bamboolib on the cluster and the databricks runtime v...
Does Databricks support the direct creation of stored procedures using the CREATE PROCEDURE syntax?
there is a sql api, which can run sql queries but also a job rest api which launches a job. this job can run one or more notebooks.https://docs.databricks.com/en/sql/admin/sql-execution-tutorial.htmlhttps://docs.databricks.com/api/workspace/jobs
Could it be nice to enable the use of one own photo instead of a ready avatar?
I think you can tag the Admins or the Community managers where they can help you with some relevant answers , tagging a few I know.@Kaizen@Sujitha @s_park @
I and 3 of my friends can't open https://community.databricks.com/ from Poland. The page returns 403. Different LTE and internet providers
I'm having the same issue while connecting from my ISP from Poland. @Retired_mod can you please help us with this?
Hello,I am seeing this message on all databricks environments.Action Required: Init Scripts on DBFS will stop working on March 31, 2024You must migrate init scripts of DBFS or opt-in to a september 1, 2024 extension by March 31Not sure what this is f...
How are yall managing your init script versions? I have mine in a repo i connected into databricks workspace and im using it within there. With multiple users they can push it to the repo and we can merge it in.
Hello, I'm setting up a python environment to work with databricks in vscode using Windows.I followed the instructions in Install Databricks Connect for Python, and found some issues/conflicts/errors:- There is a useless tip in the Set up the client ...
Additionally, there are no comments on how to avoid uploading virtual environment to the catalog when using databricks extension for vscode
Hey there, we're using DBR 13.3 (no Docker) as general purpose cluster and init the cluster using the following init script:```#!/usr/bin/env bashexport DEBIAN_FRONTEND=noninteractiveset -euxo pipefailif [[ $DB_IS_DRIVER = "TRUE" ]]; thenecho "I am d...
