- 11316 Views
- 2 replies
- 1 kudos
Resolved! Configuring NCC does not show option to add private endpoints
Hi!I am following this guide: https://learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/serverless-private-linkHowever in Step 3: Create private endpoint rules, number 6 there is no option for me to Add a private...
- 11316 Views
- 2 replies
- 1 kudos
- 1 kudos
@saikumar246 you were correct. It was really super easy to set up and works flawlessly! Good job dev-team!
- 1 kudos
- 5755 Views
- 0 replies
- 0 kudos
FileNotFoundError: [Errno 2] No such file or directory: 'ffmpeg'
import whisperimport ffmpegmodel = whisper.load_model("base")transcription = model.transcribe("dbfs:/FileStore/Call_Center_Conversation__03.mp3")print(transcription["text"])FileNotFoundError: [Errno 2] No such file or directory: 'ffmpeg'I have import...
- 5755 Views
- 0 replies
- 0 kudos
- 2322 Views
- 0 replies
- 0 kudos
Transform a file into a bytes format without using BlobServiceClient.
Hello everyone,I would like to know if it was possible to transform, with PySpark, a flat file stored in a directory in Azure Blob storage into bytes format to be able to parse it, while using the connection already integrated into the cluster betwee...
- 2322 Views
- 0 replies
- 0 kudos
- 5620 Views
- 1 replies
- 0 kudos
Make API Call to run job
Hi everyone,I want to trigger a run for a job using API Call.Here's my code"""import shleximport subprocessdef call_curl(curl):args = shlex.split(curl)process = subprocess.Popen(args, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE)stdout...
- 5620 Views
- 1 replies
- 0 kudos
- 4144 Views
- 1 replies
- 0 kudos
Resolved! combining accounts
I have an AWS based databricks account with a few workspaces and an Azure Databricks workspace. How do I combine them into one account?I am particularly interested in setting up a single billing drop with all my Databricks costs.
- 4144 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @BillGuyTheScien Greetings! Currently, we do not have such a feature to combine multiple cloud usage into a single account. We do have a feature request for the same and it is considered for future. Currently, there is no ETA on that. You can bro...
- 0 kudos
- 1999 Views
- 0 replies
- 0 kudos
Read VCF files using latest runtime version
Hello everyone!I was reading VCF files using the glow library (Maven: io.projectglow:glow-spark3_2.12:1.2.1).The last version of this library only works with the spark's version 3.3.2 so if I need to use a newer runtime with a more recent spark versi...
- 1999 Views
- 0 replies
- 0 kudos
- 5164 Views
- 1 replies
- 0 kudos
Catalog issue
When i was trying to create catalog i got an error saying to mention azure storage account and storage container in the following query -CREATE CATALOG IF NOT EXISTS Databricks_Anu_Jal_27022024MANAGED LOCATION 'abfss://<databricks-workspace-stack-anu...
- 5164 Views
- 1 replies
- 0 kudos
- 6582 Views
- 0 replies
- 0 kudos
Run spark code in notebook by setting spark conf instead of databricks connect configure in runtime
Hi community, I wanted to understand if there is a way to pass config values to spark session in runtime than using databricks-connect configure to run spark code. One way I found out is given here: https://stackoverflow.com/questions/63088121/config...
- 6582 Views
- 0 replies
- 0 kudos
- 5563 Views
- 4 replies
- 1 kudos
sparkR.session
Why might this be erroring out? My understanding is that SparkR is built into Databricks.Code:library(SparkR, include.only=c('read.parquet', 'collect'))sparkR.session() Error:Error in sparkR.session(): could not find function "sparkR.session"
- 5563 Views
- 4 replies
- 1 kudos
- 3864 Views
- 1 replies
- 0 kudos
How to add delay between databricks workflow job tasks.?
I want to add an explicit time delay between databricks workflow job tasks, any help would be greatly appreciated. Thanks
- 3864 Views
- 1 replies
- 0 kudos
- 0 kudos
@Milliman - you could add min_retry_interval_millis to add delay between start of the failed run and the subsequent retry run. Reference is here
- 0 kudos
- 1919 Views
- 0 replies
- 0 kudos
workspace level sso gives authentication failed error
We have enabled workspace level sso , and have V2.0 version of databricks using azure EntraID groups and azure applications.Values in both databricks and azure application matchStill we get sso auth failed error.How can this be resolved , SAML tracer...
- 1919 Views
- 0 replies
- 0 kudos
- 4087 Views
- 0 replies
- 0 kudos
🌟 Welcome Newcomers! 🌟
Hello and welcome to our wonderful Community!Whether you are here by chance or intention, we're thrilled to have you join us. Before you dive into the plethora of discussions and activities happening here, we'd love to get to know you better! ...
- 4087 Views
- 0 replies
- 0 kudos
- 1300 Views
- 0 replies
- 0 kudos
This job uses a format which has been deprecated since 2016
After creating a Databricks job using CLI v0.214.0 from a JSON input.I see the following message in the UI: "This job uses a format which has been deprecated since 2016, update it to dependent libraries automatically or learn more"When I update it, I...
- 1300 Views
- 0 replies
- 0 kudos
- 5812 Views
- 0 replies
- 0 kudos
TIMEZONE
Can I get some help from Databricks to help me understand how those timestamps being interpreted? Some are really confusing me. I have timestamp coming into AWS Databricks as String type. And the string timestamp is represented in UTC. I ran below qu...
- 5812 Views
- 0 replies
- 0 kudos
- 11716 Views
- 1 replies
- 0 kudos
Syntax of UPDATE Command in DataBricks
Hi All,I am testing the sql generated by our ETL software to see if it can run on data bricks SQL which I believe is Delta Tables underneath. This is the statement we are testing. As far as I can tell from the manual the from clause is not supported ...
- 11716 Views
- 1 replies
- 0 kudos
