Databricks

sensanjoy · 10-09-2023

Hi Experts,Is there any way that we can monitor all our Streaming jobs in workspace to make sure they are in "RUNNING" status?I could see there is one option to create a batch job that runs frequently and check the status(through REST API) of all str...

sensanjoy · 04-27-2023

Hi Experts,We do have one use case where we have batch load that create a dataframe at end and now we want to load this data at Azure Storage Queue/Message Queue so that some Rest API can read the data/messages from the queue later and process it acc...

sensanjoy · 04-10-2023

Hi All,We do have a requirement to access delta tables from external web service(Web UI). Presently we have tested it through jdbc connection and authenticated using PAT:Ex. jdbc:spark://[DATABRICKS_HOST]:443/default;transportMode=http;ssl=1;httpPath...

sensanjoy · 03-29-2023

Hi All,I am facing some performance issue with one of pyspark udf function that post data to REST API(uses cosmos db backend to store the data).Please find the details below: # The spark dataframe(df) contains near about 30-40k data. # I am using pyt...

sensanjoy · 02-27-2023

As of today, can we use any Databricks SQL Restful API to query Delta Tables stored in ADLS from any external UI?There is some information mentioned over this link https://docs.databricks.com/sql/api/index.html? but not sure how to use them!!Checked ...

sensanjoy · 10-10-2023

Thanks@Kaniz .If we plan in programmatic way it might required less manual intervention. what do you suggest and Rest API can be used in this use case.

sensanjoy · 04-28-2023

@Suteja Kanuri excellent and I would like to thank you once again.

sensanjoy · 04-28-2023

@Suteja Kanuri looking for your input here. Thanks.

sensanjoy · 04-19-2023

Hi,Could you please share the error here!!

sensanjoy · 04-15-2023

@Suteja Kanuri Thanks a lot.Can I take the first point as: If the AAD token is part of the workspace with adequate privilege then it works otherwise to authorize, we need some PAT token on behalf of it and using PAT we may control the lifetime of th...

Databricks

User Stats

User Activity

Monitor all Streaming jobs to make sure they are in RUNNING status.

Loading data from dataframe to Azure Storage Queue/Message Queue.

Authenticate Databricks REST API and access delta tables from external web service.

Performance issue with pyspark udf function calling rest api

Databricks SQL restful API to query delta table

Re: Monitor all Streaming jobs to make sure they are in RUNNING status.

Re: Loading data from dataframe to Azure Storage Queue/Message Queue.

Re: Loading data from dataframe to Azure Storage Queue/Message Queue.

Re: when trying to use %run to a notebook, I'm getting an error.

Re: Authenticate Databricks REST API and access delta tables from external web service.