Databricks Community

Mikki007 · 05-26-2023

My code:from great_expectations.datasource import SparkDFDatasourcefrom pyspark.sql import SparkSessionsession_name = 'mk_spark_session'spark = SparkSession.builder.appName(session_name).getOrCreate()datasource = SparkDFDatasource(spark)query = "SELE...

Mikki007 · 04-27-2023

HiI have a notebook with many command line cells in it.I want to extract the execution time of each cell using Databricks REST API? How can I do that?Please note - I managed to get the Start & End time of the Job using REST API (/2.1/jobs/runs/get) f...

Mikki007 · 06-22-2023

@Jose Gonzalez yes! That was the case and we fixed it by using it on the standard cluster so it's working now.but thanks anyway!out of curiosity why it doesn't work on high-concurrency clusters?Thanks!Milind

Mikki007 · 05-02-2023

@Suteja Kanuri thanks for your reply however I am getting below error -b'{"error_code":"ENDPOINT_NOT_FOUND","message":"No API found for \'GET /workspace/get\'"}' the GET endpoint has been deprecated as per below doc,Workspace API 2.0 | Databricks on...

Databricks Community

User Stats

User Activity

Constructor public org.apache.spark.SparkConf(boolean) is not whitelisted.

How to extract the start and end time of the command line cell of the notebook using REST API in Azure Databricks?

Re: Constructor public org.apache.spark.SparkConf(boolean) is not whitelisted.

Re: How to extract the start and end time of the command line cell of the notebook using REST API in Azure Databricks?