cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
FRG96
New Contributor III
since ‎08-27-2021
‎08-22-2023

User Stats

  • 9 Posts
  • 0 Solutions
  • 4 Kudos given
  • 4 Kudos received

User Activity

How to set the ABFSS URL for Azure Databricks Init Scripts that have spaces in directory names?

05-24-2023
I want to use an Init Script on ADLS Gen2 location for my Azure Databricks 11.3 and 12.2 clusters. The init_script.sh is placed in a directory that has spaces in it:https://storageaccount1.blob.core.windows.net/container1/directory%20with%20spaces/su...

"Create external Hive function is not supported in Unity Catalog" when registering Hive UDFs

02-01-2023
I have enabled Unity Catalog in my AWS Databricks workspace, switching from the standard Hive Metastore. I have a few custom Hive UDFs in a JAR file that I have copied to /databricks/jars/ folder through init script. I want to be able to register tho...

How to programmatically get the Spark Job ID of a running Spark Task?

02-16-2022
In Spark we can get the Spark Application ID inside the Task programmatically using:SparkEnv.get.blockManager.conf.getAppIdand we can get the Stage ID and Task Attempt ID of the running Task using:TaskContext.get.stageId TaskContext.get.taskAttemptId...
Kudos given to