- 10930 Views
- 10 replies
- 4 kudos
Resolved! Step by step process to create Unity Catalog in Azure Databricks
Hi all,There is no official doc with a step-by-step process to enable Unity Catalog in azure databricks.If anyone has created doc or has the process, please share it here.Thanks, in advance.
- 10930 Views
- 10 replies
- 4 kudos
- 4 kudos
Hi everyone!I have an Azure for Students subscription. Since I am unable to be an Azure Active Directory Global Administrator, I tried but it is restricted by the organization to add my user as a Global Administrator, I guess with an Azure for Studen...
- 4 kudos
- 9368 Views
- 5 replies
- 0 kudos
help me in converting the below code equivalent to databricks sql PS. with recursive is not working
SELECT position_no, position_function, work_function, job_profile_id, pos_cat as position_category, pos_cat_desc, job_posting_title as pos_title, employee_status as emp_status, emp_status_desc, clevel, subs...
- 9368 Views
- 5 replies
- 0 kudos
- 4500 Views
- 2 replies
- 2 kudos
Resolved! Turn on UDFs in Databricks SQL feature
Hello,Im using Unity Catalog managed tables and Unity Catalog DLTs. I urgently need to use a UDF in DBSQL because pySpark UDFs dont work in UC. I found this way to create a SQL function and use python language inside:CREATE FUNCTION redact(a STRING) ...
- 4500 Views
- 2 replies
- 2 kudos
- 2 kudos
It will be available soon in public preview. You will need to have a Pro SQL Warehouse or a Serverless SQL Warehouse to use Python UDF in Databricks SQL.
- 2 kudos
- 4763 Views
- 2 replies
- 0 kudos
Resolved! Schema browser for hive_metastore not working
Hi,I am not able to access the schemas inside the hive_metastore in the schema browser inside the SQL Editor in Databricks SQL. I tried on 2 databricks instances. One has Unity Catalog enabled and I am able to access the other catalogs/schemas but no...
- 4763 Views
- 2 replies
- 0 kudos
- 2321 Views
- 2 replies
- 2 kudos
Unable to run spark sql commands from ipywidget button click event
I'm unable to run any command that queries data from the unity catalog within a function that executes in the event of an ipywidget button click. Code block below. I cannot do queries such as spark.sql(f"SHOW SCHEMAS;") or spark.sql(f"select * from d...
- 2321 Views
- 2 replies
- 2 kudos
- 2 kudos
can you try to println out? val databricksApiTokenKey = CredentialContext.INHERITED_PROPERTY_DATABRICKS_API_TOKEN val databricksApiCredentialOpt = CredentialContext.getCredential(databricksApiTokenKey) val rawUrlProp = spark.sparkContext.get...
- 2 kudos
- 8123 Views
- 7 replies
- 5 kudos
Resolved! Databricks SQL cannot Communicate With External Hive Metastore which runs on Postgre SQL
I have created a premium cluster on Azure site. There were no problem Data Science and Engineering (DSAE) while i was binding Postgre SQL hive metastore. I have done all settings via Global init Scripts from Admin Console.However when I try to adjust...
- 8123 Views
- 7 replies
- 5 kudos
- 5 kudos
Find soluttion :spark.hadoop.javax.jdo.option.ConnectionURL jdbc:postgresql://#########.postgres.database.azure.com:5432/databricks_metastore?ssl=trueneeds to be spark.hadoop.javax.jdo.option.ConnectionURL jdbc:postgresql://#########.postgres.databas...
- 5 kudos