cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

lsun6234
by New Contributor II
  • 5595 Views
  • 6 replies
  • 0 kudos

help me in converting the below code equivalent to databricks sql PS. with recursive is not working

 SELECT position_no,      position_function,     work_function,      job_profile_id,     pos_cat as position_category,     pos_cat_desc,     job_posting_title as pos_title,     employee_status as emp_status,     emp_status_desc,      clevel,     subs...

  • 5595 Views
  • 6 replies
  • 0 kudos
Latest Reply
DBSolution
New Contributor II
  • 0 kudos

Do we have the solution of this now?

  • 0 kudos
5 More Replies
DAUR
by New Contributor
  • 1425 Views
  • 2 replies
  • 2 kudos

Resolved! Turn on UDFs in Databricks SQL feature

Hello,Im using Unity Catalog managed tables and Unity Catalog DLTs. I urgently need to use a UDF in DBSQL because pySpark UDFs dont work in UC. I found this way to create a SQL function and use python language inside:CREATE FUNCTION redact(a STRING) ...

  • 1425 Views
  • 2 replies
  • 2 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 2 kudos

It will be available soon in public preview. You will need to have a Pro SQL Warehouse or a Serverless SQL Warehouse to use Python UDF in Databricks SQL.

  • 2 kudos
1 More Replies
Ajay-Pandey
by Esteemed Contributor III
  • 5007 Views
  • 9 replies
  • 4 kudos

Resolved! Step by step process to create Unity Catalog in Azure Databricks

Hi all,There is no official doc with a step-by-step process to enable Unity Catalog in azure databricks.If anyone has created doc or has the process, please share it here.Thanks, in advance.

  • 5007 Views
  • 9 replies
  • 4 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 4 kudos

I recorded a video showing how to setup Unity Catalog Step by step https://www.youtube.com/watch?v=M2Et5aBj2aw

  • 4 kudos
8 More Replies
oteng
by New Contributor III
  • 2209 Views
  • 2 replies
  • 0 kudos

Resolved! Schema browser for hive_metastore not working

Hi,I am not able to access the schemas inside the hive_metastore in the schema browser inside the SQL Editor in Databricks SQL. I tried on 2 databricks instances. One has Unity Catalog enabled and I am able to access the other catalogs/schemas but no...

  • 2209 Views
  • 2 replies
  • 0 kudos
Latest Reply
Aviral-Bhardwaj
Esteemed Contributor III
  • 0 kudos

this is something weird, can we connect and solve your issue

  • 0 kudos
1 More Replies
129876
by New Contributor III
  • 1307 Views
  • 2 replies
  • 2 kudos

Unable to run spark sql commands from ipywidget button click event

I'm unable to run any command that queries data from the unity catalog within a function that executes in the event of an ipywidget button click. Code block below. I cannot do queries such as spark.sql(f"SHOW SCHEMAS;") or spark.sql(f"select * from d...

  • 1307 Views
  • 2 replies
  • 2 kudos
Latest Reply
Atanu
Esteemed Contributor
  • 2 kudos

can you try to println out? val databricksApiTokenKey = CredentialContext.INHERITED_PROPERTY_DATABRICKS_API_TOKEN val databricksApiCredentialOpt = CredentialContext.getCredential(databricksApiTokenKey) val rawUrlProp = spark.sparkContext.get...

  • 2 kudos
1 More Replies
saltuk
by Contributor
  • 5002 Views
  • 7 replies
  • 5 kudos

Resolved! Databricks SQL cannot Communicate With External Hive Metastore which runs on Postgre SQL

I have created a premium cluster on Azure site. There were no problem Data Science and Engineering (DSAE) while i was binding Postgre SQL hive metastore. I have done all settings via Global init Scripts from Admin Console.However when I try to adjust...

  • 5002 Views
  • 7 replies
  • 5 kudos
Latest Reply
saltuk
Contributor
  • 5 kudos

Find soluttion :spark.hadoop.javax.jdo.option.ConnectionURL jdbc:postgresql://#########.postgres.database.azure.com:5432/databricks_metastore?ssl=trueneeds to be spark.hadoop.javax.jdo.option.ConnectionURL jdbc:postgresql://#########.postgres.databas...

  • 5 kudos
6 More Replies
Labels