cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

DAUR
by New Contributor
  • 1425 Views
  • 2 replies
  • 2 kudos

Resolved! Turn on UDFs in Databricks SQL feature

Hello,Im using Unity Catalog managed tables and Unity Catalog DLTs. I urgently need to use a UDF in DBSQL because pySpark UDFs dont work in UC. I found this way to create a SQL function and use python language inside:CREATE FUNCTION redact(a STRING) ...

  • 1425 Views
  • 2 replies
  • 2 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 2 kudos

It will be available soon in public preview. You will need to have a Pro SQL Warehouse or a Serverless SQL Warehouse to use Python UDF in Databricks SQL.

  • 2 kudos
1 More Replies
munjal_prerna
by New Contributor II
  • 2723 Views
  • 3 replies
  • 3 kudos

Problem in enabling unity catalog

I have databricks premium and I want to enable unity catalog on it, I am not able to do so. I followed the following steps which are attached in the attachments. I am also attaching the screenshot of my cluster configuration. When I run this command:...

  • 2723 Views
  • 3 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Prerna Munjal​ Help us build a vibrant and resourceful community by recognizing and highlighting insightful contributions. Mark the best answers and show your appreciation!Regards

  • 3 kudos
2 More Replies
lizou
by Contributor II
  • 1837 Views
  • 3 replies
  • 1 kudos

unity catalog Request failed with status code 404

maybe this is a bug in the unity catalog as the error happens multiple times when a table becomes inaccessibleerror: Request failed with status code 404try to drop the table error: NoSuchTableException: [TABLE_OR_VIEW_NOT_FOUND] try to replace the ta...

image
  • 1837 Views
  • 3 replies
  • 1 kudos
Latest Reply
lizou
Contributor II
  • 1 kudos

the error disappeared now after a few months.It could behappens when there is a lot of schema change on db during the initial project stage.there may be some temp security issuesmay be databricks fixed in the back end appears less issue when schema r...

  • 1 kudos
2 More Replies
vpismarev
by New Contributor
  • 855 Views
  • 1 replies
  • 0 kudos

The issue with SQL-endpoint + external hive metastore

HiWe have faced an issue recently (everything worked well 1 week before)We are using exnernal hive metastore:"spark.hadoop.datanucleus.connectionPool.maxPoolSize" : "10"   "spark.sql.hive.metastore.jars" : "/dbfs/ivyjars/*"   "spark.sql.hive.metastor...

  • 855 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 0 kudos

Generally, this should not be a case. Please raise a support request to databricks

  • 0 kudos
apingle
by Contributor
  • 3541 Views
  • 3 replies
  • 4 kudos

Resolved! DLT not working with Unity Catalog

Hey guys,I am trying to create a delta live table in Unity Catalog as follows:CREATE OR REFRESH STREAMING LIVE TABLE <catalog>.<db>.<table_name> AS SELECT ... However, I get the error: org.apache.spark.sql.AnalysisException: Unsupported SQL statemen...

  • 3541 Views
  • 3 replies
  • 4 kudos
Latest Reply
Harun
Honored Contributor
  • 4 kudos

@Anant Pingle​  As of right now, DLT doesn't support Unity Catalog yet. We can expect this feature in upcomig days.

  • 4 kudos
2 More Replies
bob1
by New Contributor III
  • 1240 Views
  • 4 replies
  • 5 kudos

Error with federation for Snowflake in Databricks SQL

Hello, I am trying to test the new federation for Snowflake feature in Databricks SQL, following the docs (https://docs.databricks.com/query-federation/snowflake.html).Environment:Subscription: PremiumCompute: DB SQL (serverless)Metastore: Unity Cata...

  • 1240 Views
  • 4 replies
  • 5 kudos
Latest Reply
bob1
New Contributor III
  • 5 kudos

Hi @Landan George​, thanks for the quick response. I get the following error if I try to run the SQL code from a Notebook:SQLException: No suitable driver found for jdbc:snowflake://app.snowflake.com/region/foo/Any suggestions?

  • 5 kudos
3 More Replies
Pat
by Honored Contributor III
  • 2698 Views
  • 1 replies
  • 14 kudos

Resolved! SHOW PARTITIONS not supported

Error in SQL statement: AnalysisException: SHOW PARTITIONS is not supported in Unity Catalog;What happened with the SHOW PARTITIONS command?Is this information available anywhere in the documentation?If I go to Databricks SQL documentation there is n...

  • 2698 Views
  • 1 replies
  • 14 kudos
Latest Reply
Pat
Honored Contributor III
  • 14 kudos

I got answer from the support that there is no 'SHOW PARTITIONS' in Unity Catalog as "UC doesn't manage the partitions for tables".They suggested for work around `LIST` command, this is what I was able to came up with.The problem I see here, is for t...

  • 14 kudos
Ashley1
by Contributor
  • 1819 Views
  • 4 replies
  • 1 kudos

Resolved! How to lodge feature requests/enhancements?

Hi All, does anyone know the best way to provided feedback to the databricks team in regards to feature request or enhancements?This is a general question but I have immediate items I'm wishing to have improved: In the new data explorer for unity cat...

  • 1819 Views
  • 4 replies
  • 1 kudos
Latest Reply
User16752242622
Valued Contributor
  • 1 kudos

Hi @Ashley Betts​ You can open a feature request (Aha Idea) at https://databricks.aha.io/ Ideas registered here are reviewed by our product management team and will be picked up for implementation in the roadmap.The ideas here are generally listed fo...

  • 1 kudos
3 More Replies
Seth_J
by New Contributor III
  • 3999 Views
  • 9 replies
  • 6 kudos

SQL Endpoint with External Hive Metastore

I am trying to setup a Databricks SQL endpoint to connect to an external hive metastore. I have replicated my metastore spark config in the SQL endpoint, with the addition of adding the below to the configuration:spark.sql.hive.metastore.jars maven I...

  • 3999 Views
  • 9 replies
  • 6 kudos
Latest Reply
Vivian_Wilfred
Honored Contributor
  • 6 kudos

Hi @SETH JENSEN​ , Just checking if you were able to solve this issue? If no, Can you try to modify the connection string and make sslMode=Require and see if it works?

  • 6 kudos
8 More Replies
saltuk
by Contributor
  • 5001 Views
  • 7 replies
  • 5 kudos

Resolved! Databricks SQL cannot Communicate With External Hive Metastore which runs on Postgre SQL

I have created a premium cluster on Azure site. There were no problem Data Science and Engineering (DSAE) while i was binding Postgre SQL hive metastore. I have done all settings via Global init Scripts from Admin Console.However when I try to adjust...

  • 5001 Views
  • 7 replies
  • 5 kudos
Latest Reply
saltuk
Contributor
  • 5 kudos

Find soluttion :spark.hadoop.javax.jdo.option.ConnectionURL jdbc:postgresql://#########.postgres.database.azure.com:5432/databricks_metastore?ssl=trueneeds to be spark.hadoop.javax.jdo.option.ConnectionURL jdbc:postgresql://#########.postgres.databas...

  • 5 kudos
6 More Replies
Labels