- 3543 Views
- 2 replies
- 2 kudos
Resolved! Turn on UDFs in Databricks SQL feature
Hello,Im using Unity Catalog managed tables and Unity Catalog DLTs. I urgently need to use a UDF in DBSQL because pySpark UDFs dont work in UC. I found this way to create a SQL function and use python language inside:CREATE FUNCTION redact(a STRING) ...
- 3543 Views
- 2 replies
- 2 kudos
- 2 kudos
It will be available soon in public preview. You will need to have a Pro SQL Warehouse or a Serverless SQL Warehouse to use Python UDF in Databricks SQL.
- 2 kudos
- 3691 Views
- 3 replies
- 3 kudos
Problem in enabling unity catalog
I have databricks premium and I want to enable unity catalog on it, I am not able to do so. I followed the following steps which are attached in the attachments. I am also attaching the screenshot of my cluster configuration. When I run this command:...
- 3691 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @Prerna Munjal​ Help us build a vibrant and resourceful community by recognizing and highlighting insightful contributions. Mark the best answers and show your appreciation!Regards
- 3 kudos
- 4004 Views
- 3 replies
- 1 kudos
unity catalog Request failed with status code 404
maybe this is a bug in the unity catalog as the error happens multiple times when a table becomes inaccessibleerror: Request failed with status code 404try to drop the table error: NoSuchTableException: [TABLE_OR_VIEW_NOT_FOUND] try to replace the ta...
- 4004 Views
- 3 replies
- 1 kudos
- 1 kudos
the error disappeared now after a few months.It could behappens when there is a lot of schema change on db during the initial project stage.there may be some temp security issuesmay be databricks fixed in the back end appears less issue when schema r...
- 1 kudos
- 1571 Views
- 1 replies
- 0 kudos
The issue with SQL-endpoint + external hive metastore
HiWe have faced an issue recently (everything worked well 1 week before)We are using exnernal hive metastore:"spark.hadoop.datanucleus.connectionPool.maxPoolSize" : "10" "spark.sql.hive.metastore.jars" : "/dbfs/ivyjars/*" "spark.sql.hive.metastor...
- 1571 Views
- 1 replies
- 0 kudos
- 0 kudos
Generally, this should not be a case. Please raise a support request to databricks
- 0 kudos
- 5544 Views
- 3 replies
- 4 kudos
Resolved! DLT not working with Unity Catalog
Hey guys,I am trying to create a delta live table in Unity Catalog as follows:CREATE OR REFRESH STREAMING LIVE TABLE <catalog>.<db>.<table_name> AS SELECT ... However, I get the error: org.apache.spark.sql.AnalysisException: Unsupported SQL statemen...
- 5544 Views
- 3 replies
- 4 kudos
- 4 kudos
@Anant Pingle​ As of right now, DLT doesn't support Unity Catalog yet. We can expect this feature in upcomig days.
- 4 kudos
- 2377 Views
- 4 replies
- 5 kudos
Error with federation for Snowflake in Databricks SQL
Hello, I am trying to test the new federation for Snowflake feature in Databricks SQL, following the docs (https://docs.databricks.com/query-federation/snowflake.html).Environment:Subscription: PremiumCompute: DB SQL (serverless)Metastore: Unity Cata...
- 2377 Views
- 4 replies
- 5 kudos
- 5 kudos
Hi @Landan George​, thanks for the quick response. I get the following error if I try to run the SQL code from a Notebook:SQLException: No suitable driver found for jdbc:snowflake://app.snowflake.com/region/foo/Any suggestions?
- 5 kudos
- 4226 Views
- 1 replies
- 14 kudos
Resolved! SHOW PARTITIONS not supported
Error in SQL statement: AnalysisException: SHOW PARTITIONS is not supported in Unity Catalog;What happened with the SHOW PARTITIONS command?Is this information available anywhere in the documentation?If I go to Databricks SQL documentation there is n...
- 4226 Views
- 1 replies
- 14 kudos
- 14 kudos
I got answer from the support that there is no 'SHOW PARTITIONS' in Unity Catalog as "UC doesn't manage the partitions for tables".They suggested for work around `LIST` command, this is what I was able to came up with.The problem I see here, is for t...
- 14 kudos
- 8198 Views
- 4 replies
- 1 kudos
Resolved! How to lodge feature requests/enhancements?
Hi All, does anyone know the best way to provided feedback to the databricks team in regards to feature request or enhancements?This is a general question but I have immediate items I'm wishing to have improved: In the new data explorer for unity cat...
- 8198 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @Ashley Betts​ You can open a feature request (Aha Idea) at https://databricks.aha.io/ Ideas registered here are reviewed by our product management team and will be picked up for implementation in the roadmap.The ideas here are generally listed fo...
- 1 kudos
- 6715 Views
- 8 replies
- 6 kudos
SQL Endpoint with External Hive Metastore
I am trying to setup a Databricks SQL endpoint to connect to an external hive metastore. I have replicated my metastore spark config in the SQL endpoint, with the addition of adding the below to the configuration:spark.sql.hive.metastore.jars maven I...
- 6715 Views
- 8 replies
- 6 kudos
- 6 kudos
Hi @SETH JENSEN​ , Just checking if you were able to solve this issue? If no, Can you try to modify the connection string and make sslMode=Require and see if it works?
- 6 kudos
- 7400 Views
- 7 replies
- 5 kudos
Resolved! Databricks SQL cannot Communicate With External Hive Metastore which runs on Postgre SQL
I have created a premium cluster on Azure site. There were no problem Data Science and Engineering (DSAE) while i was binding Postgre SQL hive metastore. I have done all settings via Global init Scripts from Admin Console.However when I try to adjust...
- 7400 Views
- 7 replies
- 5 kudos
- 5 kudos
Find soluttion :spark.hadoop.javax.jdo.option.ConnectionURL jdbc:postgresql://#########.postgres.database.azure.com:5432/databricks_metastore?ssl=trueneeds to be spark.hadoop.javax.jdo.option.ConnectionURL jdbc:postgresql://#########.postgres.databas...
- 5 kudos