Databricks Community

dixonantony

py4j.protocol.Py4JJavaError: An error occurred while calling o123.sql.: io.unitycatalog.client.ApiException: generateTemporaryPathCredentials call failed with: 401 - {"error_code":"UNAUTHENTICATED","message":"Request to generate access credential for...

dixonantony

I was trying to access databricks and do DDL/DML operations using databricks unity catalog open apis. The create schema and select tables are working, but create table is not working due to below issues, could you please help?I was using pyspark sql ...

dixonantony

I already tried CREATE EXTERNAL TABLE , but not working.

dixonantony

Thanks for the reply, I was following below doc and select table is working, issue is with create table.spark.sql(f"create table if not exists {catalog}.{databasename}.testTable(id INTEGER, name VARCHAR(10), age INTEGER)").show()https://community.dat...

dixonantony

Also I have give all permissions for that user and I am trying it from my spark engine. .config("spark.jars.packages", "org.apache.hadoop:hadoop-aws:3.3.4,org.apache.hadoop:hadoop-common:3.3.4,io.delta:delta-spark_2.12:3.2.1,io.unitycatalog:unitycata...

dixonantony

I think the "provider" assertion is failing, how to pass provider properties

dixonantony · 11-05-2024

For me also same issue, can you please help?from pyspark.sql import SparkSessionimport pysparkimport osfrom datetime import datetimefrom subprocess import PIPE, runjdbc_url = "jdbc:databricks://adb-xxxxx.1.azuredatabricks.net:443/default;transportMod...

Databricks Community

User Stats

User Activity

Not able create table form external spark

not able to create table from pyspark sql using databricks unity catalog open apis

Re: Not able create table form external spark

Re: Not able create table form external spark

Re: not able to create table from pyspark sql using databricks unity catalog open apis

Re: not able to create table from pyspark sql using databricks unity catalog open apis

Re: jdbc integration returning header as data for read operation