SPARK_GEN_SUBQ_0 WHERE 1=0, Error message from Server: Configuration schema is not available

HASSAN_UPPAL123 — Tue, 25 Jun 2024 10:38:53 GMT

Hi Community,
I'm trying to read the data from sample schema from table nation from data-bricks catalog via spark but i'm getting this error.

com.databricks.client.support.exceptions.GeneralException: [Databricks][JDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: null, Query: SELECT * FROM (SELECT n_nationkey ,n_name ,n_regionkey ,n_comment FROM samples.tpch.nation order by "n_nationkey" limit 50000 offset 0) SPARK_GEN_SUBQ_0 WHERE 1=0, Error message from Server: Configuration schema is not available

Here is my sample code.

from pyspark.sql import SparkSession import os os.environ['SPARK_HOME'] = '/opt/spark' os.environ['PATH'] = os.environ['SPARK_HOME'] + '/bin:' + os.environ['PATH'] spark_dict = { "hostname": "my_hostname", "user": "my_user", "password": "my_pass", "database": "samples", "schema": "tpch", "driver": "com.databricks.client.jdbc.Driver", "url": "jdbc:databricks://host:443/samples;transportMode=http;ssl=1;AuthMech=3;httpPath=httpPath", "port": "443", "query": "SELECT n_nationkey ,n_name ,n_regionkey ,n_comment FROM samples.tpch.nation order by \"n_nationkey\" limit 50000 offset 0" } spark = ( SparkSession.builder.appName("abc") .config("spark.jars", "/home/jars/databricks-jdbc-2.6.34.jar") .getOrCreate() ) df = spark.read.format("jdbc").options(**spark_dict).load() df.show()

Can someone please guide me here how to fix the above error.

Re: SPARK_GEN_SUBQ_0 WHERE 1=0, Error message from Server: Configuration schema is not available

HASSAN_UPPAL123 — Wed, 26 Jun 2024 10:16:01 GMT

Hi Community,

I'm still facing the issue can someone please provide me any solution how to fix above error.

topic SPARK_GEN_SUBQ_0 WHERE 1=0, Error message from Server: Configuration schema is not available in Data Engineering

SPARK_GEN_SUBQ_0 WHERE 1=0, Error message from Server: Configuration schema is not available

Re: SPARK_GEN_SUBQ_0 WHERE 1=0, Error message from Server: Configuration schema is not available