I am hoping someone can help me remove the WHERE 1=0 that is constantly getting added onto the end of my Query (see below). Please let me know if I can provide more info here.
This is running a notebook, in Azure Databricks against a cluster that has the IRIS JDBC Driver loaded in the libraries.
The cluster configuration is using Spark 3.5.0
The query that gets passed into IRIS is this (from jdbc log) : SELECT * FROM (select TOP 100 AdjudicatedSvcNum, Charges, CodingSystem,CoverageGrpAuthStatus FROM CLAIMS.AdjudicatedSvcs) SPARK_GEN_SUBQ_24 WHERE 1=0
%python
connectString = "jdbc:IRIS://10.200.10.61:1981/RDD"
user = "*************"
password = "Dlh#36L!aZ"
connectionProperties = {
'user': user,
'password': password,
'driver': 'com.intersystems.jdbc.IRISDriver',
}
cacheDF = (spark.read
.format('jdbc')
.option("autopushdown", "false")
.option('url', connectString)
.option("query", "select TOP 100 AdjudicatedSvcNum, Charges, CodingSystem,CoverageGrpAuthStatus FROM CLAIMS.AdjudicatedSvcs")
.option('user', user)
.option('password', password)
.option('driver','com.intersystems.jdbc.IRISDriver')
.load()
.cache()
)
