szymon_dybczak
Esteemed Contributor III

Hi @ajay_wavicle ,

Azure Databricks automatically creates a SparkContext for each compute cluster, and creates an isolated SparkSession for each notebook or job executed against the cluster. 

So following should work in python module in Databricks Workspace (use spark variable):

col_df = spark.sql("SELECT * FROM  dev_factoring.information_schema.columns")
display(col_df)

szymon_dybczak_0-1770124005571.png

Another approach would be to create session explicityl using following:

from pyspark.sql import SparkSession

spark_session = SparkSession.builder.getOrCreate()
col_df = spark_session.sql("SELECT * FROM  dev_factoring.information_schema.columns")
display(col_df)

View solution in original post