https://community.databricks.com/t5/data-engineering/databricks-connect-vscode-debugging-pandas-api-not-working/m-p/38006#M26539 <P>Hi</P><P>I am using the databricks extension on VSCode and am running against an issue since two days, prior it worked fine. I receive an error when I want to use Pandas-on-Spark during debugging.</P><LI-CODE lang="python">from databricks.connect import DatabricksSession spark = DatabricksSession.builder.getOrCreate() df = spark.sql('select 1') print(df.count()) # ---&gt; printing 1 df.pandas_api().describe()</LI-CODE><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="FabriceDeseyn_0-1689838667900.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2900i188560449F0F9089/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="FabriceDeseyn_0-1689838667900.png" alt="FabriceDeseyn_0-1689838667900.png" /></span></P><P>If I look deeper it seems that SPARK_REMOTE was not set and therefor the error is thrown.</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="FabriceDeseyn_1-1689838868477.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2901i497008B2D28CDCDE/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="FabriceDeseyn_1-1689838868477.png" alt="FabriceDeseyn_1-1689838868477.png" /></span></P><P>Can anyone pinpoint what I did wrong.<BR />I did following steps already:</P><UL><LI>reinstall databricks-connect</LI><LI>reinstall extension</LI><LI>other cluster</LI><LI>other cluster with DBR 13.1 (and corresponding databricks-connect)</LI></UL><P>&nbsp;</P> Thu, 20 Jul 2023 07:42:56 GMT FabriceDeseyn 2023-07-20T07:42:56Z https://community.databricks.com/t5/data-engineering/databricks-connect-vscode-debugging-pandas-api-not-working/m-p/38006#M26539 <P>Hi</P><P>I am using the databricks extension on VSCode and am running against an issue since two days, prior it worked fine. I receive an error when I want to use Pandas-on-Spark during debugging.</P><LI-CODE lang="python">from databricks.connect import DatabricksSession spark = DatabricksSession.builder.getOrCreate() df = spark.sql('select 1') print(df.count()) # ---&gt; printing 1 df.pandas_api().describe()</LI-CODE><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="FabriceDeseyn_0-1689838667900.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2900i188560449F0F9089/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="FabriceDeseyn_0-1689838667900.png" alt="FabriceDeseyn_0-1689838667900.png" /></span></P><P>If I look deeper it seems that SPARK_REMOTE was not set and therefor the error is thrown.</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="FabriceDeseyn_1-1689838868477.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2901i497008B2D28CDCDE/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="FabriceDeseyn_1-1689838868477.png" alt="FabriceDeseyn_1-1689838868477.png" /></span></P><P>Can anyone pinpoint what I did wrong.<BR />I did following steps already:</P><UL><LI>reinstall databricks-connect</LI><LI>reinstall extension</LI><LI>other cluster</LI><LI>other cluster with DBR 13.1 (and corresponding databricks-connect)</LI></UL><P>&nbsp;</P> Thu, 20 Jul 2023 07:42:56 GMT https://community.databricks.com/t5/data-engineering/databricks-connect-vscode-debugging-pandas-api-not-working/m-p/38006#M26539 FabriceDeseyn 2023-07-20T07:42:56Z https://community.databricks.com/t5/data-engineering/databricks-connect-vscode-debugging-pandas-api-not-working/m-p/38762#M26747 <P>Additional info:<BR />It seems that the issue comes from the 1.1.0 version of the databricks extension in VSCode.<BR />Downgrading to 1.0.0 solves my issue.</P> Mon, 31 Jul 2023 08:28:28 GMT https://community.databricks.com/t5/data-engineering/databricks-connect-vscode-debugging-pandas-api-not-working/m-p/38762#M26747 FabriceDeseyn 2023-07-31T08:28:28Z