<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Getting python version errors when using pyspark rdd using databricks connect in Get Started Discussions</title>
    <link>https://community.databricks.com/t5/get-started-discussions/getting-python-version-errors-when-using-pyspark-rdd-using/m-p/67905#M2963</link>
    <description>&lt;P&gt;Got it. As a side note, I tried above methods, but the error persisted, hence upon reading docs again, there was this statement:&amp;nbsp;&lt;SPAN&gt;You must install Python 3 on your development machine, and the minor version of your client Python installation must be the same as the minor Python version of your Databricks cluster.&amp;nbsp;(Link:&amp;nbsp;&lt;A href="https://docs.databricks.com/en/dev-tools/databricks-connect-legacy.html#requirements" target="_blank"&gt;https://docs.databricks.com/en/dev-tools/databricks-connect-legacy.html#requirements&lt;/A&gt;).&amp;nbsp;&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;On aligning my environment python version with Databricks cluster python version, the error got resolved.&amp;nbsp;&lt;/SPAN&gt;&lt;/P&gt;</description>
    <pubDate>Thu, 02 May 2024 05:55:33 GMT</pubDate>
    <dc:creator>Surajv</dc:creator>
    <dc:date>2024-05-02T05:55:33Z</dc:date>
    <item>
      <title>Getting python version errors when using pyspark rdd using databricks connect</title>
      <link>https://community.databricks.com/t5/get-started-discussions/getting-python-version-errors-when-using-pyspark-rdd-using/m-p/66590#M2905</link>
      <description>&lt;P&gt;Hi community,&amp;nbsp;&lt;/P&gt;&lt;P&gt;When I use pyspark rdd related functions in my environment using databricks connect, I get below error:&amp;nbsp;&lt;/P&gt;&lt;P&gt;Databricks cluster version: 12.2.&amp;nbsp;&lt;/P&gt;&lt;P&gt;`RuntimeError: Python in worker has different version 3.9 than that in driver 3.10, PySpark cannot run with different minor versions. Please check environment variables PYSPARK PYTHON...`&lt;/P&gt;&lt;P&gt;How can I resolve it?&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Thu, 18 Apr 2024 11:22:26 GMT</pubDate>
      <guid>https://community.databricks.com/t5/get-started-discussions/getting-python-version-errors-when-using-pyspark-rdd-using/m-p/66590#M2905</guid>
      <dc:creator>Surajv</dc:creator>
      <dc:date>2024-04-18T11:22:26Z</dc:date>
    </item>
    <item>
      <title>Re: Getting python version errors when using pyspark rdd using databricks connect</title>
      <link>https://community.databricks.com/t5/get-started-discussions/getting-python-version-errors-when-using-pyspark-rdd-using/m-p/67905#M2963</link>
      <description>&lt;P&gt;Got it. As a side note, I tried above methods, but the error persisted, hence upon reading docs again, there was this statement:&amp;nbsp;&lt;SPAN&gt;You must install Python 3 on your development machine, and the minor version of your client Python installation must be the same as the minor Python version of your Databricks cluster.&amp;nbsp;(Link:&amp;nbsp;&lt;A href="https://docs.databricks.com/en/dev-tools/databricks-connect-legacy.html#requirements" target="_blank"&gt;https://docs.databricks.com/en/dev-tools/databricks-connect-legacy.html#requirements&lt;/A&gt;).&amp;nbsp;&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;On aligning my environment python version with Databricks cluster python version, the error got resolved.&amp;nbsp;&lt;/SPAN&gt;&lt;/P&gt;</description>
      <pubDate>Thu, 02 May 2024 05:55:33 GMT</pubDate>
      <guid>https://community.databricks.com/t5/get-started-discussions/getting-python-version-errors-when-using-pyspark-rdd-using/m-p/67905#M2963</guid>
      <dc:creator>Surajv</dc:creator>
      <dc:date>2024-05-02T05:55:33Z</dc:date>
    </item>
  </channel>
</rss>

