topic Re: Graphframes not importing on Databricks 9.1 LTS ML in Data Engineering

Graphframes not importing on Databricks 9.1 LTS ML

JonHMDavis — Fri, 10 Dec 2021 09:00:39 GMT

Is Graphframes for python meant to be installed by default on Databricks 9.1 LTS ML? Previously I was running the attached python command on 7.3 LTS ML with no issue, however now I am getting "no module named graphframes" when trying to import the package, but I thought this came pre-installed with 9.1 LTS ML.

Re: Graphframes not importing on Databricks 9.1 LTS ML

JonHMDavis — Fri, 10 Dec 2021 09:42:48 GMT

Thank you @Kaniz Fatma , I will do that. I was just asking as it states here that graphframes comes pre-installed: https://docs.databricks.com/spark/latest/graph-analysis/graphframes/index.html

Re: Graphframes not importing on Databricks 9.1 LTS ML

-werners- — Mon, 13 Dec 2021 08:10:05 GMT

Hm I thought the same thing as the docs state "The GraphFrames package is included in Databricks Runtime for Machine Learning".

But that could have changed...

Re: Graphframes not importing on Databricks 9.1 LTS ML

malz — Thu, 07 Nov 2024 05:51:10 GMT

GraphFrames package import is not working in databricks runtime 13.3LTS ML, still facing the same issue. how did you resolve this? is the databricks document is still not updated since 2021!!!!

Re: Graphframes not importing on Databricks 9.1 LTS ML

MuthuLakshmi — Thu, 07 Nov 2024 15:46:30 GMT

@malz What is the error you are facing?
Databricks recommends using a cluster running Databricks Runtime for Machine Learning, as it includes an optimized installation of GraphFrames.

https://docs.databricks.com/en/integrations/graphframes/index.html

Could you provide more info!

Re: Graphframes not importing on Databricks 9.1 LTS ML

malz — Fri, 08 Nov 2024 06:25:53 GMT

Hi @MuthuLakshmi , As per the documentation it was mentioned that graphframes comes preinstalled in databricks runtime for machine learning. but when trying to import the python module of graphframes, getting no module found error.

from graphframes import *
ModuleNotFoundError: No module named 'graphframes'

pip show graphframes
WARNING: Package(s) not found: graphframes