cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Graphframes not importing on Databricks 9.1 LTS ML

JonHMDavis
New Contributor II

Is Graphframes for python meant to be installed by default on Databricks 9.1 LTS ML? Previously I was running the attached python command on 7.3 LTS ML with no issue, however now I am getting "no module named graphframes" when trying to import the package, but I thought this came pre-installed with 9.1 LTS ML.

5 REPLIES 5

JonHMDavis
New Contributor II

Thank you @Kaniz Fatmaโ€‹  , I will do that. I was just asking as it states here that graphframes comes pre-installed: https://docs.databricks.com/spark/latest/graph-analysis/graphframes/index.html

-werners-
Esteemed Contributor III

Hm I thought the same thing as the docs state "The GraphFrames package is included in Databricks Runtime for Machine Learning".

But that could have changed...

malz
New Contributor II

GraphFrames package import is not working in databricks runtime 13.3LTS ML, still facing the same issue. how did you resolve this? is the databricks document is still not updated since 2021!!!!

MuthuLakshmi
Databricks Employee
Databricks Employee

@malz What is the error you are facing?  
Databricks recommends using a cluster running Databricks Runtime for Machine Learning, as it includes an optimized installation of GraphFrames. 

https://docs.databricks.com/en/integrations/graphframes/index.html

Could you provide more info! 

malz
New Contributor II

Hi @MuthuLakshmi ,  As per the documentation it was mentioned that graphframes comes preinstalled in databricks runtime for machine learning. but when trying to import the python module of graphframes, getting no module found error.

from graphframes import *
ModuleNotFoundError: No module named 'graphframes'

pip show graphframes
WARNING: Package(s) not found: graphframes

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group