cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Library mismatch in same cluster different file

AyushModi038
New Contributor III

In continuation to the issues encountered in this discussion.

https://community.databricks.com/s/feed/0D58Y00009tCiQTSA0

I have a bizzare issue.

Here are the 2 screenshots taken few seconds apart

1.image2 .

image 

Same cluster, same command, executed 6 seconds apart gives different version of numpy.

Things tried and did not work -

  • I have tried detach and reattach the cluster
  • I have restarted the cluster, It reveresed the version in files that were previously shown, The versions interchanged in the file. Maybe due to order of execution.

Can anyone please help me to understand if i am mising anything.

6 REPLIES 6

Debayan
Databricks Employee
Databricks Employee

Hi @Ayush Modiโ€‹ , This can be an issue with numpy library. Can you please reinstall it if thats ok with PIP? Also, please let us know the version of python used?

AyushModi038
New Contributor III

Hi @Debayan Mukherjeeโ€‹ ,

โ€‹

Thanks for the response. I am not installing numpy library separately and I am dependent on DBR 12.1 ML and additional library installation is "pycaret". That may be a cause of conflict.

Can you please guide me as to how to reinstall it? (Like create a new cluster? or add library in installtion etc..)

Also, if it was a faulty installation then other one should also not work, right?

Hope to hear soon.

Debayan
Databricks Employee
Databricks Employee

@Ayush Modiโ€‹ , Yes, that is correct. this needs to be checked. Could you please create a support ticket on this? We will triage with the workspace ID and update.

Anonymous
Not applicable

HI @Ayush Modiโ€‹ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Hi @Vidula Khannaโ€‹ 

โ€‹

Thanks for the follow-up, I really appreciate it.

โ€‹

The issue is not resolved.

If possible, could you please help me by suggesting possible solution.

Currently, I will not be able to raise a ticket due to access issues hence is there a way you can help me without raising a ticket.

-Ayush โ€‹

Anonymous
Not applicable

Hi @Ayush Modiโ€‹ 

 I'm sorry you could not find a solution to your problem in the answers provided.

Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.

I suggest providing more information about your problem, such as specific error messages, error logs or details about the steps you have taken. This can help our community members better understand the issue and provide more targeted solutions.

Alternatively, you can consider contacting the support team for your product or service. They may be able to provide additional assistance or escalate the issue to the appropriate section for further investigation.

Thank you for your patience and understanding, and please let us know if there is anything else we can do to assist you.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group