topic Re: cannot import name 'sql' from 'databricks' in Data Engineering

cannot import name 'sql' from 'databricks'

mickniz — Wed, 12 Oct 2022 15:31:27 GMT

I am working on Databricks version 10.4 premium cluster and while importing sql from databricks module I am getting below error.

cannot import name 'sql' from 'databricks' (/databricks/python/lib/python3.8/site-packages/databricks/__init__.py).Trying to execute below sample code

from databricks import sql

import os

with sql.connect(server_hostname = os.getenv("DATABRICKS_SERVER_HOSTNAME"),

http_path = os.getenv("DATABRICKS_HTTP_PATH"),

access_token = os.getenv("DATABRICKS_TOKEN")) as connection:

with connection.cursor() as cursor:

cursor.execute("SELECT * FROM default.x LIMIT 2")

result = cursor.fetchall()

for row in result:

print(row)

ANy suggestion here

Re: cannot import name 'sql' from 'databricks'

Matt101122 — Wed, 12 Oct 2022 16:05:59 GMT

@Ritu Kumari ignore my last response lol Looks like you need to install this lib:

https://docs.databricks.com/dev-tools/python-sql-connector.html#package

Package

databricks-sql-connector

Usage:

pip install databricks-sql-connector

See also databricks-sql-connector in the Python Package Index (PyPI).

Re: cannot import name 'sql' from 'databricks'

Hubert-Dudek — Wed, 12 Oct 2022 16:50:02 GMT

Just use natively spark.sql this way code is much faster and simpler you use the power of RDD. All you need is

spark.sql("SELECT * FROM default.x LIMIT 2")

Re: cannot import name 'sql' from 'databricks'

Anonymous — Sun, 20 Nov 2022 06:28:03 GMT

Hi @Ritu Kumari

Hope all is well!

Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: cannot import name 'sql' from 'databricks'

Anonymous — Sun, 20 Nov 2022 12:08:12 GMT

Just currios, why did you use spark.sql for your case I think it easy than import sql from databricks.

Re: cannot import name 'sql' from 'databricks'

mickniz — Mon, 21 Nov 2022 07:05:46 GMT

I basically used pyodbc

Spark sql is also way.

Re: cannot import name 'sql' from 'databricks'

Sumit_Kumar — Tue, 04 Apr 2023 10:59:42 GMT

There are 2 instances I got this error -

Installing correct python package. Make sure you install "databricks.sql" module, not "databricks" module. Run below code in jupyter -

%pip install databricks.sql

2. The hostname, os.getenv("DATABRICKS_SERVER_HOSTNAME") returns, should NOT contain "https://".

Please upvote the answer if it solves your issue.

Re: cannot import name 'sql' from 'databricks'

wallystart — Tue, 25 Jul 2023 23:31:29 GMT

I resolve the same error installing library from cluster interface (UI)

cannot import name 'sql' from 'databricks'

ameet9257 — Wed, 13 Nov 2024 06:18:16 GMT

if you ever received this kind of error after installing the correct Python package then try running the below command.

dbutils.library.restartPython()