cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How can we do data copy from Databricks SQL using notebook?

Jayesh
New Contributor III

Hi Team, we have a scenario where we have to connect to the DataBricks SQL instance 1 from another DataBricks instance 2 using notebook or Azure Data Factory. Can you please help?

1 ACCEPTED SOLUTION

Accepted Solutions

User16764241763
Honored Contributor

Hello @Jayesh Mehtaโ€‹ 

You can using Python connector from notebook

https://docs.databricks.com/dev-tools/python-sql-connector.html

View solution in original post

5 REPLIES 5

User16764241763
Honored Contributor

Hello @Jayesh Mehtaโ€‹ 

You can using Python connector from notebook

https://docs.databricks.com/dev-tools/python-sql-connector.html

Jayesh
New Contributor III

Thanks a lot ๐Ÿ™‚

Hubert-Dudek
Esteemed Contributor III
  • You can also mount on both databricks workspaces the same storage folder and use COPY INTO for example,
  • In ADF you can use a databricks/delta connector to read from one delta and insert it into another,
  • If it is the one-time copy (like migration) we can copy using ADF just files between storage accounts, it is the fastest copy

artsheiko
Honored Contributor

Make sure that you need such an operation in principle : we have Clone use cases as well as Delta Sharing features that might be useful for you

Anonymous
Not applicable

Thanks for jumping in to help @Arvind Ravishโ€‹  @Hubert Dudekโ€‹ and @Artem Sheikoโ€‹ !

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group