cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Foreign Catalog Wrong Mapping - Azure SQL Database Binary Column

RobsonNLPT
Contributor III

Hi all.

I've used foreign catalog attached to azure sql databases and never had problems except in 2 situations:

1) Foreign Catalogs don't support sql schemas/objects like [xxxx.yyyy].tablename. The workaround is creating views on sql database

2) This is new issue: When I try to read a table from a foreign catalog, specifically a Binary column serialized as base64(a representation of a zip file) the resultset returns a truncated and wrong value and then I can't decode.

This is the second issue with data mappings. The first one was trying read a json column from google bigquery  table and now this problem reading sql varbinary column(mapped to binary in databricks).

Using data factory I can read the sql database and copy to parquet files. It works but it should be done using only databricks.

Any help?  

 

 

 

 

0 REPLIES 0

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now