QueryingQuail
New Contributor III

Hello all,

We have a good amount of tables from an external ERP system that are being replicated to an existing dwh in an Azure SQL Server database.

We have set up a foreign connection for this database and we can connect to the server and database. Sadly, since almost all tables have a name like "dbo_Work Item$8f4cc4bc-7cd3-40df-8b85-d67139d9b4fd", these tables are not shown in Unity Catalog.

If I use a jdbc driver from e.g., DBeaver and connect using the same sql server user (login), I have no issue correctly seeing these tables. I assume that the tables are also correctly read by Databricks internally, but that the maybe the limitations in Unity Catalog (no spaces in object names: https://docs.databricks.com/aws/en/sql/language-manual/sql-ref-names) breaks the usability of "foreign" functionality.

Can someone from Databricks please reach out here and give some indication of:

- Whether this is the intended functionality (I think this should, at a minimum, be indicated somewhere like here: https://learn.microsoft.com/en-us/azure/databricks/query-federation/sql-server)?

- Whether this is being worked on or if it will not be fixed.

- If there are known workarounds.

Foreign connections are great for performing migrations to Databricks, but at the current point in time, the lacking functionality is also a big limitation.