Hi,dbutils.fs.ls() is a most useful utility to list the files in remote cloud storage. I cannot use this function on top of the location managed by the Unity catalog.I have a managed external location created on `'abfss://xyz@abcd.dfs.core.windows.ne...
Hi All, I would like to understand the pricing model of the Unity Catalog. Earlier I remember there was some mention of the data lineage and a few other features that will have a cost associated with it. If that's true, what other features cost us? W...
Hi,Does the Unity catalog support the Delta Live Tables? If yes, please help me with the documentation link. If not, any update on the feature readiness timeline would help. Thank you!
Hello Bricksters,We organize the delta lake in multiple storage accounts. One storage account per data domain and one container per database. This helps us to isolate the resources and cost on the business domain level.Earlier, when a schema/database...
Hi,I am trying to connect to databricks workspace which has IP Access restriction enabled using databricks-sql-connector. Only my Proxy server IPs are added in the allow list.from databricks import sql
connection = sql.connect(
server_hostname ='...
Sorry. I couldn't understand it. The URL shared doesn't say anything about the proxy.Do you mean to set the proxy with the os environment variable?I couldn't set the proxy setting on the environment level. I want to set it only for this databricks SQ...
Hi @Pavan Kumar Chalamcharla , Thanks for the update. We only use the LTS version within our organization to minimize the frequent upgrade and maintenance around it. Even though 10.x has a lot of new features, we have to stick with the latest LTS ve...
