Databricks Community

Gareema · 07-23-2024

Hello Team, I have a zip file in ADLS Gen 2. The folder I am using is mounted and when I run command : dbutils.fs.ls(path) it lists all the files(including the zip require). However, when I try to read the zip using 'zipfile' module, it displays 'Fil...

Gareema · 07-07-2024

Hello TeamI am using DLT. I am able to see the lineage when doing normal process. However as soon as I use 'APPLY_Changes' feature after the lineag ebreaks and I am no more able to see the Data lineage from the catalog after going to table. Is there ...

Gareema · 07-26-2024

@Witold, I know but there is a business limitation to that, so we currently can't move that. and till we move to volumes, some legacy data will be there so can't drop that as well.

Gareema · 07-26-2024

Thanks @Kaniz_Fatma . It is true that os.path.isdir(path) returns false, which is the major concern as when I try to use dbutils or just read the whole zip as a text file, it doesn't give an issue with the path. example:but when I try to use it other...

Gareema · 07-08-2024

@Kaniz_Fatma : Is there any way this can be achieved or can we expect this problem to be resolved in next releases?

Gareema · 07-08-2024

@Kaniz_Fatma Thank you for your response. However, in both approaches we are avoiding the 'APPLY_Changes' feature. In reality I want to utilise that feature to have the latest record based on the 'Sequence Key'. With merge or overwrite I will not be ...

Gareema · 07-07-2024

One point here is, both the tables are in different schema. Hence different DLT pipelines and notebooks are there.

Databricks Community

User Stats

User Activity

Not able to unzip the zip file with mount and unity catalog

Data Lineage with Apply Changes

Re: Not able to unzip the zip file with mount and unity catalog

Re: Not able to unzip the zip file with mount and unity catalog

Re: Data Lineage with Apply Changes

Re: Data Lineage with Apply Changes

Re: Data Lineage with Apply Changes