- 8492 Views
- 2 replies
- 3 kudos
I'm having an issue accessing the excel through dlt pipeline. the file is in ADLS I'm using pandas to read the Excel. It seems pandas are not able to understand abfss protocol is there any way to read Excel with pandas in dlt pipeline?I'm getting thi...
- 8492 Views
- 2 replies
- 3 kudos
Latest Reply
Thanks for the info. It works just need to install an additional library using "%pip install openpyxl".
1 More Replies
- 3315 Views
- 3 replies
- 5 kudos
I met with an issue when I was trying to use autoloader to read json files from Azure ADLS Gen2. I am getting this issue for specific files only. I checked the file are good and not corrupted.Following is the issue:java.lang.IllegalArgumentException:...
- 3315 Views
- 3 replies
- 5 kudos
Latest Reply
I got the issue resolved. The issues was by mistake we have duplicate columns in the schema files. Because of that it was showing that error. However, the error is totally mis-leading, that's why didn't able to rectify it.
2 More Replies
- 6081 Views
- 2 replies
- 1 kudos
Now that delta live pipeline is GA we are looking to convert our existing processes to leverage it. One thing that remains unclear is how to populate new delta live tables with historical data? Currently we are looking to use CDC by leveraging create...
- 6081 Views
- 2 replies
- 1 kudos
Latest Reply
@Kaniz Fatma Hello, sorry for the delayed response. The guide does not answer how to incorporate existing delta tables that container historical data into a delta live pipeline. We ended up changing the source data to pull from the existing bronze t...
1 More Replies
