topic Re: polars to natively read and write through adls in Data Engineering

polars to natively read and write through adls

pradeepvatsvk — Sun, 26 Jan 2025 07:53:03 GMT

HI Everyone,

Is there a way polars can directly read files from ADLS through abfss protocol.

Re: polars to natively read and write through adls

jennifer986bloc — Mon, 27 Jan 2025 04:57:11 GMT

@pradeepvatsvk wrotae:
HI Everyone,
Is there a way polars can directly read files from ADLS through abfss protocol.

Hello @pradeepvatsvk,
Yes, Polars can directly read files from Azure Data Lake Storage (ADLS) using the ABFS (Azure Blob Filesystem) protocol. You can use the polars.read_csv function along with the appropriate ABFS URI to access your data.

Best Regards,
Jennifer Block

Re: polars to natively read and write through adls

pradeepvatsvk — Fri, 07 Feb 2025 17:54:36 GMT

But is not working with only abfss uri , do we need to provide credentials as well to connect to storage account