topic job failing with below error massage in Data Engineering

job failing with below error massage

PP09 — Tue, 02 Apr 2024 11:02:30 GMT

Caused by: HTTP Error -1; url='https://login.microsoftonline.com/271df5c2-953a-497b-93ad-7adf7a4b3cd7/oauth2/token' AzureADAuthenticator.getTokenCall threw java.net.UnknownHostException : login.microsoftonline.comshaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator$HttpException: HTTP Error -1; url='https://login.microsoftonline.com/271df5c2-953a-497b-93ad-7adf7a4b3cd7/oauth2/token' AzureADAuthenticator.getTokenCall threw java.net.UnknownHostException : login.microsoftonline.com

Re: job failing with below error massage

jenshumrich — Tue, 16 Jul 2024 12:22:36 GMT

This was caused for me by the line (pyspark):

children = [f for f in dbutils.fs.ls(node)]

with the node being a

"dbfs:/mnt/lifestrategy-blob/scada/"
and this a mounted directory. It seems like the implementation of dbutils.fs is done with the same quality one is used to from databricks... the absolute minimum and very unstable. Could you please manage to renew the token?!