job failing with below error massage
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-02-2024 04:02 AM
Caused by: HTTP Error -1; url='https://login.microsoftonline.com/271df5c2-953a-497b-93ad-7adf7a4b3cd7/oauth2/token' AzureADAuthenticator.getTokenCall threw java.net.UnknownHostException : login.microsoftonline.comshaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator$HttpException: HTTP Error -1; url='https://login.microsoftonline.com/271df5c2-953a-497b-93ad-7adf7a4b3cd7/oauth2/token' AzureADAuthenticator.getTokenCall threw java.net.UnknownHostException : login.microsoftonline.com
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-16-2024 05:22 AM
This was caused for me by the line (pyspark):
children = [f for f in dbutils.fs.ls(node)]
with the node being a
"dbfs:/mnt/lifestrategy-blob/scada/"
and this a mounted directory. It seems like the implementation of dbutils.fs is done with the same quality one is used to from databricks... the absolute minimum and very unstable. Could you please manage to renew the token?!
