other ideas:

  • validate location and file existance for example using "data" on left menu in databricks,
  • validate S3 access rights (aws admin attach policy to user/role maybe something is missing),
  • try read that as text file to check is content loading:
spark.read.text()


My blog: https://databrickster.medium.com/