- 7274 Views
- 4 replies
- 3 kudos
Resolved! Writing PySpark DataFrame onto AWS Glue throwing error
I have followed the steps as mentioned in this blog : https://www.linkedin.com/pulse/aws-glue-data-catalog-metastore-databricks-deepak-rajak/ but when trying to saveAsTable(table_name), it is giving an error as IllegalArgumentException: Path must be ...
- 7274 Views
- 4 replies
- 3 kudos
- 3 kudos
Hey @Raghu Bharadwaj Tallapragada​ Just wanted to check in if you were able to resolve your issue or do you need more help? We'd love to hear from you.Thanks!
- 3 kudos
- 5094 Views
- 7 replies
- 3 kudos
Resolved! Issue with AWS Glue metacatalogue and DBR 9.1 ... 10.1
I have a simple SparkSQL Select statementoffers_df = (spark.sql(""" SELECT * FROM delta.`{}` """.format(TABLE_LOCATION)))It runs under DBR 9.0 and previous. When changing the DBR to 9.1 ...10.1 I get an exceptionorg.apache.spark.SparkException: Una...
- 5094 Views
- 7 replies
- 3 kudos
- 3 kudos
Retest in DBR 10.3 beta SUCCESSFUL.Problem does not occur in DBR 10.3 beta
- 3 kudos