topic Re: Error when creating table in Apache Spark course in Training offerings

Error when creating table in Apache Spark course

DatBoi — Tue, 01 Aug 2023 20:23:00 GMT

I have just started the Apache Spark course through the Databricks Academy and am running into the following error.

When I run the command:

%sql

CREATE TABLE IF NOT EXISTS events

USING parquet OPTIONS (path "/mnt/training/ecommerce/events/events.parquet");

I get the error message:

Error in SQL statement: AzureException: hadoop_azure_shaded.com.microsoft.azure.storage.StorageException: Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.

I have ran the setup line and when I run %fs mounts I see the training file. I am new to mounts and this course so I am not sure what is going on. The exact notebook I am working in in ASP 1.2 - Databricks Platform.

Someone please help.

Re: Error when creating table in Apache Spark course

DatBoi — Tue, 01 Aug 2023 20:47:03 GMT

Even when I try to look at the files in the directory I get the same message. As shown in the image attached.

Re: Error when creating table in Apache Spark course

daniel_sahal — Wed, 02 Aug 2023 05:09:44 GMT

@DatBoi

I see that it's not only you who have this problem. Users were raising this issue several times.

@Retired_modis there any possibility to push Training team to fix that? I saw that someone was raising the ticket last month but still nothing happened.

For ref: https://community.databricks.com/t5/certifications/databricks-academy-course-issue-apache-spark-programming-with/td-p/37511

Re: Error when creating table in Apache Spark course

DatBoi — Wed, 02 Aug 2023 14:14:44 GMT

Is there any other way to get the dbc file? The previous post mentioned it was possible to get it through GitHub but apparently that repo is deleted now. The course is not as effective without be able to participate in the labs. I would try and find a different course but databricks seems to be only one of the only thorough courses on spark. Please let me know the timeline of this issue.

Re: Error when creating table in Apache Spark course

APadmanabhan — Thu, 03 Aug 2023 08:19:42 GMT

Hi @DatBoi The dbc files can be downloadable from the course itself, please login to the academy and you will find it in there.

Re: Error when creating table in Apache Spark course

DatBoi — Thu, 03 Aug 2023 13:10:43 GMT

Did you not read the post and the replies? I have the dbc file downloaded but there is an internal error with the setup line. I am not the only person with this issue as there are multiple posts outlining the same issue. Some of those posts were months ago. It is a shame that a company like databricks has let an issue like this persist for months that ruins the hands-on portion of their course.