Error while running the data engineering course notebook : "DE 2.2 - Providing Options for External Sources"
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-24-2023 06:06 AM
Can somebody help me fixing this problem? I am running this notebook on databricks community edition
Labels:
Anonymous
Not applicable
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-24-2023 11:53 PM
@Ammajamma Gyarappagari : Can you paste the code here?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-04-2023 03:36 AM
Has anyone found a solution? I get the same error when trying it as of today. It says file / directory doesnt exist but when i run a dbutils.fs.ls() i can see that exact path. It also doesnt change when i manually change the code in the classroom-setup-2.2
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-04-2023 05:35 AM
df = spark.read.format('parquet').load(path = datasource_path)
df = df.select("*").toPandas()
df.to_sql('users', conn, if_exists='replace', index = False)