Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-29-2022 05:42 AM
I could not run the Cell # 2
java.lang.ClassNotFoundException:
---------------------------------------------------------------------------
Py4JJavaError Traceback (most recent call last)
<command-4336535992800220> in <module>
3 path = '/ml/flowersData/df-{}.tfrecord'.format(name_uuid)
4 print(path)
----> 5 df.limit(100).write.format("tfrecords").mode("overwrite").save(path)
/databricks/spark/python/pyspark/sql/readwriter.py in save(self, path, format, mode, partitionBy, **options)
738 self._jwrite.save()
739 else:
--> 740 self._jwrite.save(path)
741
742 @since(1.4)
/databricks/spark/python/lib/py4j-0.10.9.1-src.zip/py4j/java_gateway.py in __call__(self, *args)
1302
1303 answer = self.gateway_client.send_command(command)
-> 1304 return_value = get_return_value(
1305 answer, self.gateway_client, self.target_id, self.name)
1306
Can anyone help?
Labels:
- Labels:
-
Cell
-
Dataframes
-
Spark DataFrames
1 ACCEPTED SOLUTION
Accepted Solutions
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-05-2022 10:47 AM
Hi @THIAM HUAT TAN,
Which DBR version are you using? are you using the ML runtime?
2 REPLIES 2
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-05-2022 10:47 AM
Hi @THIAM HUAT TAN,
Which DBR version are you using? are you using the ML runtime?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-05-2022 10:20 PM
yes, the issue arise from the cluster which is a non-ML runtime. Thanks for your comments.
![](/skins/images/582998B45490C7019731A5B3A872C751/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/582998B45490C7019731A5B3A872C751/responsive_peak/images/icon_anonymous_message.png)