Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2021 02:23 AM
Hi @Sean Owen thanks four your reply,
your idea can work, but unfortunatelly there is any filename with the full version name. I am missing the minor part:
yyyyyy_spark_3.2_2.12_xxxxx.jar -> Spark version is really 3.2.0
I have configured databricks CLI to get metadata of the cluster and I get this output:
{
"cluster_id": "XXXXXXXXX",
"spark_context_id": YYYYYYYYYYYY,
"cluster_name": "Devel - Geospatial",
"spark_version": "10.1.x-cpu-ml-scala2.12", ##<------!!!!
....
}
"spark_version" property does not contain info about the spark version but about the DBR :-(, any thoughts?
Thanks in advance
regards
Alvaro