The error you are encountering, [NOT_IMPLEMENTED] rdd is not implemented, is due to the fact that RDD APIs are not supported in certain cluster configurations, specifically in shared clusters or job clusters with certain access modes. Please try the same in single user cluster