Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-01-2025 10:25 AM
As title suggests, I am struggling to use pyspark bucketizer as I repeatedly get the following error:
File <command-8301298062763331>, line 4
2 from pyspark.ml.feature import Bucketizer
3 spark = SparkSession.builder.appName("test").getOrCreate()
----> 4 bucketizer = Bucketizer()
File /databricks/python/lib/python3.12/site-packages/pyspark/ml/wrapper.py:87, in JavaWrapper._new_java_obj(java_class, *args)
84 from pyspark.core.context import SparkContext
86 sc = SparkContext._active_spark_context
---> 87 assert sc is not None
89 java_obj = _jvm()
90 for name in java_class.split("."):Minimal reproducible example on serverless compute:
from pyspark.sql import SparkSession
from pyspark.ml.feature import Bucketizer
spark = SparkSession.builder.appName("test").getOrCreate()
bucketizer = Bucketizer()