Monday
Issue Description: I created a new Databricks Free Trial account ("For Work" plan with $400 credits) but I don't have access to All-Purpose Clusters or PySpark compute. My workspace only shows SQL-only features.
Current Setup:
- Account Email: ronel.ratache@gmail.com
- Workspace Name: ronel.ratache
- Trial Plan: For Work (Premium Trial)
- Cloud Provider: AWS
- Region: us-west-2
- Account Status: Active, successfully deployed
What I Can Access:
- SQL Warehouses
- Vector Search
- Apps
- Lakehouse Postgres
What I Cannot Access (Missing):
- All-Purpose Clusters
- PySpark Compute
- Structured Streaming
- Job Clusters
What I See in the UI:
Left Sidebar → Compute
Only shows:
- Job Runs
- Data Ingestion
NO option for:
- All-Purpose Clusters
- Compute Resources
- Spark Clusters
Why I Need This: I'm building a Databricks Lakehouse POC project for my data engineering portfolio that specifically requires:
1. PySpark Development - Write and test Spark code
2. Structured Streaming - Real-time data ingestion pipelines
3. Delta Lake Transactions - ACID compliance
4. Medallion Architecture - Bronze/Silver/Gold layers
Questions
1. Is this a provisioning delay?
2. Do I need to request manual enablement for All-Purpose Clusters?
3. Is there a different Free Trial tier that includes PySpark?
Thank you for your help!
@databricks-support or @community-engineers
Tuesday
Ah, got it @pabloratache , I did some digging and here is what I found (learned a few things myself).
# Quick smoke test in a serverless notebook
from pyspark.sql import functions as F
df = spark.range(0, 10).withColumn("ts", F.current_timestamp())
df.write.format("delta").mode("overwrite").saveAsTable("demo.bronze_range")
display(spark.table("demo.bronze_range"))
Tuesday
Greetings @pabloratache , quick clarification question: are you working on Databricks Free Edition or on a Databricks 14-day Free Trial? The two are quite different in terms of capabilities and workspace behavior. Please advise when you can. Cheers, Louis.
Tuesday
Hi Louis,
Thank you for the quick response!
To clarify: I'm on a **Databricks 14-day Free Trial** (not Free Edition).
Signup path: https://www.databricks.com/try-databricks -> "For Work" plan
The issue is specifically that the Free Trial is provisioned with SQL-only access. I need All-Purpose Clusters enabled for PySpark development.
Is this a provisioning limitation, or can it be manually enabled for Free Trials?
Thank you!
Tuesday
Ah, got it @pabloratache , I did some digging and here is what I found (learned a few things myself).
# Quick smoke test in a serverless notebook
from pyspark.sql import functions as F
df = spark.range(0, 10).withColumn("ts", F.current_timestamp())
df.write.format("delta").mode("overwrite").saveAsTable("demo.bronze_range")
display(spark.table("demo.bronze_range"))
Tuesday
Thank you for taking the time to investigate and explain this. Really appreciate it!
Best regards,
Pablo
Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!
Sign Up Now