cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Am I being throttled?

farzad_h
New Contributor II

Hi,

Im using the free edition as a student and trying my best to learn databricks. I have participated in the learning festival and trying to prepare bith for my exam and get employed. Im running out of time in order to use your code

I noticed you guys have started throttling me in such a way that the databricks is so slow that its rendered useless. How is this helpful for people trying to learn your product? Please unthrottle me so I can continue to learn!

1 ACCEPTED SOLUTION

Accepted Solutions

craig15miller
Visitor

Databricks Free Edition operates under strict fair usage policies and serverless compute quotas, which can result in automatic throttling or temporary resource limitations if daily usage thresholds are exceeded. To maintain your study momentum while preparing for your exam, try optimizing your code to process smaller data samples, check if your account is eligible for expanded limits via LinkedIn verification, or consider setting up a local Apache Spark environment so you can continue practicing uninterrupted if your workspace resources are restricted.

View solution in original post

2 REPLIES 2

craig15miller
Visitor

Databricks Free Edition operates under strict fair usage policies and serverless compute quotas, which can result in automatic throttling or temporary resource limitations if daily usage thresholds are exceeded. To maintain your study momentum while preparing for your exam, try optimizing your code to process smaller data samples, check if your account is eligible for expanded limits via LinkedIn verification, or consider setting up a local Apache Spark environment so you can continue practicing uninterrupted if your workspace resources are restricted.

data_pulse
New Contributor II

Slowness doesn't necessarily mean throttling. For Free edition, when usage limits are exceeded then compute can become temporarily unavailable. There also isn't a way currently yet to check if the Usage allowance for the day has been breached. 

Try Checking whether the delay is mainly in serverless start up or in the actual workload. A tiny test in a notebook like:
spark.range(10).count()

If compute/runs start getting blocked entirely, then Free edition usage limits have kicked in. Wait for the usage window to reset or can sign-in with another to practice again.

For free edition specific issues, best place to raise is:
https://community.databricks.com/t5/databricks-free-edition-help/bd-p/Databricks-Express-Setup