Databricks Community

tj-cycyota · 02-09-2025

Intro Ray is rapidly becoming the standard for logic-parallel computing, enabling many Databricks customers to accelerate a wide range of Python workloads. Since its general availability on Databricks in early 2024, Ray on Databricks has opened up ne...

tj-cycyota · 06-22-2021

I want to test out different APIs directly from a Databricks notebook instead of using Postman or CURL. Is this possible?

tj-cycyota · 06-22-2021

In Databricks you can do either %pipor %sh pipWhats the difference? Is there a recommended approach?

tj-cycyota · 06-21-2021

I see the default in the UI is to always create clusters in a single AZ (e.g. us-west-2a), but want to distribute workloads across all available AZs.

tj-cycyota · 06-07-2021

tj-cycyota · 06-23-2021

Koalas is great! This really helps ease the transition from Pandas to Spark, because you can just use the same Pandas functions/classes through the Koalas API but everything runs in the background in Spark.

tj-cycyota · 06-23-2021

The fmin function should be of the form:def evaluate_hyperparams(params): """ This method will be passed to `hyperopt.fmin()`. It fits and evaluates the model using the given hyperparameters to get the validation loss. :param params: This d...

tj-cycyota · 06-21-2021

Found the answer - not available in the UI, but via API, you can submit the cluster definition with "aws_attributes": { "zone_id": "auto" },This is documented in the Cluster API: https://docs.databricks.com/dev-tools/api/latest/clusters.html#aw...

tj-cycyota · 06-21-2021

MLflow Projects - these are a standardized way to package up code related to a specific data science or machine learning "project". For example, if you have a workflow to pre-process data (step 1) and train a model (step 2), you could package this up...

Databricks Community

User Stats

User Activity

Ray Monitoring Made Easy: Prometheus & Grafana with Ray on Databricks Clusters

Can you use the Databricks API from a notebook?

Whats the difference between magic commands %pip and %sh pip

How can I make a cluster start up in the availability-zone (AZ) with the most available IPs?

Is there an API to query E2 usage details by workspace? I want to query to see how many DBUs a specific workspace consumed in a certain time period.

Re: Requirement to Run Koalas

Re: what does this error in hyperopt mean, One error that users commonly encounter with Hyperopt is: There are no evaluation tasks, cannot return argmin of task losses.?

Re: How can I make a cluster start up in the availability-zone (AZ) with the most available IPs?

Re: What is the difference between mlflow projects and mlflow model?