All Khoros Community Forums Support (Not for Databricks Product Questions) posts

Re: Need Labs Access for Data Engineering Learning Plan

Yogasathyandrun — Sat, 27 Jun 2026 12:20:09 GMT

The labs referenced in the Data Engineer Learning Plan aren’t included in the free learning plan itself.

Those hands-on labs are available through the Databricks Academy Labs subscription, which provides access to the lab-enabled versions of the courses.

If you have a labs subscription, try navigating to the Course Catalog / Catalogs in My Subscription section and enroll in the lab-enabled version of the course rather than accessing it through the learning plan.

If you’re accessing Databricks Academy through a partner organization or employer, the enrollment path may differ slightly.

Need Labs Access for Data Engineering Learning Plan

VijayRam — Sat, 27 Jun 2026 12:03:15 GMT

I am currently going through the Data Engineering Learning Plan. As I progress through the course, I noticed that it refers to labs, but I'm not sure where I can find or access them.

It would be very helpful if someone could guide me on how to access these labs.

https://customer-academy.databricks.com/learn/learning-plans/10/data-engineer-learning-plan

Re: Inference Lakehouse Monitor , how to create a monitor on more than one prediction

Sureshkrishna — Fri, 26 Jun 2026 06:03:29 GMT

This is a known limitation of the Databricks Lakehouse Monitoring API. Here's what you need to know and the workarounds:

The Limitation:
"prediction_col" must be a double type (not a string, and not a list/array)
Reference : https://medium.com/marvelous-mlops/streamlining-ml-model-monitoring-with-databricks-lakehouse-and-inference-tables-f0a99ab03291

The API only accepts a single scalar column. There's no native support for multi-output predictions like quantile regression.
Workaround Options:
1. Create separate monitors per quantile (Recommended) : Unpivot your quantile predictions into separate tables, each with its own scalar "prediction_col", and create one monitor per quantile

e.g., for quantiles [0.1, 0.5, 0.9]
for quantile, col_name in [("q10", "pred_q10"), ("q50", "pred_q50"), ("q90", "pred_q90")]:
spark.sql(f"""
CREATE OR REPLACE TABLE {CATALOG}.{SCHEMA}.inference_log_{quantile}
AS SELECT *, {col_name} AS prediction FROM {TABLE_NAME}
""")
w.quality_monitors.create(
table_name=f"{CATALOG}.{SCHEMA}.inference_log_{quantile}",
inference_log=MonitorInferenceLog(
granularities=GRANULARITIES,
timestamp_col=TIMESTAMP_COL,
model_id_col=MODEL_ID_COL,
prediction_col="prediction", 
problem_type=MonitorInferenceLogProblemType.PROBLEM_TYPE_REGRESSION,
label_col=LABEL_COL,
),
output_schema_name=f"{CATALOG}.{SCHEMA}",
assets_dir=f"{ASSETS_DIR}/{quantile}",
)

2. Use "custom_metrics" for the extra quantiles

Keep one quantile as the primary "prediction_col" (e.g., median), and track the others via custom metrics:

from databricks.sdk.service.catalog import MonitorMetric, MonitorMetricType
custom_metrics = [
MonitorMetric(
name="mean_pred_q10",
input_columns=["pred_q10"],
definition="avg(:pred_q10)",
output_data_type="double",
type=MonitorMetricType.CUSTOM_METRIC_TYPE_AGGREGATE,
),
MonitorMetric(
name="mean_pred_q90",
input_columns=["pred_q90"],
definition="avg(:pred_q90)",
output_data_type="double",
type=MonitorMetricType.CUSTOM_METRIC_TYPE_AGGREGATE,
),
]

w.quality_monitors.create(
table_name=TABLE_NAME,
inference_log=MonitorInferenceLog(
prediction_col="pred_q50", ]
...
),
custom_metrics=custom_metrics,
...
)

3. Use Snapshot analysis instead

If you don't need the inference-specific accuracy metrics (MSE, etc.), switch to a Snapshot monitor. It will profile all your quantile columns as regular numeric columns and still compute drift/distribution stats across all of them no "prediction_col" constraint.

Re: Inference Lakehouse Monitor , how to create a monitor on more than one prediction

AustinZaccor — Tue, 05 May 2026 01:27:09 GMT

Unfortunately this can only take a single column. To monitor a list of predictions for quantile regression, you need to flatten the list into distinct columns before creating the monitor.

Re: Most appropriate way to re-highlight a post on Databricks Community?

ChristianRRL — Mon, 04 May 2026 16:34:42 GMT

Perfect, I'll keep this in mind next time. Thanks!

Re: Most appropriate way to re-highlight a post on Databricks Community?

Advika — Mon, 04 May 2026 16:30:41 GMT

Hello @ChristianRRL,

I’d suggest adding a quick comment on your post, it helps bring it back up on the homepage so it gets more visibility.

Also, this post would be a better fit for the Community Forums Support page, since the discussion is about the community itself. 🙂

Most appropriate way to re-highlight a post on Databricks Community?

ChristianRRL — Mon, 04 May 2026 16:10:56 GMT

Hi there, wasn't really sure what the best way/place to post this. Please feel free to give me feedback on how to best do this in the future!

I posted a topic on Friday, and I think since it was right before the weekend my post may have been buried. Normally what would be the best way to bring attention to a post that hasn't been reviewed yet?

Declarative Automation Bundle - Reusable job_clust... - Databricks Community - 155976

Re: What does 50% even mean?

Steve_Lyle_BPCS — Thu, 30 Apr 2026 19:15:07 GMT

❤️

Re: What does 50% even mean?

Advika — Thu, 30 Apr 2026 19:13:48 GMT

Thanks for sharing this feedback, @Steve_Lyle_BPCS.
I hear your point on the lack of context and clarity. I will take this back to the team to refine this experience. Appreciate you raising it.

Re: What does 50% even mean?

Steve_Lyle_BPCS — Thu, 30 Apr 2026 14:27:10 GMT

Of course you understand I did click through on that before this post. Have you? When you do you land on your profile without any indication of what is expected. In fact, good design would mean any average user can land on the profile through _any_different_path_ and would "get" what is intended by the 50% rating.
But the real point of the post is, as currently designed, "50%" without context of "why". Except perhaps a _really_ disassociated and visually trivialized link.

Re: What does 50% even mean?

szymon_dybczak — Thu, 30 Apr 2026 14:14:20 GMT

Hi @Steve_Lyle_BPCS ,

It measures your profile completness. For example if you add something to your profile, i.e biography, image, linkedin profile your overall score should increase

If my answer was helpful, please consider marking it as accepted solution.

What does 50% even mean?

Steve_Lyle_BPCS — Thu, 30 Apr 2026 14:10:29 GMT

What's even being measured? What is the data? What got me to 50% on the path to what target? What's it take to get to 100%? What is the story this is telling?
This is "THE" data & analytics company isn't it? Cobbler's kids situation?

What challenges do developers face when building a scalable Food Donation App platform?

jameswood32 — Tue, 17 Mar 2026 11:44:49 GMT

Building a scalable Food Donation App platform comes with several technical and operational challenges. Developers must design a system that can efficiently connect donors, volunteers, NGOs, and recipients while handling real-time updates for food availability and pickups. Ensuring food safety tracking, accurate location-based matching, and timely notifications can be complex when the number of users grows. Another challenge is building a reliable backend that supports high traffic, secure data management, and smooth integrations with maps, payment gateways, or third-party services. Developers also need to focus on user-friendly design to encourage participation. What technologies, architectures, or strategies do you think can help overcome these challenges and ensure the platform scales effectively?

Re: Unable to edit my post

Advika — Mon, 16 Mar 2026 09:40:56 GMT

Hello @Saf4Databricks!

This is expected behaviour. The Edit option is available only for a limited time after a post is published. If you’d like to add additional details or share an update, please add a reply to your post.

Unable to edit my post

Saf4Databricks — Sat, 14 Mar 2026 02:48:55 GMT

We are unable to edit our post. It works sometimes but not always. For example, when I click on the drop down menu on the top right corner of the post, the drop down menu does not give the "Edit" option as shown in the image below:

Edit option not available

Re: Databricks Community - Can't post images and other quality degradations

Advika — Fri, 06 Mar 2026 11:31:54 GMT

Thank you for sharing the examples, @ChristianRRL!
We’ll continue to monitor this behaviour 👍.

Re: Databricks Community - Can't post images and other quality degradations

ChristianRRL — Thu, 05 Mar 2026 22:35:26 GMT

Thank you for looking into this! Hopefully the copy-paste issue can be resolved soon, it's quite annoying.

Relating to the bullet point issue, I haven't been able to replicate it recently and agree that it may have been a one-time issue as @Ashwin_DSA noted. But I'll provide a couple of quick examples below:

Example 1: Correct/typical behavior

testing bullet 1
testing bullet 2

Example 2: Unexpected/one-time behavior (simulated)

testing bullet 1

testing bullet 2

In this example, although I didn't experience it at the time of this writing, a few days ago the bullets functionality was being very glitchy acting closer to example 2.

Re: Publish a Technical Blog

Prosenjeet33 — Thu, 05 Mar 2026 12:50:38 GMT

Hi,

I hope you are doing well.

I would like to contribute and publish a technical blog on the Databricks Community portal. However, I am not sure about the process and appropriate platform. I would appreciate your guidance on where to start, the submission process, and any recommended topics or guidelines to follow.

Thank you for your time and support.

Best regards,
Prosenjeet Saha

Re: Databricks Community - Can't post images and other quality degradations

Advika — Wed, 04 Mar 2026 17:10:01 GMT

Hello @ChristianRRL!

Thank you for taking the time to share this.
We’re currently looking into the image copy-paste issue. In the meantime, please use the Insert Photo option in the editor or attach the image file directly to the post.

Regarding the bullet points and tab/indentation behaviour, please share more details about what felt inconsistent. If this is related to spacing and indentation when adding bullets or sub-bullets, that is part of the current editor styling behaviour. However, we’d like to better understand your experience so we can explore ways to make the posting flow smoother.

Re: Databricks Community - Can't post images and other quality degradations

Ashwin_DSA — Tue, 03 Mar 2026 20:57:35 GMT

Hi @ChristianRRL - Thanks for pointing this out.

I had some issues with bullet points earlier, but I thought it was a one-time occurrence. After trying to paste an image, I understand what you mean. I have raised this concern internally to find out if there have been any recent changes to the platform. I will keep you updated on the outcome.

If this answer resolves your question, could you mark it as “Accept as Solution”? That helps other users quickly find the correct fix.

Regards,