Databricks Community

menotron · 01-04-2025

You can create Tableau-styled charts without leaving your notebook with just a few lines of code.Imagine this: You’re working within Databricks notebook, trying to explore your Spark/Pandas DataFrame, but visualizing the data or performing Explorator...

menotron · 09-07-2024

Hi @ak4, this is an expected behavior with DBIO transactional commit enabled and most likely the issue is when you update a table and query it immediately. You could explicitly invalidate the cache or configure disk cache. If you have a long running ...

menotron · 08-28-2024

Hi @Dnirmania, You could achieve something similar using this UDF:%sql CREATE OR REPLACE FUNCTION ryanlakehouse.default.column_masking(column_value STRING, groups_str String) RETURNS STRING LANGUAGE SQL COMMENT 'Return the column value if use...

menotron · 08-28-2024

Hi @Amodak91, you could use the %run magic command from within the downstream notebook and call the upstream notebook thus having it run in the same context and have all it's variables accessible including the dataframe without needing to persist it....

menotron · 08-23-2024

Hi @Mangeysh,You could achieve this using Databricks SQL Statement Execution API. I would recommend going through the docs and looking at the functionality and limitations and see if it serves your need before planning to develop your own APIs.

menotron · 08-22-2024

Hi @ChristianRRL, you could get this information using the dynamic value references {{job.trigger.type}}In your task settings, assign it to a parameter.And then you could access it from within your notebook using dbutils widgets

Databricks Community

User Stats

User Activity

Turn Your Dataframes into an Interactive Tableau-Styled Drag-and-Drop UI for Visual Analysis

Re: Failed to read job commit marker error

Re: Dynamic Python UDF in unity catalog

Re: How to use a Dataframe created in one Notebook from Another, without writing it anywhere ?

Re: Converting databricks query output in JSON and creating end point

Re: Manual vs. Scheduled Job Flag