cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Soham-003
by Visitor
  • 48 Views
  • 2 replies
  • 0 kudos

Resolved! Genie Ontology access on Free Edition

Hi Community,I am currently using the  Free Edition and I would like to explore Genie Ontology as part of a project.I checked my account and it seems Genie Ontology is not yet available on the Free Edition. Could someone guide me on how to request ac...

  • 48 Views
  • 2 replies
  • 0 kudos
Latest Reply
GabFernandes
New Contributor III
  • 0 kudos

Hi!To answer your question directly: Databricks Genie (and Genie Spaces / Ontology) is not available on the Databricks Community Edition (Free Edition), and there is currently no waitlist to enable it within that environment.Here is why, along with t...

  • 0 kudos
1 More Replies
ChristianRRL
by Honored Contributor II
  • 93 Views
  • 2 replies
  • 2 kudos

CREATE CONNECTION - Support for Community Connections?

Hi there, as the title asks, I'm wondering how Databricks Community Connections are being supported. For example, when I try to make a fresh connection via Spark SQL commands, I get an error because `COMMUNITY` type is not supported.However, when I c...

ChristianRRL_0-1785276761138.png ChristianRRL_1-1785276787254.png ChristianRRL_4-1785277045154.png ChristianRRL_3-1785276855186.png
  • 93 Views
  • 2 replies
  • 2 kudos
Latest Reply
adnan_alvee
Databricks Employee
  • 2 kudos

Lakeflow Community Connector connections are supported, but not as a normal Spark SQL CREATE CONNECTION type today. They’re supported through the Lakeflow Community Connectors flow/UI and companion CLI/API path, while SQL/SDK enum surfaces still don’...

  • 2 kudos
1 More Replies
dbernstein_tp
by Contributor
  • 44 Views
  • 3 replies
  • 3 kudos

Recommendations for a spreadsheet like interface that writes back to a databricks table

Hi Everyone, There is a need for a lakehouse front-end tool at my company that operates like an excel spreadsheet but reads/writes to a lakehouse table. This would replace actual spreadsheets that are passed around, manually updated, and then collate...

  • 44 Views
  • 3 replies
  • 3 kudos
Latest Reply
dbernstein_tp
Contributor
  • 3 kudos

Thanks, great information!

  • 3 kudos
2 More Replies
Phani1
by Databricks MVP
  • 5356 Views
  • 5 replies
  • 2 kudos

Multi languages support in Databricks

Hi Team,How can I set up multiple languages in Databricks? For example, if I connect from Germany, the workspace and data should support German. If I connect from China, it should support Chinese, and if I connect from the US, it should be in English...

  • 5356 Views
  • 5 replies
  • 2 kudos
Latest Reply
honey_sharma
  • 2 kudos

Great question! Databricks doesn't automatically change the workspace or data language based on a user's location. The best practice is to keep your data language-neutral, store translations in separate tables, detect the user's preferred language (s...

  • 2 kudos
4 More Replies
Dhruv-22
by Contributor III
  • 194 Views
  • 5 replies
  • 0 kudos

VOID column inside STRUCT fails to cast to VARIANT

Let's say I have the following dataframe%sqlCREATE OR REPLACE TEMPORARY VIEW v_temp ASVALUES (NULL, DATE'2025-12-31'), (NULL, DATE'2026-04-12'), (NULL, DATE'2026-06-23') AS T(PAYMENT_DATE, TRANSACTION_DATE);SELECT PAYMENT_DATE, TYPEOF(PAYMENT_DATE), ...

Dhruv22_0-1785136495855.png Dhruv22_1-1785136581445.png Dhruv22_2-1785136658557.png Dhruv22_3-1785136718467.png
  • 194 Views
  • 5 replies
  • 0 kudos
Latest Reply
anagilla
Databricks Employee
  • 0 kudos

Your screenshot already uses TO_VARIANT_OBJECT; the VOID field inside the STRUCT is what causes the failure. TO_VARIANT_OBJECT requires every field to be convertible to VARIANT, but VOID is not accepted in that nested path. Scalar CAST(PAYMENT_DATE A...

  • 0 kudos
4 More Replies
shama1
by New Contributor II
  • 4306 Views
  • 3 replies
  • 3 kudos

Resolved! Not able to reset password with password re-set link

I am not able to reset password https://community.cloud.databricks.com/When I use link provided in the email to re-set the password, and I enter new password, request never gets completed.Password reset link keeps on loading even after entering passw...

image
  • 4306 Views
  • 3 replies
  • 3 kudos
Latest Reply
Anusha6
Visitor
  • 3 kudos

I am not able to connect to Databricks partner academy login. The databricks SSO login directs me to MFA passkey. But I donot have a passkey setup.

  • 3 kudos
2 More Replies
maninegi05
by New Contributor II
  • 167 Views
  • 1 replies
  • 1 kudos

Databricks Apps (Streamlit) - How to Implement Proper Logout Functionality?

We have built a Databricks App using Streamlit and are looking for a way to implement a proper logout functionality.Currently, we built Logout functionality where we can clear the Streamlit session state and client-side cookies. However, the Databric...

  • 167 Views
  • 1 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, At the moment this is not a supported feature, you may want to raise it as a feautre request via your account team. Having said that there are a few things you could try to get a near but not perfect experience. Here are some options for you to e...

  • 1 kudos
LincolnGarbin
by New Contributor
  • 174 Views
  • 2 replies
  • 3 kudos

Resolved! What happens to Databricks notebooks and jobs when a user's Microsoft account is deactivated?

Hi everyone,I recently joined a company where we use Databricks to process and transform data that is ultimately used in our Power BI reports and dashboards.The person who has been training me is leaving the company. Our Databricks environment is int...

  • 174 Views
  • 2 replies
  • 3 kudos
Latest Reply
GabFernandes
New Contributor III
  • 3 kudos

Hi!This is a very common scenario when dealing with identity integration between Microsoft Entra ID (Azure AD) and Databricks.Here is a breakdown of what happens when a corporate account is deactivated, followed by the best practices to ensure zero d...

  • 3 kudos
1 More Replies
droid
by New Contributor II
  • 119 Views
  • 0 replies
  • 0 kudos

Support Multiple Tasks DAG Inside a `for_each_task` Iteration

Databricks Jobs `for_each_task` accepts exactly one nested task. For workloads that run the *samemulti-step pipeline over many datasets* — a very common metadata-driven pattern — this forces achoice between two architectures, each of which gives up s...

  • 119 Views
  • 0 replies
  • 0 kudos
17abhishek
by New Contributor III
  • 117 Views
  • 1 replies
  • 0 kudos

Issue with Notebook Scrolling Position While Switching Between Multiple Notebooks

Hi Team,For the past 1–2 weeks, I have been experiencing an issue while working with multiple notebooks simultaneously. Whenever I switch from one notebook to another, the notebook automatically scrolls back to Cell 1 instead of retaining my current ...

  • 117 Views
  • 1 replies
  • 0 kudos
Latest Reply
Brahmareddy
Esteemed Contributor II
  • 0 kudos

Hi Abhi,How are you doing today? as per my understanding, this looks like a notebook state or browser session issue. As a temporary workaround, try opening notebooks in separate browser tabs, testing in incognito mode, or clearing the browser cache.I...

  • 0 kudos
AlexSantiago
by New Contributor II
  • 19829 Views
  • 29 replies
  • 4 kudos

spotify API get token - raw_input was called, but this frontend does not support input requests.

hello everyone, I'm trying use spotify's api to analyse my music data, but i'm receiving a error during authentication, specifically when I try get the token, above my code.Is it a databricks bug?pip install spotipyfrom spotipy.oauth2 import SpotifyO...

  • 19829 Views
  • 29 replies
  • 4 kudos
Latest Reply
delta432
New Contributor
  • 4 kudos

I run Delta Xecutor a website dedicated to providing the latest information about Delta Executor for Roblox. We publish installation guides, download tutorials, update news, FAQs, troubleshooting tips, and beginner-friendly walkthroughs to help users...

  • 4 kudos
28 More Replies
maddan80
by New Contributor III
  • 4178 Views
  • 8 replies
  • 4 kudos

Oracle Essbase connectivity

Team, I wanted to understand the best way of connecting to Oracle Essbase to ingest data into the delta lake

  • 4178 Views
  • 8 replies
  • 4 kudos
Latest Reply
binlogreader
New Contributor II
  • 4 kudos

@hyaqoob @saf_dbx Your query and your connection are both fine. Error 10220 is the Databricks JDBC driver's SQLFeatureNotSupportedException, which means the tool called an optional JDBC API method the driver does not implement. It happens during data...

  • 4 kudos
7 More Replies
van45678
by New Contributor III
  • 196 Views
  • 2 replies
  • 2 kudos

Auto-Termination Did Not Trigger on Production Cluster Despite 20-Minute Inactivity

Hello everyone,I recently encountered an issue with one of our production all-purpose clusters where the auto-termination feature did not work as expected.The cluster was configured with "Terminate after 20 minutes of inactivity", but it never termin...

van45678_0-1784894552797.png van45678_1-1784894588839.png
  • 196 Views
  • 2 replies
  • 2 kudos
Latest Reply
binlogreader
New Contributor II
  • 2 kudos

@van45678 -- @balajij8 's diagnosis matches what your Spark UI shows, so I will just add three things from the operational side, one for the postmortem and two for making sure the next occurrence costs you hours instead of five days.(1) Driver logs a...

  • 2 kudos
1 More Replies
Labels