Community Activity
- 62 Views
- 1 replies
- 0 kudos
Can I automate notebook tagging based on workspace folder structure?
Hi all,I’m currently organizing a growing number of notebooks in our Databricks workspace and trying to keep things manageable with proper tagging and metadata. One idea I had was to automatically apply tags to notebooks based on their folder structu...
- 62 Views
- 1 replies
- 0 kudos
- 0 kudos
@EllaClark wrote:Hi all,I’m currently organizing a growing number of notebooks in our Databricks workspace and trying to keep things manageable with proper tagging and metadata. One idea I had was to automatically apply tags to notebooks based on the...
- 0 kudos
- 7 Views
- 0 replies
- 0 kudos
Langchain SQLDatabase not fetching column names from table in Unity Catalog
I am building a text-to-sql agent using Langchain API.I created a SQLDatabase using: db = SQLDatabase.from_databricks(catalog="`my-catalog-name`", schema="my_schema", host="...", api_token="...", warehouse_id="12345678")When I call db.get_table_info(...
- 7 Views
- 0 replies
- 0 kudos
- 98 Views
- 1 replies
- 1 kudos
OPTIMIZE command on heavily nested table OOM error
I'm trying to run the OPTIMIZE command on a table with less than 2000 rows, but it is causing an out of memory issue. The problem seems to come from the fact that it is a heavily nested table in staging between a json file and flattened table. The ta...
- 98 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi cmathieu,How are you doing today?, As per my understanding, Yeah, this sounds like one of those cases where the data volume is small, but the complexity of the schema is what’s causing the trouble. If your table has deeply nested JSON structures, ...
- 1 kudos
- 18 Views
- 1 replies
- 1 kudos
is there a way to find DLT job and task records in system.lakeflow.job_task_run_timeline?
Hi Guys,We're working on the monetization product and are trying to understand how much costs are coming from our jobs and DLT and all purpose interactive sessions? and are currently exploring the system.lakeflow.job_task_run_timeline table to find t...
- 18 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi ankit001mittal,How are you doing today?, As per my understanding, you're on the right path by using the system.lakeflow.job_task_run_timeline table to track job and task-level activity. While this table gives you rich info on task runs, it doesn't...
- 1 kudos
- 287 Views
- 3 replies
- 1 kudos
Build a streaming table on top of a snowflake table
Is it possible to create a streaming table on top of a snowflake tablel accessible via the Lakehouse Federation?
- 287 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi abelian-grape,How are you doing today?, As per my understanding, Right now, it’s not possible to create a streaming table directly on top of a Snowflake table that’s accessed through Lakehouse Federation in Databricks. Lakehouse Federation allows ...
- 1 kudos
- 3788 Views
- 2 replies
- 1 kudos
Cost of using delta sharing with unity catalog
I am new to databricks delta sharing. In case of delta sharing, i don't see any cluster running. Tried looking for documentation but only hint i got is, it usage delta sharing server but what is the cost of it and how to configure and optimize for la...
- 3788 Views
- 2 replies
- 1 kudos
- 1 kudos
@RajNath I am also looking for information around this. as far as I understood, it uses provider side compute. did you get the same info?...
- 1 kudos
- 10 Views
- 0 replies
- 0 kudos
Databricks delta sharing design
DearsI wanted to have a mindshare around delta sharing - how do you decide how many shares to be created and share with other departments if you are maintaining an enterprise wide data warehoouse/lakehouse using Azure Databricks. I see from the docum...
- 10 Views
- 0 replies
- 0 kudos
- 143 Views
- 2 replies
- 0 kudos
Databricks Access Management
Hi, Can someone suggest me what's the least level of access we can provide to any external business user to able to run a notebook and download the results. I tried with giving read and run level permissions at notebook level and also with a user gro...
- 143 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @Niki_M , Just adding one more check : did you added the user group to the cluster with minimal access ? Saran
- 0 kudos
- 50 Views
- 1 replies
- 0 kudos
Databricks exam got suspended
Hi team,My Databricks Certified Data Engineer Professional exam got suspended. I have answered almost all questions, and I was reviewing the answers. And suddenly my assessment got stopped and without giving any reasons they suspended my exam.Before ...
- 50 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi,Under those two links, you can create support tickets for both Databricks and Kryterion. I had some issues with my account and exams before, and they always helped me resolve them quickly.Contact Us - databrickContact Kryterion Email Support - kry...
- 0 kudos
- 387 Views
- 1 replies
- 0 kudos
Azure Databricks - Databricks AI Assistant missing on Azure Student Subscription?
I am going through a course learning Azure Databricks and I had created a new Azure Databricks Workspace. I am the owner of the subscription and created everything so I assume I should have full admin rights.The following is my set up-Azure Student S...
- 387 Views
- 1 replies
- 0 kudos
- 0 kudos
@rodneyc8063 According to Azure’s documentation, it states:Tip:Admins: If you’re unable to enable Databricks Assistant, you might need to disable the "Enforce data processing within workspace Geography for Designated Services" setting. See “For an ac...
- 0 kudos
- 12461 Views
- 34 replies
- 25 kudos
community edition : "User is not a member of this workspace"
Something very strange has happened. When trying to login to my databricks community edition account. I'm getting the email with my verification code. but after entring that code, I'm getting the error message : "User is not a member of this workspac...
- 12461 Views
- 34 replies
- 25 kudos
- 25 kudos
Hi everyone!I am facing the same issue, but it is not clear how to solve this. Can anyone help me, please?My email id is: ddressa.silva@gmail.comThanks in advance!
- 25 kudos
- 614 Views
- 3 replies
- 0 kudos
Unable to login community.cloud.databricks.com site getting "User is not a member of this workspace"
Unable to login community.cloud.databricks.com site getting "User is not a member of this workspace".email-id: dmpti.prabhakar@gmail.com
- 614 Views
- 3 replies
- 0 kudos
- 0 kudos
I am facing the same issue. How to solve this?My email-id is: ddressa.silva@gmail.com
- 0 kudos
- 165 Views
- 2 replies
- 1 kudos
Resolved! Not able to access free Lakehouse Fundamentals training
Hello, I have a Databricks account on this Gmail: harpal.30898@gmail.com, I am trying to access the Databricks Lakehouse fundamentals certification. But shows access denied. Any help would be highly appreciated.Thank you,Harpal
- 165 Views
- 2 replies
- 1 kudos
- 41 Views
- 0 replies
- 0 kudos
"Exploring the Legacy and Innovation of Varley"
Varley is a renowned brand that blends fashion, function, and sustainability, offering high-quality activewear designed for modern lifestyles. Known for its stylish, versatile pieces, Varley prioritizes both comfort and performance, making it a favor...
- 41 Views
- 0 replies
- 0 kudos
- 3253 Views
- 5 replies
- 10 kudos
Databricks Community Champion - March 2025 - Takuya Omi
Meet Takuya Omi (尾美拓哉), a passionate Data Engineer at NS Solutions and a valuable member of the Databricks Community. Takuya's career journey began in the marketing division of a financial institution, where his early work with SQL and machine learni...
- 3253 Views
- 5 replies
- 10 kudos
