cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

chandataeng
by New Contributor
  • 1100 Views
  • 1 replies
  • 1 kudos

Resolved! How to trigger Power BI refresh from Databricks pipeline without keeping cluster alive?

I have a Databricks pipeline that pulls data from AWS, which takes ~90 minutes. After this, I need to refresh a series of Power BI dataflows (~45 mins) and then datasets (~45 mins).I want to trigger the Power BI refresh automatically from Databricks ...

  • 1100 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @chandataeng ,The current Power BI task that is available in databricks workflow will wait for refresh process to return correct status (whether it succeeded or failed).But you can start refresh process by using asynchronous REST API call. The ref...

  • 1 kudos
KIRKQUINBAR
by New Contributor III
  • 2223 Views
  • 2 replies
  • 0 kudos

Resolved! information_schema not populating with columns

We started migrating databases from hive_metastore into unity catalog back in October 2024 and ive noticed that periodically the Catalog UI will not show columns or a data preview for some tables, but not all of them that were migrated. After some di...

  • 2223 Views
  • 2 replies
  • 0 kudos
Latest Reply
KIRKQUINBAR
New Contributor III
  • 0 kudos

this is definitely a bug related to older instances of azure databricks that were upgraded to use unity platform. after going back and forth with MS support for 2+ months, we made the decision to just spin up a new instance of azure databricks and co...

  • 0 kudos
1 More Replies
alex-syk
by New Contributor II
  • 7177 Views
  • 8 replies
  • 0 kudos

Delta Sharing - Alternative to config.share

I was recently given a credential file to access shared data via delta sharing. I am following the documentation from https://docs.databricks.com/en/data-sharing/read-data-open.html. The documentation wants the contents of the credential file in a fo...

  • 7177 Views
  • 8 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, the most feasible way would be to convert the contents of your key file into base64 and only mention the spark config as below: credentials <base 64 encoded code>

  • 0 kudos
7 More Replies
Nietzsche
by New Contributor III
  • 2581 Views
  • 3 replies
  • 2 kudos

Resolved! is Spark UI available on the Databricks Free Edition?

Hi allI have a noob question, I am currently using the Databricks free edition, which runs on serverless compute.To access the Spark UI normally one would click on the attached compute, however, with serverless, I can not find the menu to access Spar...

  • 2581 Views
  • 3 replies
  • 2 kudos
Latest Reply
dyusuf
New Contributor II
  • 2 kudos

So, there is no way we can run spark in free edition as we need general purpose clusters?

  • 2 kudos
2 More Replies
Ganeshch
by New Contributor III
  • 2915 Views
  • 4 replies
  • 0 kudos

Databricks Features

Hi All, I am new to the Databricks, am using community version. So far, I have noticed some limitations , features like DBFS (File System) are restricted and  Cluster Configuration is Locked. So I am thinking to use trial version,  it will give 14 da...

  • 2915 Views
  • 4 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor
  • 0 kudos

Translator  Hello   However, the DBFS file browser is often disabled by default in the user interface. It can typically be re-enabled through the admin settings. In the free edition, you would face some limitations with cluster size.  However, if you...

  • 0 kudos
3 More Replies
SmileyVille
by New Contributor III
  • 3362 Views
  • 7 replies
  • 0 kudos

Capture data from a Specific SharePoint Site (List) in M365 into Azure DataBricks

Hello.  We are using Azure Databricks and would like to ingest data from a specific M365 SharePoint Online Site/List.  I was originally trying to use this recommendation, https://learn.microsoft.com/en-us/answers/questions/2116616/service-principal-a...

Get Started Discussions
M365
Service Principal
SharePoint Online
  • 3362 Views
  • 7 replies
  • 0 kudos
Latest Reply
Divya_Bhadauria
New Contributor III
  • 0 kudos

We achieved the same using the SharePoint API. You can follow the steps outlined in this documentation: https://learn.microsoft.com/en-us/graph/auth-v2-service?tabs=http.Additionally, you can grant the Sites.Selected permission to the Azure AD applic...

  • 0 kudos
6 More Replies
ds01
by New Contributor
  • 942 Views
  • 2 replies
  • 1 kudos

Dario Schiraldi Deutsche Bank Executive : Excited to Join

I’m Dario Schiraldi Deutsche Bank Executive. During my time there, I led global institutional sales and investment businesses, honing my expertise in strategy, leadership, and financial markets.  As someone who’s passionate about the transformative p...

  • 942 Views
  • 2 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @ds01 ,Welcome, Dario! It’s great to have someone with your deep experience in finance and leadership join the Databricks community. Looking forward to your insights and contributions!

  • 1 kudos
1 More Replies
protmaksim
by New Contributor II
  • 950 Views
  • 1 replies
  • 0 kudos

Efficiently Copying Single or Multiple Cells in Databricks Notebooks

I found some hidden features in Databricks Notebooks, but sometimes when copying, Titles are lost. Maybe someone knows the reason?

  • 950 Views
  • 1 replies
  • 0 kudos
Latest Reply
intuz
Contributor II
  • 0 kudos

When you copy cells in Databricks, titles (headers) can be lost because:TOC (Table of Contents) comes from Markdown titles like # Level 1.If you copy only the content and not the Markdown format, it won’t show in TOC.Hidden cells under the title migh...

  • 0 kudos
MagnusW
by New Contributor II
  • 2169 Views
  • 4 replies
  • 3 kudos

Resolved! Unable to create Serverless Warehouse

I have all the prerequisites met as per the documentation but I don't have the option to create a serverless warehouse, which looks like is mandatory for delta share.https://learn.microsoft.com/en-us/azure/databricks/admin/sql/serverless- The workspa...

MagnusW_0-1751404876294.png
  • 2169 Views
  • 4 replies
  • 3 kudos
Latest Reply
BigRoux
Databricks Employee
  • 3 kudos

Magnus, if this satisfies your query please feel free to "Accept as Solution" so that others will benefit should they be in the same situation. Cheers, Lou.

  • 3 kudos
3 More Replies
reggie
by New Contributor III
  • 4156 Views
  • 5 replies
  • 2 kudos

Resolved! Issue enabling mosaic

Hi,I am trying to install mosaic on my cluster, but get the error once I use 'enable_mosaic': ImportError: cannot import name '_to_java_column' from 'pyspark.sql.functions' (/databricks/spark/python/pyspark/sql/functions/__init__.py) File <command-14...

  • 4156 Views
  • 5 replies
  • 2 kudos
Latest Reply
KyleL
New Contributor II
  • 2 kudos

Hello all, do we know when databricks-mosaic will get an update support the latest spark/scala runtime? Thanks 

  • 2 kudos
4 More Replies
Nietzsche
by New Contributor III
  • 1667 Views
  • 2 replies
  • 1 kudos

Resolved! Why Databricks Free Edition asks for my login every single time I tries to log on?

Hello all,everytime I try to log into Databricks Free Edition, I have to sign in with my email and password and then verification code via my email account.It gets really tiresome after a while.Is there a way for Databricks to remember my account log...

  • 1667 Views
  • 2 replies
  • 1 kudos
Latest Reply
Nietzsche
New Contributor III
  • 1 kudos

Thank you.

  • 1 kudos
1 More Replies
Meghna18
by New Contributor
  • 858 Views
  • 1 replies
  • 1 kudos

Sandbox environment

Hello,I wanted to have a hands-on experience on databricks platform and need sandbox environment for same. Please let me know if we have any such platform to practice, learn and explore databricks concepts.

  • 858 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @Meghna18 ,Sure, you can use databricks free edition for that purpose. Databricks Free Edition is a no-cost version of Databricks designed for students, educators, hobbyists, and anyone interested in learning or experimenting with data and AI.Free...

  • 1 kudos
LulutoxSe
by New Contributor
  • 384 Views
  • 0 replies
  • 0 kudos

Lulutox: Hemligheten bakom naturlig viktminskning och ökad energi

Lulutox Oavsett om du precis har börjat din viktminskningsresa eller vill bryta igenom en platå, erbjuder Lulutox en väl avrundad, kroppspositiv väg till transformation. Det är mer än bara ett piller – det är ett verktyg för att återta kontrollen öve...

  • 384 Views
  • 0 replies
  • 0 kudos
Sujitha
by Databricks Employee
  • 24848 Views
  • 6 replies
  • 14 kudos

Join the Databricks Champions program

The Databricks Champions program is exclusively for current Databricks customers. It provides you with opportunities to: Share your Databricks storyBe recognized for the impact of your workPromote your personal brand to progress your careerAid your r...

Community Ad_July 2023 (1) (1).jpg
  • 24848 Views
  • 6 replies
  • 14 kudos
Latest Reply
deepakhari
New Contributor II
  • 14 kudos

Could not register with this link.

  • 14 kudos
5 More Replies
GRV
by New Contributor II
  • 832 Views
  • 2 replies
  • 0 kudos

Data import.

i am using the databricks free edition and when i am importing a csv file i am not able to access that csv file in using spark commands(when i am creating a dataframe) it says "Public DBFS root is disabled." and i can't find any "data" tab in my side...

  • 832 Views
  • 2 replies
  • 0 kudos
Latest Reply
ilir_nuredini
Honored Contributor
  • 0 kudos

Hello @GRV Regarding DBFS, there is no official update on enabling full access in the Free Edition. Also, DBFS is now considered a legacy approach, and you would need to use Unity Catalog Volumes for storing and accessing data going forward is recomm...

  • 0 kudos
1 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels