- 4937 Views
- 3 replies
- 2 kudos
Resolved! is Spark UI available on the Databricks Free Edition?
Hi allI have a noob question, I am currently using the Databricks free edition, which runs on serverless compute.To access the Spark UI normally one would click on the attached compute, however, with serverless, I can not find the menu to access Spar...
- 4937 Views
- 3 replies
- 2 kudos
- 2 kudos
So, there is no way we can run spark in free edition as we need general purpose clusters?
- 2 kudos
- 3814 Views
- 4 replies
- 0 kudos
Databricks Features
Hi All, I am new to the Databricks, am using community version. So far, I have noticed some limitations , features like DBFS (File System) are restricted and Cluster Configuration is Locked. So I am thinking to use trial version, it will give 14 da...
- 3814 Views
- 4 replies
- 0 kudos
- 0 kudos
Translator Hello However, the DBFS file browser is often disabled by default in the user interface. It can typically be re-enabled through the admin settings. In the free edition, you would face some limitations with cluster size. However, if you...
- 0 kudos
- 7224 Views
- 7 replies
- 0 kudos
Capture data from a Specific SharePoint Site (List) in M365 into Azure DataBricks
Hello. We are using Azure Databricks and would like to ingest data from a specific M365 SharePoint Online Site/List. I was originally trying to use this recommendation, https://learn.microsoft.com/en-us/answers/questions/2116616/service-principal-a...
- 7224 Views
- 7 replies
- 0 kudos
- 0 kudos
We achieved the same using the SharePoint API. You can follow the steps outlined in this documentation: https://learn.microsoft.com/en-us/graph/auth-v2-service?tabs=http.Additionally, you can grant the Sites.Selected permission to the Azure AD applic...
- 0 kudos
- 1502 Views
- 2 replies
- 1 kudos
Dario Schiraldi Deutsche Bank Executive : Excited to Join
I’m Dario Schiraldi Deutsche Bank Executive. During my time there, I led global institutional sales and investment businesses, honing my expertise in strategy, leadership, and financial markets. As someone who’s passionate about the transformative p...
- 1502 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @ds01 ,Welcome, Dario! It’s great to have someone with your deep experience in finance and leadership join the Databricks community. Looking forward to your insights and contributions!
- 1 kudos
- 2367 Views
- 1 replies
- 0 kudos
Efficiently Copying Single or Multiple Cells in Databricks Notebooks
I found some hidden features in Databricks Notebooks, but sometimes when copying, Titles are lost. Maybe someone knows the reason?
- 2367 Views
- 1 replies
- 0 kudos
- 0 kudos
When you copy cells in Databricks, titles (headers) can be lost because:TOC (Table of Contents) comes from Markdown titles like # Level 1.If you copy only the content and not the Markdown format, it won’t show in TOC.Hidden cells under the title migh...
- 0 kudos
- 3834 Views
- 4 replies
- 3 kudos
Resolved! Unable to create Serverless Warehouse
I have all the prerequisites met as per the documentation but I don't have the option to create a serverless warehouse, which looks like is mandatory for delta share.https://learn.microsoft.com/en-us/azure/databricks/admin/sql/serverless- The workspa...
- 3834 Views
- 4 replies
- 3 kudos
- 3 kudos
Magnus, if this satisfies your query please feel free to "Accept as Solution" so that others will benefit should they be in the same situation. Cheers, Lou.
- 3 kudos
- 6388 Views
- 5 replies
- 2 kudos
Resolved! Issue enabling mosaic
Hi,I am trying to install mosaic on my cluster, but get the error once I use 'enable_mosaic': ImportError: cannot import name '_to_java_column' from 'pyspark.sql.functions' (/databricks/spark/python/pyspark/sql/functions/__init__.py) File <command-14...
- 6388 Views
- 5 replies
- 2 kudos
- 2 kudos
Hello all, do we know when databricks-mosaic will get an update support the latest spark/scala runtime? Thanks
- 2 kudos
- 3518 Views
- 2 replies
- 1 kudos
Resolved! Why Databricks Free Edition asks for my login every single time I tries to log on?
Hello all,everytime I try to log into Databricks Free Edition, I have to sign in with my email and password and then verification code via my email account.It gets really tiresome after a while.Is there a way for Databricks to remember my account log...
- 3518 Views
- 2 replies
- 1 kudos
- 1521 Views
- 1 replies
- 1 kudos
Sandbox environment
Hello,I wanted to have a hands-on experience on databricks platform and need sandbox environment for same. Please let me know if we have any such platform to practice, learn and explore databricks concepts.
- 1521 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Meghna18 ,Sure, you can use databricks free edition for that purpose. Databricks Free Edition is a no-cost version of Databricks designed for students, educators, hobbyists, and anyone interested in learning or experimenting with data and AI.Free...
- 1 kudos
- 1443 Views
- 2 replies
- 1 kudos
Data import.
i am using the databricks free edition and when i am importing a csv file i am not able to access that csv file in using spark commands(when i am creating a dataframe) it says "Public DBFS root is disabled." and i can't find any "data" tab in my side...
- 1443 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello @GRV Regarding DBFS, there is no official update on enabling full access in the Free Edition. Also, DBFS is now considered a legacy approach, and you would need to use Unity Catalog Volumes for storing and accessing data going forward is recomm...
- 1 kudos
- 6632 Views
- 9 replies
- 2 kudos
Spark configuration to access Azure Blob or ADLS
I am new to Databricks, I am using the free edition of Databricks. I have tried [spark.conf.set("fs.azure.account.auth.type.<storage-account>.dfs.core.windows.net", "SAS")spark.conf.set("fs.azure.sas.token.provider.type.<storage-account>.dfs.core.win...
- 6632 Views
- 9 replies
- 2 kudos
- 2 kudos
This is an old way of accessing data lake. With the free edition and serverless it is not supported. Try creating an external credential and external location to the data lake.https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql...
- 2 kudos
- 1500 Views
- 1 replies
- 0 kudos
Resolved! ask to how to use databricks community version
Hi, guys, as I am new to Databricks, I use Databricks free tier. But I want to explore it more and practice more, so. How do we get access to the community version? Because when I go to the community version, it redirects me to the free edition, but ...
- 1500 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Amit110409 ,Databricks has announced the free edition version of Databricks. It contains much more capabilities than the community edition.Regarding DBFS, there is no official update on enabling full access in the Free Edition. Also, DBFS is n...
- 0 kudos
- 4588 Views
- 2 replies
- 0 kudos
Converting managed table to external tables
I have some managed tables in catalog which i plan to convert to external tables. But i want preserve the version history of the tables as well. I have tried deep cloning but it builds the external table as version 0. Is there any way i can achieve t...
- 4588 Views
- 2 replies
- 0 kudos
- 0 kudos
I'm curious to know, what is the reason why you are looking to convert from managed to external? Most customers are looking to convert from external to managed, since UC managed tables help them reduce storage costs and increase query speeds. If ther...
- 0 kudos
- 2389 Views
- 1 replies
- 0 kudos
Azure File Share Connect with Databricks
Hi All,I am working on a task where i need to access Azure File Share from Databricks and move files from there to storage account blob container.I found one solution which is to use azure-file-share python package and it needs SAS token. But i don't...
- 2389 Views
- 1 replies
- 0 kudos
- 0 kudos
I think you are on the right track but getting a bit more granular. Once the Azure File Share is mounted,use Spark to move the data from the source path and write it to a blob container.
- 0 kudos
- 4158 Views
- 3 replies
- 0 kudos
Error with using Vector assembler in Unity Catalog
Hello,I am getting the below error while trying to convert my features using vector assembler in unity catalog cluster I tried setting up the config like mentioned in a different post, but it did not work still. Could use some help here.Thank you..
- 4158 Views
- 3 replies
- 0 kudos
- 0 kudos
I am stuck on the same issue, it does not make any sense to keep these blocked by UC. Let me know if someone got any solution of this issue.
- 0 kudos
