- 2999 Views
- 1 replies
- 0 kudos
Efficiently Copying Single or Multiple Cells in Databricks Notebooks
I found some hidden features in Databricks Notebooks, but sometimes when copying, Titles are lost. Maybe someone knows the reason?
- 2999 Views
- 1 replies
- 0 kudos
- 0 kudos
When you copy cells in Databricks, titles (headers) can be lost because:TOC (Table of Contents) comes from Markdown titles like # Level 1.If you copy only the content and not the Markdown format, it won’t show in TOC.Hidden cells under the title migh...
- 0 kudos
- 4653 Views
- 4 replies
- 3 kudos
Resolved! Unable to create Serverless Warehouse
I have all the prerequisites met as per the documentation but I don't have the option to create a serverless warehouse, which looks like is mandatory for delta share.https://learn.microsoft.com/en-us/azure/databricks/admin/sql/serverless- The workspa...
- 4653 Views
- 4 replies
- 3 kudos
- 3 kudos
Magnus, if this satisfies your query please feel free to "Accept as Solution" so that others will benefit should they be in the same situation. Cheers, Lou.
- 3 kudos
- 7073 Views
- 5 replies
- 2 kudos
Resolved! Issue enabling mosaic
Hi,I am trying to install mosaic on my cluster, but get the error once I use 'enable_mosaic': ImportError: cannot import name '_to_java_column' from 'pyspark.sql.functions' (/databricks/spark/python/pyspark/sql/functions/__init__.py) File <command-14...
- 7073 Views
- 5 replies
- 2 kudos
- 2 kudos
Hello all, do we know when databricks-mosaic will get an update support the latest spark/scala runtime? Thanks
- 2 kudos
- 3969 Views
- 2 replies
- 1 kudos
Resolved! Why Databricks Free Edition asks for my login every single time I tries to log on?
Hello all,everytime I try to log into Databricks Free Edition, I have to sign in with my email and password and then verification code via my email account.It gets really tiresome after a while.Is there a way for Databricks to remember my account log...
- 3969 Views
- 2 replies
- 1 kudos
- 1808 Views
- 1 replies
- 1 kudos
Sandbox environment
Hello,I wanted to have a hands-on experience on databricks platform and need sandbox environment for same. Please let me know if we have any such platform to practice, learn and explore databricks concepts.
- 1808 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Meghna18 ,Sure, you can use databricks free edition for that purpose. Databricks Free Edition is a no-cost version of Databricks designed for students, educators, hobbyists, and anyone interested in learning or experimenting with data and AI.Free...
- 1 kudos
- 1705 Views
- 2 replies
- 1 kudos
Data import.
i am using the databricks free edition and when i am importing a csv file i am not able to access that csv file in using spark commands(when i am creating a dataframe) it says "Public DBFS root is disabled." and i can't find any "data" tab in my side...
- 1705 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello @GRV Regarding DBFS, there is no official update on enabling full access in the Free Edition. Also, DBFS is now considered a legacy approach, and you would need to use Unity Catalog Volumes for storing and accessing data going forward is recomm...
- 1 kudos
- 7414 Views
- 9 replies
- 2 kudos
Spark configuration to access Azure Blob or ADLS
I am new to Databricks, I am using the free edition of Databricks. I have tried [spark.conf.set("fs.azure.account.auth.type.<storage-account>.dfs.core.windows.net", "SAS")spark.conf.set("fs.azure.sas.token.provider.type.<storage-account>.dfs.core.win...
- 7414 Views
- 9 replies
- 2 kudos
- 2 kudos
This is an old way of accessing data lake. With the free edition and serverless it is not supported. Try creating an external credential and external location to the data lake.https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql...
- 2 kudos
- 1982 Views
- 1 replies
- 0 kudos
Resolved! ask to how to use databricks community version
Hi, guys, as I am new to Databricks, I use Databricks free tier. But I want to explore it more and practice more, so. How do we get access to the community version? Because when I go to the community version, it redirects me to the free edition, but ...
- 1982 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Amit110409 ,Databricks has announced the free edition version of Databricks. It contains much more capabilities than the community edition.Regarding DBFS, there is no official update on enabling full access in the Free Edition. Also, DBFS is n...
- 0 kudos
- 5163 Views
- 2 replies
- 0 kudos
Converting managed table to external tables
I have some managed tables in catalog which i plan to convert to external tables. But i want preserve the version history of the tables as well. I have tried deep cloning but it builds the external table as version 0. Is there any way i can achieve t...
- 5163 Views
- 2 replies
- 0 kudos
- 0 kudos
I'm curious to know, what is the reason why you are looking to convert from managed to external? Most customers are looking to convert from external to managed, since UC managed tables help them reduce storage costs and increase query speeds. If ther...
- 0 kudos
- 2744 Views
- 1 replies
- 0 kudos
Azure File Share Connect with Databricks
Hi All,I am working on a task where i need to access Azure File Share from Databricks and move files from there to storage account blob container.I found one solution which is to use azure-file-share python package and it needs SAS token. But i don't...
- 2744 Views
- 1 replies
- 0 kudos
- 0 kudos
I think you are on the right track but getting a bit more granular. Once the Azure File Share is mounted,use Spark to move the data from the source path and write it to a blob container.
- 0 kudos
- 4528 Views
- 3 replies
- 0 kudos
Error with using Vector assembler in Unity Catalog
Hello,I am getting the below error while trying to convert my features using vector assembler in unity catalog cluster I tried setting up the config like mentioned in a different post, but it did not work still. Could use some help here.Thank you..
- 4528 Views
- 3 replies
- 0 kudos
- 0 kudos
I am stuck on the same issue, it does not make any sense to keep these blocked by UC. Let me know if someone got any solution of this issue.
- 0 kudos
- 1823 Views
- 1 replies
- 0 kudos
Does Databricks run it's own compute clusters?
Rather new to Databricks so I understand this might be a silly question, but from what I understand so far Databricks leverages Spark for parallelized computation-but when we create a compute is it using the compute power from whatever cloud provider...
- 1823 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello billyboy,You can start it off by looking in their official architecture documentation: https://learn.microsoft.com/en-us/azure/databricks/getting-started/overviewAnd next this is the article I like, that goes in more details: https://www.accent...
- 0 kudos
- 7302 Views
- 2 replies
- 0 kudos
How to create a mount point to File share in Azure Storage account
Hello All,I have a requirement to create a mount point to file share in Azure Storage account, I did follow the official documentation. However, I could not create the mount point to fileshare.. and the documentation discribed the mount point creatio...
- 7302 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi Raja,You're correct that the wasbs:// method is for Azure Blob Storage, not File Shares! I believe File Share mounting is different and would require you to use SMB protocol mounted outside of Databricks since File Shares isn't natively supported!...
- 0 kudos
- 6523 Views
- 4 replies
- 3 kudos
Databricks Apps Deployment with React codebase
Hi,Need help to understand how we can deploy frontend(React) codebase via Databricks Apps as I am tried all templates and Custom App creation. It seems only Python based codebase can be deployed.Let me know if anyone can help me with approach or fesi...
- 6523 Views
- 4 replies
- 3 kudos
- 3 kudos
Here is some new documentation for using node.js with Databricks apps.
- 3 kudos
- 3080 Views
- 1 replies
- 0 kudos
Integrate Genie to teams
Hey, I'm trying to integrate Genie into Teams. I am Admin and have all rights. created a Genie to test. We are encountering an PermissionDeniederror while interacting with Genie API via SDK and workspace token.Details:Workspace URL: https://dbc-125a3...
- 3080 Views
- 1 replies
- 0 kudos
- 0 kudos
Check this repo - TeamsGenieIntegration
- 0 kudos
