Join the Databricks Learning Festival (Virtual)! Mark your calendars from 10 October - 31 October 2024! Upskill today across data engineering, data analysis, machine learning, and generative AI. Join the thousands who have elevated their career w...
- 53645 Views
- 214 replies
- 44 kudos
a month ago
Thursday, 24 October 2024, 16:00 - 18:30 Slalom Consulting - 545 NW 26th St #300, Miami, FL 33127 Join us as the South Florida Databricks User Group debuts with an in-person event hosted at Slalom Consulting in Miami. We've planned an explora...
- 47 Views
- 0 replies
- 0 kudos
yesterday
Databricks Apps, a new way to build and deploy internal data and AI applications, is now available in Public Preview on AWS and Azure. Ideal use cases include data visualization, AI applications, self-service analytics, and data quality monitoring.It...
- 12462 Views
- 0 replies
- 4 kudos
a week ago
What if anyone in your organization could get insights from their data using just natural language? What if you didn’t have to manage a BI system separate from your data platform?Databricks is working to make your job easier by delivering these and o...
- 11500 Views
- 0 replies
- 1 kudos
Thursday
Meet Szymon Dybczak, a valued member of our community! Szymon is a Senior Data Engineer at Nordcloud. He brings a wealth of knowledge and expertise to the group, and we're thrilled to have him here. We presented him with a range of questions, and be...
- 13288 Views
- 11 replies
- 9 kudos
2 weeks ago
Don't Miss Out on "Making AI-Powered Data Engineering Practical"! Join us for this exciting virtual event where we’ll cut through the hype and explore how AI-powered data intelligence is transforming data engineering. AMER: Nov 4 / 10 AM PT EMEA: ...
- 5680 Views
- 2 replies
- 3 kudos
4 weeks ago
Shifting to customized GenAI that deeply understands your data AMER October 8 / 10 AM PTEMEA October 9 / 9 AM BST / 10 AM CESTAPJ October 10 / 12 PM SGT Click here to check out the agenda and speakers and register now! Why are 9 out of 10 organiz...
- 4819 Views
- 2 replies
- 2 kudos
a month ago
Get practical guidance, notebooks, code snippets You know this better than anyone: the best GenAI models in the world will not succeed without good data. That’s why data engineers are even more critical today. The challenge is staying ahead of the ra...
- 13297 Views
- 0 replies
- 3 kudos
a month ago
Community Activity
- 17 Views
- 0 replies
- 0 kudos
DBFS FILE BROWSER BUTTON
Hello, I can not see the filestore when I open the ' catalog' tab and when I want to activate the ' dbfs file browser', the option to enable it in 'settings/Advanced' does not appear. How could I do it so I can have the Filestore active in my Databri...
- 17 Views
- 0 replies
- 0 kudos
- 157 Views
- 2 replies
- 0 kudos
Could not access databricks on iphone any webbrowser
Hi around passed 2 weeks, I tried to access databricks via my ios(17.6) safari and chrome.both web browser could not access.I tried to clear cache and login with Global Administrator in Azure AD before already it same still blank page.could you pleas...
- 157 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Noimeta,I still could not fix this issue, may be I still don't update my ios to latest version.Do you update ios to latest version and reset all setting?
- 0 kudos
- 28 Views
- 0 replies
- 0 kudos
Serving Endpoint Deployment
Hello Community,I am seeking assistance with an issue related to serving a custom Hugging Face model (M2M100). I successfully registered the model in Unity Catalog using the MLflow Python libraries without any problems. However, when attempting to se...
- 28 Views
- 0 replies
- 0 kudos
- 45 Views
- 2 replies
- 2 kudos
Resolved! Databricks Asset Bundles + Artifacts + Poetry
Hello,I've configured the DABs on our project successfully. Moreover, I could switch from setuptools to poetry almost successfully. In the project's databricks.yml I configured it as the documentation suggested, I've just changed the name of the arti...
- 45 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @Fiabane ,Could you first check:Do you see your .whl file in your artifacts folder?Could you try to install the package by running the code in your notebook : %pip install <path to your wheel>As far as I understand you want to have a job ...
- 2 kudos
- 420 Views
- 7 replies
- 6 kudos
Suddenly can't find the option to uplaod files into Databricks Community Edition
Hi everyone,I am suddenly unable to find the option to upload my files into Databricks Community Edition today. Please find the same in the screenshot attached. Is anyone else also facing this issue?
- 420 Views
- 7 replies
- 6 kudos
Latest Reply
- 6 kudos
Perfect time for this to happen -- right in the middle of a class assignment due in a few days. The easiest way to do it is by using dbutils.fs.mv to mv the file from the local system to the dbfs. Here is a complete example:## create file in the loc...
- 6 kudos
- 15 Views
- 1 replies
- 0 kudos
What Would You Like to Hear at a Future Meetup?
If we were to organize a meetup, what topics would interest you the most? Are there any speakers you'd love to hear from? Let us know what you'd want to see at a future meetup, so we can plan something exciting and valuable for the community! Share y...
- 15 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Since I'm new to Databricks, I’d like to know how to get started in a cost-effective way. While I have some basic knowledge, I want to become proficient, but I'm unsure where to begin. The resources I've found so far haven't been helpful. A 1:1 knowl...
- 0 kudos
- 49 Views
- 1 replies
- 0 kudos
DLT x UC x Auto Loader
Now that the Directory Listing Mode of Auto Loader is officially deprecated, is there a solution for using File Notification Mode in a DLT pipeline writing to a UC-managed table? My understanding is that File Notification Mode is only available on si...
- 49 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
I am having the same concern and am reaching out to our Solutions Architect to better understand how AutoLoader &DLT can be used. DLT and AutoLoader should go hand in hand especially when using file notification mode.
- 0 kudos
- 17 Views
- 0 replies
- 0 kudos
Not able to create table using upload file option
I was trying to create table using a CSV file in community addition. I am not able to find any option to do that on the portal.
- 17 Views
- 0 replies
- 0 kudos
- 21 Views
- 0 replies
- 0 kudos
Databricks community edition browse data to create New Table not available
Hi,From today (17-10-24), I can't seems to browse data to create New Table. Is there any change? If so how to import data on the community edition to run pySpark cluster. Please let me know as I run academic classes using this tool.Thank you Sandra
- 21 Views
- 0 replies
- 0 kudos
- 43 Views
- 1 replies
- 0 kudos
Resolved! Finger- loan- app-cusTomer-care-helpline–number +91)7624821974_/76248-21974-:me nj
Finger- loan- app-cusTomer-care-helpline–number +91)7624821974_/76248-21974-:meFinger- loan- app-cusTomer-care-helpline–number +91)7624821974_/76248-21974-:me jj
- 43 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Akshay kumar and friends with a new one that has happened
- 0 kudos
- 17 Views
- 0 replies
- 0 kudos
EXECUTE IMMEDIATE works with JDBC connection ???
Hello, i need help I am trying to use the EXECUTE IMMEDIATE command to perform DELETE or DROP operations on a table located on a remote SQL server (on-premises) using a JDBC connection from a notebook in the Databricks environment.While I can succes...
- 17 Views
- 0 replies
- 0 kudos
- 29 Views
- 0 replies
- 0 kudos
Access Databricks Table with Simple Python3 Script
Hi, I'm super new to Databricks. I'm trying to do a little API scripting against my company's DB instance.I have this supersimple python (ver 3) which is meant to run a remote host. The script tries to a simple SQL query against my Databricks instan...
- 29 Views
- 0 replies
- 0 kudos
- 49 Views
- 3 replies
- 2 kudos
I want to consolidate the delta tables historical versions and write to another table in append mode
Hi Team, I have a table let's say, employee and it has 5 versions .version 0 and 1 has column A, column B, from version 2 column A has been changed to column C and column B to column D. I want to ingest version by version without manual intervention....
- 49 Views
- 3 replies
- 2 kudos
- 13 Views
- 0 replies
- 0 kudos
Generative AI - Certificate and Badge not received
Hi,I'm experiencing issues regarding the Badge Accreditation after the completion of both the course and the quiz contained in the learning plan.Moreover, I have attended the learning plan with my Partner Account, and I have already submitted a Ticke...
- 13 Views
- 0 replies
- 0 kudos
- 4258 Views
- 3 replies
- 0 kudos
How to run a saved query from a Notebook (PySpark)
Hi Team! Noob to Databricks, so apologies if I ask a dumb question.I have created a relatively large series of queries that fetch and organize the data I want. I'm ready to drive all of these from a Notebook (likely PySpark).An example query is save...
- 4258 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
You can do something like this using databricks-sdk: Here's the saved query Pyspark code: import re from pyspark.sql import DataFrame from databricks.sdk import WorkspaceClient def run_saved_query(query_id:str, **params) -> DataFrame: query_bo...
- 0 kudos
Latest from our Blog
💡 ML Training Tip Of The Week #2 - Custom Dataset Split in AutoML
When launching an AutoML experiment on Databricks, the default run splits the dataset randomly with 60% for training, 20% for validation, and 20% for testing. Starting from ML Runtime 15.3, users can ...
How not to build an AI/BI Demo
Firstly. Don’t make a demo and then release it under its old name Lakeview, 6 weeks before the name changes to AI/BI, because now no one in the future knows what you're on about. Secondly, I spoke a...
Top 5 Tips to Build Delta Live Tables (DLT) Pipelines Optimally
Imagine a world where building complex data pipelines is as simple as describing what you want rather than meticulously coding how to do it. This is one of the key propositions that Delta Live Tables ...
Optimising Data Integration and Serving patterns with Cosmos DB and Azure Databricks
Introduction In today's data-driven world, organisations aconstantly seekways to optimise their data integration and serving patterns. This blog post delves into the powerful combination of Azure Cosm...
