cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
Next-Level Interactivity in AI/BI Dashboards

As recently announced at this year’s Data and AI Summit, Databricks AI/BI democratizes business intelligence and analytics across your organization with highly visual and interactive low-code AI/BI Dashboards and no-code conversational analytics powe...

  • 453 Views
  • 0 replies
  • 2 kudos
Tuesday
Announcing advanced security and governance in Mosaic AI Gateway

We are excited to introduce several powerful new capabilities to Mosaic AI Gateway, designed to help our customers accelerate their AI initiatives with even greater simplicity, security, and governance. Read more here

  • 214 Views
  • 1 replies
  • 3 kudos
Tuesday
Submit your feedback and win a $25 gift card!

Your feedback is crucial to us and directly influences how we innovate and improve our customer experience.  To share your success and feedback with Databricks, please  visit this link.  The first 20 people to submit a completed survey response will ...

  • 608 Views
  • 0 replies
  • 1 kudos
2 weeks ago
Databricks Unity Catalog Workshop

Thursday, September 12, 2024 | 9:00 AM-10:35 AM PT Effective governance is essential to democratizing data and AI in the age of LLMs and generative AI. Enterprises face challenges with fragmented governance across databases, warehouses, and lakes, c...

  • 2499 Views
  • 1 replies
  • 3 kudos
4 weeks ago
Data + AI World Tour 2024

Over 12,000 companies have adopted data intelligence. Join a tour stop near you to discover how Databricks can unlock your data and AI too. Find your city now!  Explore technologies Explore the latest advancements in the Databricks Data Intellige...

  • 3046 Views
  • 0 replies
  • 5 kudos
07-23-2024

Community Activity

Ajay-Pandey
by > Esteemed Contributor III
  • 414 Views
  • 1 replies
  • 3 kudos

Onboarding your new Databricks AI/BI Genie

The integration of AI and BI into the modern data stack has been a game-changer for businesses seeking to leverage data-driven insights. Databricks, a leader in this innovative frontier, has introduced the AI/BI Genie, a tool designed to democratize ...

Knowledge Sharing Hub
AI
assistance
bi
data engineering
Databricks
  • 414 Views
  • 1 replies
  • 3 kudos
Latest Reply
Anushree_Tatode
  • 3 kudos

Hi,The AI/BI Genie is a fantastic innovation! By enabling natural language queries and learning from user interactions, it makes data analytics more accessible and insightful. It’s a powerful tool for businesses looking to enhance their data-driven d...

  • 3 kudos
Kushal12345
by > New Contributor III
  • 13631 Views
  • 25 replies
  • 2 kudos

Resolved! DataBricks Certification Exam Got Suspended. Require support for the same.

Hello Team, I encountered Pathetic experience while attempting my 1st DataBricks certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam, saying I have exceeded ...

  • 13631 Views
  • 25 replies
  • 2 kudos
Latest Reply
divya_p
Visitor
  • 2 kudos

Hi Team,I had a very weird and pathetic experience while taking the Databricks Associate Exam . I wasn't even moving my eyes and was sincerely giving the exam . While i was about to submit the exam a pop up came and mentioned to show me all the walls...

  • 2 kudos
24 More Replies
MichTalebzadeh
by > Valued Contributor
  • 443 Views
  • 1 replies
  • 0 kudos

Feature Engineering for Data Engineers: Building Blocks for ML Success

For a  UK Government Agency, I made a Comprehensive presentation titled " Feature Engineering for Data Engineers: Building Blocks for ML Success".  I made an article of it in Linkedlin together with the relevant GitHub code. In summary the code delve...

Knowledge Sharing Hub
feature engineering
ML
python
  • 443 Views
  • 1 replies
  • 0 kudos
Latest Reply
Anushree_Tatode
  • 0 kudos

Hi,Excellent presentation and article! Your insights on feature engineering and practical code examples are incredibly useful for building strong ML models. Thanks for sharing! Thanks,Anushree    

  • 0 kudos
Rishabh-Pandey
by > Esteemed Contributor
  • 2402 Views
  • 1 replies
  • 1 kudos

Databricks on Databricks: Kicking off the Journey to Governance with Unity Catalog

In the world of data engineering and analytics, governance is paramount. Databricks has taken a significant step forward in this arena with the introduction of Unity Catalog, a unified governance solution for all data and AI assets. This journey to e...

  • 2402 Views
  • 1 replies
  • 1 kudos
Latest Reply
Anushree_Tatode
  • 1 kudos

Hi Rishabh ,Unity Catalog is a major advancement in data governance, enhancing how we manage and secure data and AI assets in Databricks. Exciting to see these improvements!Thanks,Anushree 

  • 1 kudos
Nishat
by > New Contributor
  • 159 Views
  • 1 replies
  • 0 kudos

Unity Catalog

Can MLflow Experiments be incorporated into Unity Catalog (may be in volume or somewhere in unity catalog) similar to models and feature tables?

  • 159 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Honored Contributor
  • 0 kudos

As of now Databricks supports DBFS, S3, and Azure Blob storage artifact locations. Our teams are working on intruducing Volumes as repository which might be coming soon 

  • 0 kudos
Jaku6
by > New Contributor
  • 304 Views
  • 1 replies
  • 1 kudos

Run now with different parameters doesn't pass parameter to pipeline tasks

I have a job with some tasks. Some of the tasks are pipeline_task's some are notebook_task's.When I run the job with "Run now with different parameters" and enter a new key-value, I see that the key-value is available in the notebook_task's with dbut...

  • 304 Views
  • 1 replies
  • 1 kudos
Latest Reply
Walter_C
Honored Contributor
  • 1 kudos

As per docs it seems that pipeline task type is currently not supported to pass parameters: https://docs.databricks.com/en/jobs/create-run-jobs.html#pass-parameters-to-a-databricks-job-taskYou could create a notebook task that runs before your pipeli...

  • 1 kudos
data-digger
by > New Contributor
  • 128 Views
  • 0 replies
  • 0 kudos

Hide function defination

Hi - I would like to hide function definition from user, what is the best way to do it in unity catalog

  • 128 Views
  • 0 replies
  • 0 kudos
eric-c
by > New Contributor
  • 207 Views
  • 1 replies
  • 0 kudos

Alert ACL's not available

The list of available ACL's for alerts suggests there's a way to set "can run" and "can manage" permissions but neither the REST API nor the Databricks CLI show options for setting permissions. Is there a way to set acl's on alerts? If so, how?Alert ...

  • 207 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Honored Contributor
  • 0 kudos

The API call needed to set the ACLs for an alert and other object types as (alerts | dashboards | data_sources | queries) is:https://docs.databricks.com/api/workspace/dbsqlpermissions/set

  • 0 kudos
cadull
by > New Contributor II
  • 100 Views
  • 1 replies
  • 1 kudos

Permission Issue with IDENTIFIER clause

Hi all,we are parameterizing environment specific catalog names (like `mycatalog_dev` vs. `mycatalog_prd`) in Lakeview dashboard queries like this:SELECT * FROM IDENTIFIER(:catalog_name || '.myschema.mytable')Which works fine in most cases. We have o...

  • 100 Views
  • 1 replies
  • 1 kudos
Latest Reply
madams
New Contributor
  • 1 kudos

I've had quite a bit of fun with UC and view permissions.  I don't think this is specific to using the IDENTIFIER() function, but I suspect it's related to UC permissions.  What you'll need to ensure:The user or group who owns the view on catalog_b h...

  • 1 kudos
tdk
by > New Contributor
  • 92 Views
  • 1 replies
  • 0 kudos

Cannot install jar to cluster: invalid authority.

Hi allI want to access on-prem Oracle Database data from the python notebooks. However, the install of the jar (ojdbc8.jar) results in an error, which occurs while the cluster is starting up.The error message:"Library installation attempted on the dr...

  • 92 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Honored Contributor
  • 0 kudos

The error message suggests that the jar file located at abfss:/jars/ojdbc8.jar has an invalid authority. This could be due to a number of reasons such as incorrect file path, insufficient permissions, or network restrictions. Here are a few steps you...

  • 0 kudos
semsim
by > Contributor
  • 48 Views
  • 0 replies
  • 0 kudos

Can't query Legacy Serving Endpoint

Hi,I was able to deploy an endpoint using legacy serving (It's the only option we have to deploy endpoints in DB). Now I am having trouble querying the endpoint itself. When I try to query it I get the following error:    Here is the code I am using ...

semsim_0-1726245119742.png
  • 48 Views
  • 0 replies
  • 0 kudos
FedericoRaimond
by > New Contributor
  • 330 Views
  • 7 replies
  • 2 kudos

Azure Databricks Workflows with Git Integration

Hello,I receive a very weird error when attempting to connect my workflows tasks to a remote git on azure devops.As per documentation: "For a Git repository, the path relative to the repository root."Then, I use directly the name of the notebook file...

  • 330 Views
  • 7 replies
  • 2 kudos
Latest Reply
madams
New Contributor
  • 2 kudos

Ah, I have had that same error before when cloning from git.  I'm guessing you got the Repo URL by hitting the "clone" button in ADO and copy/pasting it in to Databricks.  One thing I've done in the past is in the Repository URL, remove the "org@" pa...

  • 2 kudos
6 More Replies
DatabricksGuide
by Community Manager
  • 3689 Views
  • 1 replies
  • 2 kudos

Getting Started with Databricks - Build a simple Lakehouse analytics pipeline

Getting started with Databricks - Build a simple Lakehouse analytics pipeline The demo example in this guide illustrates a lakehouse analytics pipeline using the well-known NYC taxi trip dataset. This public dataset is also available at Kaggle.  This...

DatabricksGuide_0-1723742834161.png DatabricksGuide_1-1723742833943.png DatabricksGuide_2-1723742833913.png
  • 3689 Views
  • 1 replies
  • 2 kudos
Latest Reply
DBQUEST
New Contributor
  • 2 kudos

"Excellent exercise! The most challenging part was setting up the environment using the Azure free account. However, now that I have access to all the functionalities, I am well-equipped to continue training and building my skills with Databricks. Lo...

  • 2 kudos
Visakh_Vijayan
by > New Contributor
  • 120 Views
  • 3 replies
  • 0 kudos

Uninstall whl file from databricks cluster via CLI

Hello, we have a need to uninstall older versions of whl files from personal cluster via databricks CLI - could you please provide the exact command to be used here. We tried with many found on the documentations but none of them worked to do the act...

  • 120 Views
  • 3 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Contributor
  • 0 kudos

Hi @Visakh_Vijayan ,Did you try to use databricks libraries uninstall? It's exactly crafted for this purposedatabricks libraries uninstall --json YOUR_JSON_WITH_REQUEST_BODYAlso, when you uninstall a library from a cluster, the library is removed onl...

  • 0 kudos
2 More Replies
ishmaelamin
by > New Contributor
  • 97 Views
  • 1 replies
  • 0 kudos

Databricks Academy Labs Subscription (Partners)

Is the subscription to the "Databricks Academy Labs Subscription (Partners)" useful, given that I have access to the Databricks platform through Visual Studio? Does the ecosystem perform better for the lab samples.  I ask this question because when I...

  • 97 Views
  • 1 replies
  • 0 kudos
Latest Reply
ishmaelamin
New Contributor
  • 0 kudos

...

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors

Latest from our Blog

MLOps Gym - Version control best practices

In the first part of this article, we explored the critical role that version control plays in data science, particularly when using Git within the Databricks environment. We covered the foundational ...

6Views 0kudos

6 Migration Mistakes You Don’t Want To Make: Part 2

Welcome to Part 2 of this series. If you haven’t read Part 1, we recommend you start there. To recap so far: Between us, we have worked on over 30 customer migrations leading us to develop this list o...

75Views 0kudos

GenAI is for Data Engineers Too

Large Language Models (LLMs) or GenAI have taken center stage in their ability to summarize large text, write code, articles, poems, explain complex topics, and power now ubiquitous chatbots. Data Eng...

590Views 1kudos

6 Migration Mistakes You Don’t Want To Make: Part 1

Congratulations! Your team has just signed a contract with Databricks and you’re ready to start your first project.  Maybe.  Statistically, most of you will need to migrate off your previous platform ...

2048Views 4kudos