cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
Next-Level Interactivity in AI/BI Dashboards

As recently announced at this year’s Data and AI Summit, Databricks AI/BI democratizes business intelligence and analytics across your organization with highly visual and interactive low-code AI/BI Dashboards and no-code conversational analytics powe...

  • 7 Views
  • 0 replies
  • 0 kudos
32m ago
Announcing advanced security and governance in Mosaic AI Gateway

We are excited to introduce several powerful new capabilities to Mosaic AI Gateway, designed to help our customers accelerate their AI initiatives with even greater simplicity, security, and governance. Read more here

  • 10 Views
  • 0 replies
  • 0 kudos
40m ago
Submit your feedback and win a $25 gift card!

Your feedback is crucial to us and directly influences how we innovate and improve our customer experience.  To share your success and feedback with Databricks, please  visit this link.  The first 20 people to submit a completed survey response will ...

  • 397 Views
  • 0 replies
  • 0 kudos
Wednesday
Databricks Unity Catalog Workshop

Thursday, September 12, 2024 | 9:00 AM-10:35 AM PT Effective governance is essential to democratizing data and AI in the age of LLMs and generative AI. Enterprises face challenges with fragmented governance across databases, warehouses, and lakes, c...

  • 1376 Views
  • 1 replies
  • 2 kudos
3 weeks ago
Data + AI World Tour 2024

Over 12,000 companies have adopted data intelligence. Join a tour stop near you to discover how Databricks can unlock your data and AI too. Find your city now!  Explore technologies Explore the latest advancements in the Databricks Data Intellige...

  • 2245 Views
  • 0 replies
  • 4 kudos
07-23-2024

Community Activity

Sujitha
by Community Manager
  • 7 Views
  • 0 replies
  • 0 kudos

Next-Level Interactivity in AI/BI Dashboards

As recently announced at this year’s Data and AI Summit, Databricks AI/BI democratizes business intelligence and analytics across your organization with highly visual and interactive low-code AI/BI Dashboards and no-code conversational analytics powe...

Screenshot 2024-09-10 at 6.58.31 PM.png
  • 7 Views
  • 0 replies
  • 0 kudos
YannLevavasseur
by > New Contributor
  • 1312 Views
  • 2 replies
  • 0 kudos

SQL function refactoring into Databricks environment

Hello all,I'm currently working on importing  some SQL functions from Informix Database into Databricks using Asset Bundle deploying Delta Live Table to Unity Catalog. I'm struggling importing a recursive one, there is the code :CREATE FUNCTION "info...

YannLevavasseur_0-1713952085696.png YannLevavasseur_1-1713952236903.png
  • 1312 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @YannLevavasseur, It looks like you’re dealing with a recursive SQL function for calculating the weight of articles in a Databricks environment. Handling recursion in SQL can be tricky, especially when translating existing Informix code to Data...

  • 0 kudos
1 More Replies
abueno
by > New Contributor III
  • 41 Views
  • 2 replies
  • 0 kudos

Resolved! exclude (not like) filter using pyspark

I am trying to exclude rows with a specific variable when querying using pyspark but the filter is not working.  Similar to the "Not like" function in SQL.  e.g. not like '%var4%'.  The part of the code that is not working is: (col('col4').rlike('var...

  • 41 Views
  • 2 replies
  • 0 kudos
Latest Reply
abueno
New Contributor III
  • 0 kudos

Worked perfectly Thank you. 

  • 0 kudos
1 More Replies
MKSodhi
by > New Contributor
  • 29 Views
  • 2 replies
  • 2 kudos

Resolved! Looking for Databricks Study Materials/Resources

Hello,I’m looking for study materials or resources to help me learn Databricks more effectively. Any recommendations would be greatly appreciated!

  • 29 Views
  • 2 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Contributor
  • 2 kudos

Hi @MKSodhi , If you're new to apache spark I would start with following book. You can get it for free from databricks site:https://pages.databricks.com/202003-US-EB-Learning-Spark-2nd-Edition_01_Downloadpage.htmlNext, you can setup account on databr...

  • 2 kudos
1 More Replies
ctiwari7
by > Visitor
  • 23 Views
  • 1 replies
  • 0 kudos

get job run link based on the job name or the submit body

This is the current code(ignore indentations) that I am using which takes the list of all the running jobs and then filters from the list to get the run id of the matching job name. I want to know if there is any better way to optimise this. Legacy d...

  • 23 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Contributor
  • 0 kudos

Hi @ctiwari7 ,I don't know if this is a better approach, because it's a very subjective matter, but you can try to use 2 alternative approaches:1. system tables - >  Jobs system table reference | Databricks on AWS 2.  REST API calls to first:     - g...

  • 0 kudos
tingwei
by > New Contributor
  • 737 Views
  • 3 replies
  • 5 kudos

ISOLATION_STARTUP_FAILURE

Hi I'm getting error in my data pipeline[ISOLATION_STARTUP_FAILURE] Failed to start isolated execution environment. Please contact Databricks support. SQLSTATE: XXKSSit was working fine and suddenly it is keep failing. Please advice. 

  • 737 Views
  • 3 replies
  • 5 kudos
Latest Reply
PaoloSwiss
Visitor
  • 5 kudos

This solution also worked for me

  • 5 kudos
2 More Replies
J_Anderson
by New Contributor III
  • 33 Views
  • 0 replies
  • 1 kudos

FAQ for Databricks Learning Festival (Virtual): 10 October - 31 October 2024

General Q: Where can I ask questions, if I have questions while going through the self-paced material? A: Databricks Academy Learners Group page is the forum within Databricks Community, where you can ask questions and get them answered by your fello...

  • 33 Views
  • 0 replies
  • 1 kudos
hitalo
by > New Contributor
  • 2740 Views
  • 2 replies
  • 0 kudos

Partner Discount

Hi there are there some discount to partner on exams nowadays?

  • 2740 Views
  • 2 replies
  • 0 kudos
Latest Reply
igor779
New Contributor II
  • 0 kudos

If your company is a partner, you can request a 50% voucher for Databricks support or wait for a certification event, like the one that took place in July.https://www.databricks.com/learn/partners/partner-technical-learning-paths-certifications

  • 0 kudos
1 More Replies
dbrixr
by > New Contributor II
  • 185 Views
  • 2 replies
  • 0 kudos

Reverse colors in dark mode

It seems that Databricks implements its dark mode by applying the invert filter so that all colors are reversed. This is problematic if one wants to create some sort of html widget or rich output since this filter is passed down to the result of disp...

  • 185 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anushree_Tatode
  • 0 kudos

Hi @dbrixr  he issue you're facing with DBR 14.3 ML may be due to conflicts arising from concurrent data writes while reading. To address this, consider implementing the following: Use Delta Lake: Convert your Parquet files to Delta Lake tables to ha...

  • 0 kudos
1 More Replies
mortenhaga2
by > New Contributor III
  • 319 Views
  • 6 replies
  • 2 kudos

Resolved! Genie: Cant upvote/downvote, cant edit queries nor view other results

Hi allI have been trying to get some feedback on this before, but since this is important to if and how my organization is going to adopt this tool, I need some help on this:For me as an account admin and workspace admin, my problem is that I cant up...

mortenhaga2_0-1725264270178.png mortenhaga2_1-1725264435843.png mortenhaga2_3-1725264479589.png
  • 319 Views
  • 6 replies
  • 2 kudos
Latest Reply
holly
Valued Contributor III
  • 2 kudos

Hi Morten, I think I understand what you're asking: As an admin, You want to view other peoples responses and rate them thumbs up or thumbs down. Unfortunately this is not something that can be done right now, but here are some alternatives: Ask the ...

  • 2 kudos
5 More Replies
RobsonNLPT
by > Contributor
  • 9846 Views
  • 3 replies
  • 1 kudos

Permissions on Unity Catalog Table Constraints

Hi all.I've used new options to add constraints to UC tablesEven granting permissions to an user (ALL PRIVILEGES) on particular schema we have errors when trying to add PKs. The message doesn't make sense (PERMISSION_DENIED: User is not an owner of T...

  • 9846 Views
  • 3 replies
  • 1 kudos
Latest Reply
dmart
New Contributor III
  • 1 kudos

So how does one grant these permissions to non-owners?

  • 1 kudos
2 More Replies
EricMa
by > New Contributor III
  • 1418 Views
  • 15 replies
  • 2 kudos

Mounting Data IOException

Hello,I am currently taking a course from Coursera for data science using SQL. For one of our assignments we need to mount some data by running a script that has been provided to us by the class. When I run the script I receive the following error. I...

IOException.jpg IOException_Classroom-Setup.jpg
  • 1418 Views
  • 15 replies
  • 2 kudos
Latest Reply
smdatainsights
New Contributor II
  • 2 kudos

Any updates on this? I'm experiencing the same issue.

  • 2 kudos
14 More Replies
Angus-Dawson
by > New Contributor II
  • 543 Views
  • 5 replies
  • 1 kudos

PARSE_EMPTY_STATEMENT error when trying to use spark.sql via Databricks Connect

I'm trying to use Databricks Connect to run queries on Delta Tables locally. However, SQL queries using spark.sql don't seem to work properly, even though spark.read.table works.>>> from databricks.connect import DatabricksSession>>> spark = Databric...

  • 543 Views
  • 5 replies
  • 1 kudos
Latest Reply
alex_khakhlyuk
New Contributor II
  • 1 kudos

Hi everyone! I am an engineer working on Databricks Connect. This error appears because of the incompatibility between the Serverless Compute and Databricks Connect versions. The current Serverless Compute release roughly corresponds to Databricks Ru...

  • 1 kudos
4 More Replies
xwen
by > Visitor
  • 31 Views
  • 0 replies
  • 0 kudos

how to modify data type of a column explicitly via DBSQL

is there a SQL equivalent of overwriteSchema ?https://docs.databricks.com/en/delta/update-schema.html#explicitly-update-schema-to-change-column-type-or-name

  • 31 Views
  • 0 replies
  • 0 kudos
-werners-
by > Esteemed Contributor III
  • 1945 Views
  • 3 replies
  • 0 kudos

performance issues using shared compute access mode in scala

I created on our dev environment a cluster using the shared access mode, for our devs to use (instead of separate single user clusters).What I notice is that the performance of this cluster is terrible.  And I mean really terrible: notebook cells wit...

  • 1945 Views
  • 3 replies
  • 0 kudos
Latest Reply
prakharcode
  • 0 kudos

I can confirm this behaviour. To run the same job on shared cluster in "USER_ISOLATION" mode with nothing changes between the job definition or source data, the performance drop is significant. So much so that there needs to be a radical change in ho...

  • 0 kudos
2 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors

Latest from our Blog

6 Migration Mistakes You Don’t Want To Make: Part 1

Congratulations! Your team has just signed a contract with Databricks and you’re ready to start your first project.  Maybe.  Statistically, most of you will need to migrate off your previous platform ...

878Views 2kudos

Data Validation: The Last Mile of Migration

Introduction Enterprise Data Warehouse (EDW) Migration use cases are always complex in nature. Data architects and Data engineers spend the majority of time in analyzing the source data, identifying t...

374Views 3kudos

MLOps Gym - Getting started with version control

In the halcyon days of data science’s youth, version control was an oft-overlooked aspect of the work of data science teams, a “nice-to-have” that was perhaps the domain of hobbyists and enthusiasts. ...

301Views 1kudos