I have learned about unit catalog and databricks and how it works as an end point for other applications
When I try to run a simple limit number of rows in Spark using a pushdown query, I receive an error back from spark with a where clause of 1= 0. Meaning it won't return the results and the original sql query was appended by spark.This seems very od...
This year many technologies and the evolution of others have been presented, among which Unity Catalog stands out as an amazing tool to catalogue, classify, unify and create your semantic layers of data from any data source... I hope it continues to ...
The whole fair was very interesting. is renewed every year
So excited about LakehouseIQ, can't wait to see what else Databricks puts out next!
Today at 11:30 at the moscone center, room 155, you will find a deep dive into the unity catalog! Dont miss it!
Databricks has built an impressive platform to allow data engineers access AI more easily and be more productive. Very excited by Lakehouse IQ and the impact that will have on teams productivity. I can’t wait to see what innovations Databricks is goi...
I’m excited to be here! I just took the advanced data engineering course and realized I have a lot to learn!
How to identify the list jobs are using interactive cluster ?
@rdkarthikeyan27 you can try to use list jobs api and try to filter based on jobs and type of cluster
Learned on optimization my workflows With amazing tool and fast development for the team members
@Arpangrwl are you talking about workflows part of databricks or any tool has been recently introduced, can you shed some light on that please
Basically I want to use Unity Catalog alone ( without integration with purview or other tools ) as data catalog to democratize data for all data workers.Is it possible to setup access to unity catalog the way, anybody can search / browse metadata in ...
@Palkers if i understood your question correctly you are looking to view all catalogs data, to view or browse complete metadata you should be admin of your metastore. at least you need to have select and use_catatlog on required catalogs that you wan...
When the data sharing is enabled using delta sharing across different cloud platforms, how should the architecture be setup to create private connection between the databricks workspace to securely share the data.#deltasharing #summit #multicloud #Da...
@yuvapraveen_k adding to @bikash84 delta sharing itself is secured, when you are sharing data between workspaces, you be only allowing users whom you provided access based on acceptor users that you added. if you want to share out side to databricks ...
My team has just started to use Databricks and this is my first time attending DAIS! The Databricks platform has so many features and opportunities, my team is ecstatic to start diving in! The community here has been amazing. Really excited to learn ...
Very interesting to learn the other LLMs can validate each other better then humans.
The Summit Quests makes the conference very engaging and I hope databricks keeps running it
