How to identify the list jobs are using interactive cluster ?
@rdkarthikeyan27 you can try to use list jobs api and try to filter based on jobs and type of cluster
Learned on optimization my workflows With amazing tool and fast development for the team members
@Arpangrwl are you talking about workflows part of databricks or any tool has been recently introduced, can you shed some light on that please
Basically I want to use Unity Catalog alone ( without integration with purview or other tools ) as data catalog to democratize data for all data workers.Is it possible to setup access to unity catalog the way, anybody can search / browse metadata in ...
@Palkers if i understood your question correctly you are looking to view all catalogs data, to view or browse complete metadata you should be admin of your metastore. at least you need to have select and use_catatlog on required catalogs that you wan...
When the data sharing is enabled using delta sharing across different cloud platforms, how should the architecture be setup to create private connection between the databricks workspace to securely share the data.#deltasharing #summit #multicloud #Da...
@yuvapraveen_k adding to @bikash84 delta sharing itself is secured, when you are sharing data between workspaces, you be only allowing users whom you provided access based on acceptor users that you added. if you want to share out side to databricks ...
My team has just started to use Databricks and this is my first time attending DAIS! The Databricks platform has so many features and opportunities, my team is ecstatic to start diving in! The community here has been amazing. Really excited to learn ...
Very interesting to learn the other LLMs can validate each other better then humans.
The Summit Quests makes the conference very engaging and I hope databricks keeps running it
The Lakehouse AI is cool to automate SQL work.
I would like to know about best practices when finetuning a transformer model and most common problems during the process
Happy to see that Databricks makes their Data Clean Room slowly publicly available. Looking forward to more updates.
So many announcement today:LakehouseIQLakehouse FederationDelta Lake 3.0 - Unify in top of Iceberg, Huidi & DeltaVector SearchUnity Catalog for AILakehouse Monitoring & ObservabilityLakehouse AppDatabricks Marketplace GAwhich one are u the most exist...
Very excited about Lakehouse Monitoring, it’s exactly what we need for data quality.
Amazing sessions for last 2 days and learning lots of new things
Hello everyone
At my first conference and it's amazing to see the possibilities to grow our business and truly stand apart as a data first company!
