Databricks has built an impressive platform to allow data engineers access AI more easily and be more productive. Very excited by Lakehouse IQ and the impact that will have on teams productivity. I can’t wait to see what innovations Databricks is goi...
This is my first tech conference and I’ve been blown away by the experience, and seeing all the technology in action has been really inspiring.
Enjoying all the learning at the Summit!
Great opportunity to learn what's coming next and meet your data engineering counterparts from multiple industries,
I’m excited to be here! I just took the advanced data engineering course and realized I have a lot to learn!
Attending the Data and AI 2023 Summit. I gave a talk on Jet Streaming Data and Predictive analytics on Tuesday at 2pm. Check out the recorded session when it is available June 30th.
How to identify the list jobs are using interactive cluster ?
@rdkarthikeyan27 you can try to use list jobs api and try to filter based on jobs and type of cluster
Learned on optimization my workflows With amazing tool and fast development for the team members
@Arpangrwl are you talking about workflows part of databricks or any tool has been recently introduced, can you shed some light on that please
Basically I want to use Unity Catalog alone ( without integration with purview or other tools ) as data catalog to democratize data for all data workers.Is it possible to setup access to unity catalog the way, anybody can search / browse metadata in ...
@Palkers if i understood your question correctly you are looking to view all catalogs data, to view or browse complete metadata you should be admin of your metastore. at least you need to have select and use_catatlog on required catalogs that you wan...
When the data sharing is enabled using delta sharing across different cloud platforms, how should the architecture be setup to create private connection between the databricks workspace to securely share the data.#deltasharing #summit #multicloud #Da...
@yuvapraveen_k adding to @bikash84 delta sharing itself is secured, when you are sharing data between workspaces, you be only allowing users whom you provided access based on acceptor users that you added. if you want to share out side to databricks ...
How does Databricks Delta Lake address the challenges of managing data quality and consistency in the presence of complex data structures, such as those found in iceberg tables?
Some useful links: https://www.google.com/search?q=databricks+delta+lake+vs+iceberg&tbm=isch&ved=2ahUKEwiykbqB9Oj_AhVGO0QIHfo9CjEQ2-cCegQIABAD&oq=databricks+delta+lake+vs+iceberg&gs_lcp=ChJtb2JpbGUtZ3dzLXdpei1pbWcQAzoECCMQJzoFCCEQqwI6BAghEAo6BwgAEBgQ...
Just finished coding class and hoping for the jacket/nirvana anyone else aims for it?
What do we need to do to complete? I’m having trouble finding details.
I was part of the summit this year. It was very knowledgeable and insightful with how databricks is growing and how we can take benefit of it. The reason to attend this year summit is to gain business insight and need for the databricks in our worksp...
My team has just started to use Databricks and this is my first time attending DAIS! The Databricks platform has so many features and opportunities, my team is ecstatic to start diving in! The community here has been amazing. Really excited to learn ...
