- 4544 Views
- 2 replies
- 1 kudos
How can I use data skipping with Delta Lake
How does data skipping work with delta lake, can I run ANALYZE TABLE COMPUTE STATISTICS with Delta lake? or Zorder going to solve these problems?
- 4544 Views
- 2 replies
- 1 kudos
- 1 kudos
You can use Zorder with indexes for data skipping. Data skipping information is collected automatically when you write to delta table. Delta lake uses this information to provide faster query.You dont need to configure anything for data skipping as t...
- 1 kudos
- 1223 Views
- 1 replies
- 0 kudos
Hello Databricks
I would love Unity catalog , eager to learn more
- 1223 Views
- 1 replies
- 0 kudos
- 0 kudos
There is a Databricks education university, you should get the account and also certified for some exam for free
- 0 kudos
- 658 Views
- 0 replies
- 0 kudos
Summit experience
SpoilerI like the overall experience, and like the data engineering training.I like the overall experience, and like the data engineering training.
- 658 Views
- 0 replies
- 0 kudos
- 682 Views
- 0 replies
- 0 kudos
Summit
How is everyone enjoying the summit?
- 682 Views
- 0 replies
- 0 kudos
- 713 Views
- 0 replies
- 0 kudos
Daa & AI Summit
Sessions are very useful, welcome reception is very enjoyable. Thanks for the organization.
- 713 Views
- 0 replies
- 0 kudos
- 8346 Views
- 0 replies
- 0 kudos
What I learnt
I learned about how to implement and utilize databricks more efficiently. We also explored how to live tables and how to build pipelines in the vastness that we can use this in our data orchestration process. We also explored autoloading go to live ...
- 8346 Views
- 0 replies
- 0 kudos
- 1215 Views
- 0 replies
- 0 kudos
Learning
I’ve learned so much I can’t put it into words! Looking forward to more!hopefully more information on data ingestion!
- 1215 Views
- 0 replies
- 0 kudos
- 779 Views
- 0 replies
- 0 kudos
Unity catalog
I need to setup a UC to share data among 4 different accounts. How can I do that using corporate VPC?
- 779 Views
- 0 replies
- 0 kudos
- 776 Views
- 0 replies
- 0 kudos
Databricks Summit
Love to be at Databricks summit #AI
- 776 Views
- 0 replies
- 0 kudos
- 870 Views
- 0 replies
- 0 kudos
Spark Optimization strategies
How can we get the correct size for job cluster in a job workflow pipeline based in the complexity of the process? #databricks #deltalake
- 870 Views
- 0 replies
- 0 kudos
- 801 Views
- 0 replies
- 0 kudos
How can I parallelize io and cpu processing in structured streaming?
How can I parallelize io and cpu processing while processing microbatches on spark streaming.
- 801 Views
- 0 replies
- 0 kudos
- 1195 Views
- 0 replies
- 0 kudos
Version control for databricks notebook visualizations?
We use databricks notebooks to create some inbuilt visualizations in the notebook but unable to checkin those in GitHubWe lose out the visualizations and dashboard that we create if we checkout a different branch
- 1195 Views
- 0 replies
- 0 kudos
- 829 Views
- 0 replies
- 0 kudos
CDF background implementation
How Delta Lake CDF works? I seen it add additional column to data, where data was updated or deleted. So what is the purpose of change log?
- 829 Views
- 0 replies
- 0 kudos
- 824 Views
- 0 replies
- 0 kudos
Greetings for My 1st Data+AI Summit 2023!
Kudos to the amazing instructors and TAs for my first in-person Data Engineer Associate Training, and I've passed my exam! Having a fantastic time so far, can't wait for the content unfolded in the next two days!
- 824 Views
- 0 replies
- 0 kudos
- 908 Views
- 0 replies
- 0 kudos
Advanced Data Engineering
Just finished the final day of training. Great content and delivery!
- 908 Views
- 0 replies
- 0 kudos
