Data Engineering Associate Training
Props to the training team for the Data Engineering track at AI Summit, learned a ton and got some great experience!
- 810 Views
- 0 replies
- 0 kudos
Props to the training team for the Data Engineering track at AI Summit, learned a ton and got some great experience!
YES. You can use this script to do it%run ./path_to_other_notebook
We are planning to load 2 million plus jsons into prod. How should we plan for any intermittent failures and complete loads without performance issues.
This is Rajani
Just learned in this mornings session that Databricks enables me to share data across organizations. What would be the first step to learn more about how to do this?
The feature you're interested in is Delta Sharing. The feature page is located here.https://www.databricks.com/product/delta-sharingA more technical description for AWS customers can be found here:https://docs.databricks.com/data-sharing/index.html
Excited to be attending the #DataAISummit! Joined industry leaders, experts, and data enthusiasts at this incredible event. Learning about the latest trends, advancements, and best practices in data and AI. It's a fantastic opportunity to network an...
Is it possible to send job alerts via microsoft teams?
Yes , if databricks jobs are being orchestrated through ADF then you can call azure function app to send teams notifications.
Hi, can you do zordering as part of a structured streaming ingestion?
You can also turn on auto optimize writes for your table or session. This is especially good if your table is partitioned. You should also turn on auto compaction to help control the size of your files.Auto compaction can be enabled at the table or...
On prem Spark enthusiasts? Setting up your own Hadooop is fun, right?
This gives me ptsd. Hadoop and mapreduce has been nice and painful!
Great keynote this morning
There are lots of tools around improving ETL at DAIS.Why is a low code right (or wrong) for you?
Hi! I’m a pediatric dentist without any coding experience. Any help I can get with a no-code/low-code solution would be very right for me. Thank you!
Great stuff at the summit! Like the Satya Nadella interview!!
Well put together summit.
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 553 | |
| 349 | |
| 287 |