- 1658 Views
- 5 replies
- 7 kudos
From Associate to Professional: My Learning Plan to ace all Databricks Data Engineer Certifications
In today’s data-driven world, the role of a data engineer is critical in designing and maintaining the infrastructure that allows for the efficient collection, storage, and analysis of large volumes of data. Databricks certifications holds significan...
- 1658 Views
- 5 replies
- 7 kudos
- 7 kudos
@ms_ccg You are correct. I got that error too. Seems like Databricks has removed some of these. I would suggest you to search for those separately via Databricks Academy or external resources. Let me know if you need any help.
- 7 kudos
- 1188 Views
- 2 replies
- 5 kudos
knowledge sharing
Hello Databricks Community,I hope this message finds you well.My name is Yogita, and I am excited to announce that I have started sharing knowledge and insights on various Spark scenarios and theoretical questions on linkdin platform. My aim is to cr...
- 1188 Views
- 2 replies
- 5 kudos
- 5 kudos
Hi @Yogic24 , that's fantastic! Please share your blogs in this space so fellow data practitioners can benefit.
- 5 kudos
- 745 Views
- 1 replies
- 1 kudos
Enhanced Search in Schema Browser
More easily find models and tables in your organization with our enhanced Schema Browser search experience. Functions and volumes support are coming soon. Opt-in to use this feature by visiting Settings > User > Developer settings.
- 745 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for sharing this update with the community! @Ajay-Pandey Thanks for keeping the community informed.
- 1 kudos
- 876 Views
- 1 replies
- 2 kudos
Can monitor permission for SQL Warehouses now in Public Preview
Can monitor permission allows users to monitor SQL Warehouses, including query history and query profiles.
- 876 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Ajay-Pandey , Thank you for sharing this. I am sure it will help community members. We appreciate your participation. Thanks, Rishabh
- 2 kudos
- 830 Views
- 1 replies
- 2 kudos
Bulk move and delete available in filebrowser
You can now perform bulk move and delete on your filebrowser assets. Select multiple assets and right-click or use the new actions toolbar.
- 830 Views
- 1 replies
- 2 kudos
- 2 kudos
Thank you for sharing the quick tricks @Ajay-Pandey I am sure, it will help other community members.
- 2 kudos
- 686 Views
- 1 replies
- 2 kudos
Caching and data freshness
Dashboards maintain a 24-hour result cache to optimize initial loading times, operating on a best-effort basis. This means that while the system always attempts to use historical query results linked to dashboard credentials to enhance performance, t...
- 686 Views
- 1 replies
- 2 kudos
- 2 kudos
Thank you for providing this valuable update on caching and data freshness @Ajay-Pandey . It's great to see how these features are designed to optimize performance and ensure data accuracy. We appreciate your detailed explanation and your efforts to ...
- 2 kudos
- 488 Views
- 1 replies
- 2 kudos
Accelerating discovery on Unity Catalog with a revamped Catalog Explore
Discover favorite and recent UC assets in Quick Access. You'll experience a simplified navigation with the gear icon (top left) for compute, storage, credentials, connections, DBFS, and managements features. Delta Sharing, Clean Rooms, and External D...
- 488 Views
- 1 replies
- 2 kudos
- 2 kudos
Thank you for sharing this update on the Unity Catalog! @Ajay-Pandey Appreciate the detailed overview!
- 2 kudos
- 2571 Views
- 1 replies
- 3 kudos
Configuring DNS resolution for Private Databricks Workspaces (AWS)
Intro For customers on the E2 Platform, Databricks has a feature that allows them to use AWS PrivateLink to provision secure private workspaces by creating VPC endpoints to both the front-end and back-end interfaces of the Databricks infrastructure. ...
- 2571 Views
- 1 replies
- 3 kudos
- 3 kudos
@alysson_souza love it! Thank you for sharing
- 3 kudos
- 3318 Views
- 1 replies
- 1 kudos
Optimizing Costs in Databricks by Dynamically Choosing Cluster Sizes
Databricks is a popular unified data analytics platform known for its powerful data processing capabilities and seamless integration with Apache Spark. However, managing and optimizing costs in Databricks can be challenging, especially when it comes ...
- 3318 Views
- 1 replies
- 1 kudos
- 1 kudos
@Harun This is amazing! Thank you for sharing
- 1 kudos
- 2992 Views
- 1 replies
- 2 kudos
Comprehensive Guide to Databricks Optimization: Z-Order, Data Compaction, and Liquid Clustering
Optimizing data storage and access is crucial for enhancing the performance of data processing systems. In Databricks, several optimization techniques can significantly improve query performance and reduce costs: Z-Order Optimize, Optimize Compaction...
- 2992 Views
- 1 replies
- 2 kudos
- 2 kudos
Very insightful @Harun. Thank you for sharing this with us!
- 2 kudos
- 1976 Views
- 0 replies
- 2 kudos
CICD for databricks workflow jobs
This post is to set up Databricks workflow jobs as a CI/CD. Below are the two essential components needed for a complete CI/CD setup of workflow jobs. Databricks Asset Bundles(DABs)AzureDevOps pipeline. Databricks Asset Bundle ( From local terminal )...
- 1976 Views
- 0 replies
- 2 kudos
- 1499 Views
- 1 replies
- 3 kudos
Resolved! RamK - Certification Update
Hi Team,My name is Ram based out of Singapore. I am new to this Community . Recently I have completed my certification in Databricks starting from Data Analyst , Data Engineering and Gen AI. Looking forward to get connected in serving the Data and AI...
- 1499 Views
- 1 replies
- 3 kudos
- 3 kudos
Happy to see you here .
- 3 kudos
- 1052 Views
- 0 replies
- 1 kudos
Free Databricks Professional Data Engineer Practice Tests
Hi All,I came across a very good set of Practice tests on Databricks Professional Data Engineer Certification.For time being It is being given for free by instructor as promotional activity . Enroll if you are planning to go for the certificationhttp...
- 1052 Views
- 0 replies
- 1 kudos
- 557 Views
- 0 replies
- 1 kudos
How to deal with Slow Jobs?
Definitely configure job timeouts, and configure notifications. This will help you to identify slowness due to various factors. It is crucial to also investigate and fix the issue causing the slowness. The first step is to identify the problem. This ...
- 557 Views
- 0 replies
- 1 kudos
- 2466 Views
- 1 replies
- 1 kudos
How to enable unity catalog system tables?
Unity Catalog system tables provide lots of metadata & log data related to the operations of Databricks. System tables are organized into separate schemas containing one to a few tables owned and updated by Databricks. The storage and the cost of the...
- 2466 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @DouglasMoore , Thank you for sharing this. Until now I used to check the information schema. I am not able to find these details in any official doc. Do you have a reference?
- 1 kudos
- 870 Views
- 0 replies
- 0 kudos
Monitoring a Streaming Job
If you have a streaming job, you need to check the batch metrics to be able to understand the stream progress. However, here are some other suggestions which we can use to monitor a streaming job and be stuck in a "hung" state. Streaming Listeners sp...
- 870 Views
- 0 replies
- 0 kudos
