- 1303 Views
- 5 replies
- 7 kudos
From Associate to Professional: My Learning Plan to ace all Databricks Data Engineer Certifications
In today’s data-driven world, the role of a data engineer is critical in designing and maintaining the infrastructure that allows for the efficient collection, storage, and analysis of large volumes of data. Databricks certifications holds significan...
- 1303 Views
- 5 replies
- 7 kudos
- 7 kudos
@ms_ccg You are correct. I got that error too. Seems like Databricks has removed some of these. I would suggest you to search for those separately via Databricks Academy or external resources. Let me know if you need any help.
- 7 kudos
- 421 Views
- 0 replies
- 0 kudos
Lakehouse Monitoring GA: Profile, diagnose, and enforce data quality
Lakehouse Monitoring provides automated profiling and a dashboard that visualizes trends and anomalies over time. Track key metrics such as data volume, percent nulls, numerical distribution changes, and categorical distribution. For inference tables...
- 421 Views
- 0 replies
- 0 kudos
- 1663 Views
- 2 replies
- 0 kudos
Error code 403 - Invalid access to Org
I am trying to make a GET /api/2.1/jobs/list call in a Notebook to get a list of all jobs in my workspace but am unable to do so due to a 403 "Invalid access to Org" error message. I am using a new PAT and the endpoint is correct. I also have workspa...
- 1663 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello, this API you are running is to the same workspace where you are currently located? Are you using classic compute or user Serverless compute? In case it is serverless can you test it with classic? Also may I know on which region and which cloud...
- 0 kudos
- 371 Views
- 0 replies
- 0 kudos
Reference SQL results in Workflows [Private Preview]
Reference the result of SQL tasks in Workflows and use it for control flow (If/else condition, For each task) or as a parameter of another task.Enable it today from your Previews page.
- 371 Views
- 0 replies
- 0 kudos
- 524 Views
- 2 replies
- 3 kudos
Resolved! Observability for materialized views and streaming tables
You can now view a materialized view/streaming table's refresh information and schedules from the Catalog Explorer page.
- 524 Views
- 2 replies
- 3 kudos
- 3 kudos
Thank you for sharing this valuable information with the community! @Ajay-Pandey This will surely help many users manage their data workflows more efficiently. We appreciate your contribution and encourage more insights like this.
- 3 kudos
- 1716 Views
- 1 replies
- 4 kudos
Best Practices for Utilizing Databricks Asset Bundles
Best practices for utilizing Databricks Asset Bundles effectively streamline your data and AI projects, ensuring they are robust, scalable, and maintainable. Here are some key practices to consider:1. Version Control: Always maintain a versioned hist...
- 1716 Views
- 1 replies
- 4 kudos
- 4 kudos
Thank you for sharing these best practices. @Ajay-Pandey We appreciate your contribution to helping the community members streamline their projects effectively.
- 4 kudos
- 608 Views
- 0 replies
- 1 kudos
Enhancements: Markdown Easy Editor
Dears,This idea is to bring the HTML editor to our markdown cells in notebook, this will help the developers add comments and note in fast and easy way.Thanks
- 608 Views
- 0 replies
- 1 kudos
- 1151 Views
- 2 replies
- 4 kudos
Resolved! DLT pipeline development made simple with notebooks
We’re just a couple weeks removed from the biggest Data + AI Summit in history, where we introduced Databricks LakeFlow, a unified, intelligent solution for data engineering. While we are hard at work evolving DLT and Workflows into the new unified s...
- 1151 Views
- 2 replies
- 4 kudos
- 4 kudos
Hi @Rishabh-Pandey Thank you for sharing this insightful update! We're thrilled to see your enthusiasm for the latest enhancements to the DLT development experience. Please keep sharing your experiences and insights with the community. Thanks,Rishab...
- 4 kudos
- 1131 Views
- 1 replies
- 1 kudos
Resolved! Databricks SQL fixes
Added support for customizing scatter point size and opacity in AI/BI dashboards.Improved interactivity in displaying tooltips when hovering over pie, scatter, and heatmap charts with many data points.AI/BI dashboard widgets created by Databricks Ass...
- 1131 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for sharing the updates on fixes @Ajay-Pandey .
- 1 kudos
- 1661 Views
- 1 replies
- 3 kudos
What is Accumulators and Broadcast Variables
1) Accumulators: Accumulators are used to implement counters and sum in Spark applications.Accumulators allow you to aggregate values from tasks running on worker nodes back to the driver program. They provide a way for tasks to incrementally update ...
- 1661 Views
- 1 replies
- 3 kudos
- 3 kudos
Thank you for sharing this @Yogic24 . I am sure it will help other community members.
- 3 kudos
- 1181 Views
- 1 replies
- 1 kudos
Resolved! AI/BI dashboard list API
You can now list existing AI/BI dashboards via API.Learn more
- 1181 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for sharing this , @Ajay-Pandey . We appreciate your contribution.
- 1 kudos
- 735 Views
- 1 replies
- 3 kudos
Why we are using shared variables into spark?
Hello Databricks Community!I am excited to share my first blog post with you all. This is a small and basic introduction to the concept of shared variables in Apache Spark. I hope this post will help those who are new to Spark understand why shared ...
- 735 Views
- 1 replies
- 3 kudos
- 3 kudos
Hi @Yogic24 , Welcome to the Databricks Community! Thank you for sharing your first blog post with us, I am sure it will help our community members. Thank you for your contribution and support! Thanks,Rishabh
- 3 kudos
- 1152 Views
- 2 replies
- 5 kudos
knowledge sharing
Hello Databricks Community,I hope this message finds you well.My name is Yogita, and I am excited to announce that I have started sharing knowledge and insights on various Spark scenarios and theoretical questions on linkdin platform. My aim is to cr...
- 1152 Views
- 2 replies
- 5 kudos
- 5 kudos
Hi @Yogic24 , that's fantastic! Please share your blogs in this space so fellow data practitioners can benefit.
- 5 kudos
- 509 Views
- 1 replies
- 1 kudos
Enhanced Search in Schema Browser
More easily find models and tables in your organization with our enhanced Schema Browser search experience. Functions and volumes support are coming soon. Opt-in to use this feature by visiting Settings > User > Developer settings.
- 509 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for sharing this update with the community! @Ajay-Pandey Thanks for keeping the community informed.
- 1 kudos
- 715 Views
- 1 replies
- 2 kudos
Can monitor permission for SQL Warehouses now in Public Preview
Can monitor permission allows users to monitor SQL Warehouses, including query history and query profiles.
- 715 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Ajay-Pandey , Thank you for sharing this. I am sure it will help community members. We appreciate your participation. Thanks, Rishabh
- 2 kudos
- 794 Views
- 1 replies
- 2 kudos
Bulk move and delete available in filebrowser
You can now perform bulk move and delete on your filebrowser assets. Select multiple assets and right-click or use the new actions toolbar.
- 794 Views
- 1 replies
- 2 kudos
- 2 kudos
Thank you for sharing the quick tricks @Ajay-Pandey I am sure, it will help other community members.
- 2 kudos
