Certifications
Access industry-recognized credentials to validate your expertise in data engineering, analytics, an...
0 Posts
Activity in Learning & Certification
- 13545 Views
- 4 replies
- 1 kudos
We are opening additional ports for Azure Databricks
IMPORTANT NOTE: we have delayed opening additional ports for new workspaces until October 11, 2024. For existing workspaces, Network Security Groups (NSGs) have been updated. If you received a communication that updates for your existing workspaces f...
- 13545 Views
- 4 replies
- 1 kudos
Latest Reply
- 1 kudos
@MajaGrubbeHil @loic @thedatacrew - adding these rules to NSGs for new workspaces will break workspace creation for any customers who are still blocking the ports, so we gave extended time (through October 11th) for those customers to open access. Af...
- 1 kudos
- 7539 Views
- 1 replies
- 4 kudos
Getting Started with Databricks - Build a simple Lakehouse analytics pipeline
Getting started with Databricks - Build a simple Lakehouse analytics pipeline The demo example in this guide illustrates a lakehouse analytics pipeline using the well-known NYC taxi trip dataset. This public dataset is also available at Kaggle. This...
- 7539 Views
- 1 replies
- 4 kudos
Latest Reply
- 4 kudos
"Excellent exercise! The most challenging part was setting up the environment using the Azure free account. However, now that I have access to all the functionalities, I am well-equipped to continue training and building my skills with Databricks. Lo...
- 4 kudos
- 29094 Views
- 21 replies
- 6 kudos
[Action required] [Azure] update outbound connectivity for classic workspaces
Communication To improve security for Azure Databricks customers, we’ll begin applying workspace IP access controls to compute plane traffic. This change will impact workspaces that use both secure cluster connectivity (no public IP) and workspace IP...
- 29094 Views
- 21 replies
- 6 kudos
Latest Reply
- 6 kudos
@Abadoom you must have configured backend private link as well, including setting requiredNsgRules=NoAzureDatabricksRules CC @rugger-bricks @kyrrewk if your traffic goes through Azure Firewall, then you can add the IPs of the Azure Firewall instance...
- 6 kudos
- 7387 Views
- 1 replies
- 3 kudos
Getting Started with Databricks - Building a Forecasting Model on Databricks
Building a Forecasting Model on Databricks: A Step-by-Step Guide This guide offers a detailed, step-by-step approach for building a forecasting model on Databricks. By leveraging the power of Databricks, you will unlock new potentials in your data w...
- 7387 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
Truly well articulated.
- 3 kudos
- 223 Views
- 0 replies
- 0 kudos
Databricks Data Warehousing Announcements— July 2024
Predictive Optimisation Predictive Optimisation is in GA, which uses AI to understand the maintenance operations required from Unity Catalog (eg: data access patterns) and automatically runs optimisations on your data layouts to improve query perform...
- 223 Views
- 0 replies
- 0 kudos
- 255 Views
- 0 replies
- 0 kudos
Databricks Governance and DWH Announcements — July 2024
Governance & Delta Sharing New connection support for Lakehouse federation You can run federated queries on data managed by Salesforce Data Cloud You can use SSO authentication to connect to SQL Server Query History and Node timeline are now avai...
- 255 Views
- 0 replies
- 0 kudos
- 749 Views
- 0 replies
- 0 kudos
Databricks GenAI & ML Announcements — July 2024
No time to read? Check out this recap video of all the announcements listed below for July 2024 → Subscribe to our YouTube channel for regular updates Table of Contents· Llama 3.1: A New Standard in Open Source AI: Meta Llama 3.1 on Databricks·...
- 749 Views
- 0 replies
- 0 kudos
- 1401 Views
- 0 replies
- 1 kudos
Getting started with Databricks - Deploy an LLM chatbot using Databricks Vector Search and Foundation Model API
Getting started with Databricks - Deploy an LLM chatbot using Databricks Vector Search and Foundation Model API This guide demonstrates how to build a simple Retrieval-Augmented Generation (RAG) application using Databricks Vector Search, a vect...
- 1401 Views
- 0 replies
- 1 kudos
- 662 Views
- 0 replies
- 0 kudos
Get started with an exploratory analysis on Databricks using Sample Data
Getting started with Databricks - Exploratory analysis This guide walks you through using a Databricks notebook to query sample data stored in Unity Catalog using Python and then visualize the query results in the notebook.This is a beginner’s tutori...
- 662 Views
- 0 replies
- 0 kudos
- 3701 Views
- 0 replies
- 1 kudos
Data+AI Summit 2024 Data Warehousing Announcements
In a nutshell AI/BI Dashboards (GA) allow end users to create dashboards with low-code experience via a drag-and-drop canvas or through natural language via AI-powered text to viz capability. → Data+AI Summit TalkAI/BI Genie (Public Preview) is a con...
- 3701 Views
- 0 replies
- 1 kudos
- 3644 Views
- 0 replies
- 0 kudos
Data+AI Summit 2024 Data Engineering Announcements
In a nutshell Databricks acquired Tabular, a data management company founded by Ryan Blue, Daniel Weeks, and Jason Reid. This acquisition brings the original creators of Apache Iceberg and those of Linux Foundation Delta Lake, the two leading open so...
- 3644 Views
- 0 replies
- 0 kudos
- 3568 Views
- 0 replies
- 0 kudos
Data+AI Summit 2024 Governance & Unity Catalog Announcements
Subscribe to the NextGenLakehouse to receive monthly updates! In a nutshell Open Data/Table format war is over — Delta & Iceberg will work together toward unification with the Tabular.io acquisitionOpen Governance is at hand with Unity Catalog being ...
- 3568 Views
- 0 replies
- 0 kudos
- 4197 Views
- 0 replies
- 0 kudos
Data+AI Summit 2024 GenAI & ML Announcements
In a nutshell — it’s all about Compound AI Systems Watch this video for a deep dive into all the GenAI and ML announcements, and read the newsletter below for more details! Here are the main takeaways in the Machine Learning and GenAI space: Mos...
- 4197 Views
- 0 replies
- 0 kudos
- 1898 Views
- 0 replies
- 1 kudos
Update your UC AWS IAM Roles to include self-assume capabilities by September 20th, 2024
Background In order for Unity Catalog to moderate fine-grained access control in S3 cloud storage, Unity Catalog performs STS:AssumeRole operations on the IAM roles that underlie storage credentials. This article details the upcoming changes to the r...
- 1898 Views
- 0 replies
- 1 kudos
- 7564 Views
- 6 replies
- 0 kudos
[Action required] [AWS] update outbound connectivity for classic workspaces
Communication To enhance security, we are making a change to workspaces that use the workspace IP access lists feature. For these workspaces, we will begin to apply workspace IP access controls to compute plane traffic. See Action Required and Timeli...
- 7564 Views
- 6 replies
- 0 kudos
Latest Reply
- 0 kudos
@SathwickKollipa if I understood your set-up correctly, all compute plane traffic will egress through proxy before hitting the control plane. In this case, allow-listing the IPs of the proxy in the workspace IP ACL should be sufficient. @krikotti ca...
- 0 kudos
