Certifications
Access industry-recognized credentials to validate your expertise in data engineering, analytics, an...
0 Posts
Activity in Learning & Certification
- 2105 Views
- 6 replies
- 4 kudos
[Azure] Outbound public IP address ranges for the control plane will be updated May 20, 2025
To improve the security and zone support availability of the Azure Databricks control plane, we'll be updating the outbound public IP address range and associated Databricks service tags on May 20, 2025. Required Action: If you use a resource firewal...
- 2105 Views
- 6 replies
- 4 kudos
- 331 Views
- 0 replies
- 0 kudos
[Azure] Azure Databricks Upgrading to Standard SKU Public IP Addresses
Due to the upcoming retirement of Static IPv4's Basic SKU, Azure Databricks will gradually start adopting the Standard SKU for new public IPs on 11 April 2025. As part of this change, the cost of new public Static IPv4 SKUs will increase from $0.004 ...
- 331 Views
- 0 replies
- 0 kudos
- 26682 Views
- 4 replies
- 9 kudos
Getting Started with Databricks - Building a Forecasting Model on Databricks
Building a Forecasting Model on Databricks: A Step-by-Step Guide This guide offers a detailed, step-by-step approach for building a forecasting model on Databricks. By leveraging the power of Databricks, you will unlock new potentials in your data w...
- 26682 Views
- 4 replies
- 9 kudos
- 20587 Views
- 6 replies
- 3 kudos
We are opening additional ports for Azure Databricks
IMPORTANT NOTE: we have delayed opening additional ports for new workspaces until January 31, 2025. For existing workspaces, Network Security Groups (NSGs) have been updated. If you received a communication that updates for your existing workspaces f...
- 20587 Views
- 6 replies
- 3 kudos
Latest Reply
- 3 kudos
Hello @shiv_DB25 According to me, your NSG config is fine. The rule 65001 on your outbound should allow your cluster to access internet.Not sure it will help, but there is this line in your log:'Error code: ERROR_NO_MATCHING_DISTRIBUTION'I don't know...
- 3 kudos
- 1554 Views
- 0 replies
- 0 kudos
[Action required] [GCP] Databricks is updating the public IP range for our control plane services
This blog is to notify you that on January 20, 2025, Databricks will begin using new control plane service components on Google Cloud Platform (GCP). This will affect the egress and ingress IP addresses Databricks’ control plane uses. If you use a fi...
- 1554 Views
- 0 replies
- 0 kudos
- 17719 Views
- 2 replies
- 12 kudos
Getting Started with Databricks - Build a simple Lakehouse analytics pipeline
Getting started with Databricks - Build a simple Lakehouse analytics pipeline The demo example in this guide illustrates a lakehouse analytics pipeline using the well-known NYC taxi trip dataset. This public dataset is also available at Kaggle. This...
- 17719 Views
- 2 replies
- 12 kudos
- 48121 Views
- 21 replies
- 6 kudos
[Action required] [Azure] update outbound connectivity for classic workspaces
IMPORTANT NOTE: We have indefinitely delayed the automatic enforcement described below for workspaces that had enabled workspace IP access lists prior to July 29, 2024. We still recommend manually enforcing IP access lists on compute plane requests i...
- 48121 Views
- 21 replies
- 6 kudos
Latest Reply
- 6 kudos
@Abadoom you must have configured backend private link as well, including setting requiredNsgRules=NoAzureDatabricksRules CC @rugger-bricks @kyrrewk if your traffic goes through Azure Firewall, then you can add the IPs of the Azure Firewall instance...
- 6 kudos
- 6782 Views
- 0 replies
- 1 kudos
Getting started with Databricks - Deploy an LLM chatbot using Databricks Vector Search and Foundation Model API
Getting started with Databricks - Deploy an LLM chatbot using Databricks Vector Search and Foundation Model API This guide demonstrates how to build a simple Retrieval-Augmented Generation (RAG) application using Databricks Vector Search, a vect...
- 6782 Views
- 0 replies
- 1 kudos
- 3613 Views
- 0 replies
- 0 kudos
Get started with an exploratory analysis on Databricks using Sample Data
Getting started with Databricks - Exploratory analysis This guide walks you through using a Databricks notebook to query sample data stored in Unity Catalog using Python and then visualize the query results in the notebook.This is a beginner’s tutori...
- 3613 Views
- 0 replies
- 0 kudos
- 8772 Views
- 0 replies
- 3 kudos
Update your UC AWS IAM Roles to include self-assume capabilities by September 20th, 2024
Background In order for Unity Catalog to moderate fine-grained access control in S3 cloud storage, Unity Catalog performs STS:AssumeRole operations on the IAM roles that underlie storage credentials. This article details the upcoming changes to the r...
- 8772 Views
- 0 replies
- 3 kudos
- 13991 Views
- 6 replies
- 0 kudos
[Action required] [AWS] update outbound connectivity for classic workspaces
IMPORTANT NOTE: We have indefinitely delayed the automatic enforcement described below for workspaces that had enabled workspace IP access lists prior to July 29, 2024. We still recommend manually enforcing IP access lists on compute plane requests i...
- 13991 Views
- 6 replies
- 0 kudos
Latest Reply
- 0 kudos
@SathwickKollipa if I understood your set-up correctly, all compute plane traffic will egress through proxy before hitting the control plane. In this case, allow-listing the IPs of the proxy in the workspace IP ACL should be sufficient. @krikotti ca...
- 0 kudos
- 12148 Views
- 1 replies
- 3 kudos
Getting Started with Databricks SQL Serverless on Azure
Getting Started with Databricks SQL Serverless on Azure This is an Azure admin guide for existing Databricks SQL customers interested in SQL Serverless features. This guide covers the following topics: What is Serverless ArchitectureSecurity on Serv...
- 12148 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
It's great
- 3 kudos
- 21301 Views
- 6 replies
- 3 kudos
[Action required] Azure Databricks is updating the public IP range for its control plane services
Starting on 30 May 2024, Azure Databricks will begin using new control plane service components. This will affect the egress and ingress IP addresses Azure Databricks’ control plane uses. If you use a firewall or proxy appliance to restrict user acce...
- 21301 Views
- 6 replies
- 3 kudos
Latest Reply
- 3 kudos
@VladimirD1 apologies for the delay - for workspaces that are both: a) in a locked virtual network in your Azure subscription (i.e., NOT VNet injection workspaces) b) NOT using secure cluster connectivity there is an NSG inbound rule for the compute...
- 3 kudos
- 4589 Views
- 0 replies
- 0 kudos
[Action required] [GCP] update outbound connectivity for classic workspaces
IMPORTANT NOTE: We have indefinitely delayed the automatic enforcement described below for workspaces that had enabled workspace IP access lists prior to July 29, 2024. We still recommend manually enforcing IP access lists on compute plane requests i...
- 4589 Views
- 0 replies
- 0 kudos
- 8195 Views
- 1 replies
- 3 kudos
DigiCert is updating its root CA certificate
Databricks uses DigiCert as its SSL certificate authority, to establish trust. DigiCert is making a change to its root and intermediate CA certificates (detailed information below). This change will impact Databricks, starting on May 15, 2024. If you...
- 8195 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
Thanks for info
- 3 kudos
