- 4431 Views
- 1 replies
- 2 kudos
Use Retrieval-augmented generation (RAG) to boost performance of LLM applications
Retrieval-augmented generation (RAG) is a method that boosts the performance of large language model (LLM) applications by utilizing tailored data.It achieves this by fetching pertinent data or documents related to a specific query or task and presen...
- 4431 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks for sharing such valuable insight, @Sourav-Kundu . Your breakdown of how RAG enhances LLMs is spot on- clear and concise!
- 2 kudos
- 3819 Views
- 1 replies
- 2 kudos
You can use Low Shuffle Merge to optimize the Merge process in Delta lake
Low Shuffle Merge in Databricks is a feature that optimizes the way data is merged when using Delta Lake, reducing the amount of data shuffled between nodes.- Traditional merges can involve heavy data shuffling, as data is redistributed across the cl...
- 3819 Views
- 1 replies
- 2 kudos
- 2 kudos
Great post, @Sourav-Kundu. The benefits you've outlined, especially regarding faster execution and cost efficiency, are valuable for anyone working with large-scale data processing. Thanks for sharing!
- 2 kudos
- 1738 Views
- 0 replies
- 0 kudos
Utilize Unity Catalog alongside your Delta Live Tables pipelines
Delta Live Tables support for Unity Catalog is in Public PreviewDatabricks recommends setting up Delta Live Tables pipelines using Unity Catalog.When configured with Unity Catalog, these pipelines publish all defined materialized views and streaming ...
- 1738 Views
- 0 replies
- 0 kudos
- 1330 Views
- 0 replies
- 1 kudos
Databricks Asset Bundles package and deploy resources like notebooks and workflows as a single unit.
Databricks Asset Bundles help implement software engineering best practices like version control, testing and CI/CD for data and AI projects.1. They allow you to define resources such as jobs and notebooks as source files, making project structure, t...
- 1330 Views
- 0 replies
- 1 kudos
- 1849 Views
- 0 replies
- 0 kudos
Databricks serverless budget policies are now available in Public Preview
Databricks serverless budget policies are now available in Public Preview, enabling administrators to automatically apply the correct tags to serverless resources without relying on users to manually attach them.1. This feature allows for customized ...
- 1849 Views
- 0 replies
- 0 kudos
- 7143 Views
- 0 replies
- 1 kudos
How to recover Dropped Tables in Databricks
Have you ever accidentally dropped a table in Databricks, or had someone else mistakenly drop it?Databricks offers a useful feature that allows you to view dropped tables and recover them if needed.1. You need to first execute SHOW TABLES DROPPED2. T...
- 7143 Views
- 0 replies
- 1 kudos
- 4889 Views
- 4 replies
- 2 kudos
Resolved! Want to learn LakeFlow Pipelines in community edition.
Hello Everyone. I want to explore LakeFlow Pipelines in the community version but don’t have access to Azure or AWS. I had a bad experience with Azure, where I was charged $85 while just trying to learn. Is there a less expensive, step-by-step learni...
- 4889 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @nafikazi ,Sorry, this is not possible in community edition. Your only option is to have AWS or Azure account.
- 2 kudos
- 6929 Views
- 6 replies
- 7 kudos
🚀 Databricks Custom Apps! 🚀
Whether you're a data scientist or a sales executive, Databricks is making it easier than ever to build, host, and share secure data applications. With our platform, you can now run any Python code on serverless compute, share it with non-technical c...
- 6929 Views
- 6 replies
- 7 kudos
- 7 kudos
Can we somehow play with hosting, and expose this app outside?
- 7 kudos
- 5320 Views
- 5 replies
- 1 kudos
Writing append blob files to unity catalog volum
The workspace is assigned to unity catalog, and all the access to the ADLS Gen2 is now handled via unity catalog only, means no SPN, no connection string, access keys etc. I have to create append blob files in a volume, Is this is possible in a works...
- 5320 Views
- 5 replies
- 1 kudos
- 1 kudos
Now I got your point. No, you can't create Append Blob files directly in Volumes, as this is a native Azure functionality. A volume is basically just an abstraction over a native storage.You will still need to use libraries like azure-storage-blob wi...
- 1 kudos
- 5341 Views
- 2 replies
- 0 kudos
Resolved! Standardized Framework to update Databricks job definition using CI/CD
Hi Databricks support, I am looking for a standardized Databricks framework to update job definition using DevOps from non-production till it get productionized. Our current process of updating the Databricks job definition is as follows:In our sourc...
- 5341 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi from the Git folders/Repos PM: DAB is the way to go, and we are working on an integration to author DABs directly in the workspace. Here's a DAIS talk where the DAB PM and I demo'ed some recommendations for source controlling jobs: https://www.da...
- 0 kudos
- 14734 Views
- 3 replies
- 5 kudos
Build & Refresh a Calendar Dates Table
IntroductionMaintaining accurate and up-to-date calendar date tables is crucial for reliable reporting, yet manual updates can be time-consuming and prone to error. This fundamental component serves as the backbone for date-based analysis, enabling a...
- 14734 Views
- 3 replies
- 5 kudos
- 10518 Views
- 3 replies
- 1 kudos
Reading Excel files folder
Dears,One of the tasks needed by DE is to ingest data from files, for example, Excel file.Thanks for OnerFusion-AI for the below thread that give us the steps of reading from one file https://community.databricks.com/t5/get-started-discussions/how-to...
- 10518 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @AhmedAlnaqa ,Can we read from ADLS location too by using abfss ?Thanks
- 1 kudos
- 2279 Views
- 1 replies
- 3 kudos
Notification destination API
You can now create, delete, and update notification destinations through the Databricks API.The notification destinations API lets you programmatically manage a workspace's notification destinations. Notification destinations are used to send notific...
- 2279 Views
- 1 replies
- 3 kudos
- 3 kudos
Hi,Thank you for sharing this Ajay. We appreciate you keeping the community informed!Thanks,Anushree
- 3 kudos
- 3965 Views
- 1 replies
- 2 kudos
The Importance of Databricks in Today's Data Market
Unlocking the Power of Data with Databricks In the rapidly evolving landscape of data and analytics, Databricks has emerged as a transformative force, reshaping how organizations handle big data, data engineering, and machine learning. As we naviga...
- 3965 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Rishabh-Pandey,Thank you for sharing this! Databricks is really making a difference with its unified platform and powerful features. Excited to see how it will continue to shape the future of data! Thanks,
- 2 kudos
- 7371 Views
- 1 replies
- 1 kudos
Databricks on Databricks: Kicking off the Journey to Governance with Unity Catalog
In the world of data engineering and analytics, governance is paramount. Databricks has taken a significant step forward in this arena with the introduction of Unity Catalog, a unified governance solution for all data and AI assets. This journey to e...
- 7371 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi Rishabh ,Unity Catalog is a major advancement in data governance, enhancing how we manage and secure data and AI assets in Databricks. Exciting to see these improvements!Thanks,Anushree
- 1 kudos
-
Access Data
1 -
Access Delta Tables
1 -
ADB
1 -
ADF Linked Service
1 -
ADF Pipeline
1 -
Advanced Data Engineering
7 -
Agent Architecture
2 -
Agent Bricks
2 -
Agent Skills
2 -
Agentic AI
8 -
agents
1 -
AI
5 -
AI Agents
12 -
AI BI Dashboards
1 -
ai gateway
2 -
AI Governance
1 -
AI Readiness
1 -
ai_query
1 -
AIAgents
1 -
AIBI
3 -
AIBI Dashboards
1 -
AIGovernance
1 -
Alerts
1 -
Analytics
2 -
Analytics Engineering
1 -
Apache Iceberg
2 -
Apache spark
3 -
Apache Spark 3.0
2 -
ApacheSpark
1 -
Aqe
1 -
Architecture
7 -
asset bundle
1 -
Asset Bundles
4 -
Associate Certification
2 -
Audit
1 -
Audit Logs
1 -
AUTO CDC
1 -
Auto-loader
1 -
Autoloader
1 -
Automation
3 -
Automl
1 -
AutoML Experiment
1 -
AWS
1 -
AWSDatabricksCluster
2 -
Azure
5 -
Azure databricks
6 -
Azure Databricks Delta Table
3 -
Azure Databricks Job
2 -
Azure Delta Lake
4 -
Azure devops integration
2 -
Azure Unity Catalog
3 -
AzureDatabricks
2 -
Banking
1 -
best practices
3 -
BI Integrations
1 -
Big data
1 -
Billing and Cost Management
2 -
Blog
1 -
BroadcastJoin
1 -
Bronze Layer
1 -
Bronze Table
1 -
Build a Databricks App on Free Edition with a Genie Agent at its core.
1 -
Caching
2 -
Cash Flow
1 -
CDC
5 -
CDF
1 -
Certification
1 -
Certification Badge
1 -
Certification Exam
1 -
Change data capture
1 -
CICD
5 -
CICDForDatabricksWorkflows
2 -
Cluster
1 -
Cluster Policies
1 -
Cluster Pools
1 -
Collect
1 -
Community Champion
1 -
Community Contest
1 -
Community Event
1 -
CommunityArticle
3 -
Concurrency
1 -
Cost Optimization Effort
2 -
CostOptimization
3 -
Creative Thinking
1 -
Credential Vending
1 -
Credit Risk
1 -
custom compute policy
1 -
Customer Record
1 -
CustomLibrary
1 -
DABs
3 -
DAIS 0206
3 -
DAIS 2026
2 -
Dashboards
2 -
Data
1 -
Data Agents
1 -
Data Analysis with Databricks
1 -
Data Architecture
2 -
Data Driven AI Roadmap
1 -
Data Engineering
29 -
Data Governance
10 -
Data Ingestion
2 -
Data Ingestion & connectivity
1 -
data layout
1 -
Data Mesh
1 -
data optimization
1 -
Data Processing
1 -
Data Quality
7 -
Data Quality Checks
2 -
Data warehouse
1 -
Data Warehousing
1 -
Databricks
6 -
Databricks App
2 -
Databricks Apps
17 -
Databricks Assistant
2 -
Databricks Blog
1 -
Databricks Certified
1 -
Databricks Clusters
1 -
Databricks Community
1 -
Databricks Dashboard
2 -
Databricks Delta Table
3 -
Databricks Demo Center
1 -
Databricks Free Edition
2 -
Databricks genAI associate
1 -
databricks genie
4 -
Databricks Job
2 -
Databricks Lakeflow
4 -
Databricks Lakehouse
4 -
Databricks Migration
4 -
Databricks Mlflow
1 -
Databricks News
1 -
Databricks Notebooks
1 -
Databricks Partner
1 -
Databricks Platform
1 -
Databricks Pyspark
3 -
Databricks Serverless
4 -
Databricks SQL
3 -
Databricks Support
1 -
Databricks Training
1 -
Databricks Unity Catalog
4 -
Databricks Workflows
3 -
DatabricksAutomation
2 -
DatabricksML
1 -
DatabricksOptimization
2 -
DataEngineering
2 -
DataGovernance
1 -
DateChange
1 -
DBR Versions
1 -
Dbt
1 -
Declartive Pipelines
2 -
DeepLearning
1 -
Deletion Vectors
1 -
Delta Lake
25 -
Delta Lake Files
1 -
Delta Live Table
4 -
Delta Live Tables
1 -
Delta Tables
1 -
Delta Time Travel
1 -
Delta-lake
1 -
DeltaLake
2 -
Developer
1 -
Development
1 -
DevOps
2 -
DimensionTables
1 -
DLT
3 -
DLT Pipeline
2 -
DLT Pipelines
3 -
DLT-Meta
1 -
Dns
1 -
DQX
3 -
Drift
1 -
Dynamic
1 -
Dynamic Partition
1 -
Engineering With Databricks
1 -
ETL
1 -
ETL Pipelines
2 -
fastapi
1 -
Feature Store
1 -
Financial Services
1 -
Fine Grained Access
1 -
FinOps
1 -
Forecasting
1 -
Fraud Detection
1 -
Free Databricks
3 -
Free Edition
1 -
GenAI
3 -
GenAI agent
2 -
GenAI and LLMs
5 -
GenAIGeneration AI
2 -
Generation AI
1 -
Generative AI
12 -
Generative AI Engineer
1 -
genie
19 -
Genie Agent
2 -
Genie Agents
12 -
Genie Code
1 -
Genie Ontology
1 -
Genie-Powered App Challenge - 2026
3 -
GenieCode
1 -
GenieOntology
2 -
Git
1 -
Github
1 -
Github actions
1 -
Gold Layer
1 -
GoldLayer
1 -
Google Bigquery
1 -
Google cloud
1 -
Governance
5 -
Governed Tag
1 -
Graph
1 -
Graphframes
1 -
hackathon
2 -
Hive metastore
1 -
Hubert Dudek
42 -
Hybrid Lakehouse
1 -
Incremental Load
1 -
infrastructure as code
1 -
Ingestion
1 -
Insurance · Reinsurance · Banking · Telecom · Retail · Agriculture — Per-Object API Calls to Per-Cell Scoring with H3 and Native Spatial SQL
1 -
Interoperability
1 -
IoT
1 -
Kafka streaming
3 -
Keyvault
1 -
Lakebase
6 -
Lakeflow
4 -
Lakeflow Declarative Pipelines
2 -
Lakeflow Pipelines
3 -
LakeflowDesigner
2 -
LakeflowJobs
1 -
Lakehouse
5 -
Lakehouse federation
1 -
Lakehouse Migration
2 -
Langchain
1 -
LangGraph
2 -
Lazy Evaluation
1 -
Learning
2 -
Library Installation
1 -
LightGBM
1 -
Lineage
2 -
Liquid Clustering
1 -
LiquidClustering
2 -
Live Tables CDC
3 -
Llama
1 -
LLM
1 -
LLM Evaluation
1 -
LLM-as-a-Judge
1 -
LLMs
1 -
Machine Learning
3 -
Materialized Views
1 -
mcp
5 -
Medallion Architecture
9 -
MERGE
2 -
MERGE Performance
3 -
Metadata
2 -
Metric Views
4 -
Migration
1 -
Migrations
1 -
ML Model
1 -
MlFlow
5 -
MLOps
1 -
Model Governance
1 -
Model Serving
2 -
mosic ai search
1 -
MSExcel
3 -
Multi-Table Transactions
1 -
Multiagent
4 -
Networking
2 -
New Features
1 -
NotMvpArticle
1 -
Ontology
1 -
Operations Analytics
2 -
Optimization
6 -
Optimize Command
1 -
Partitioning
4 -
Partner
2 -
Performance
3 -
Performance Tuning
5 -
Photon Engine
1 -
PII
1 -
Power BI
1 -
Power BI XLMA EndPoint
1 -
Powerbi
1 -
PredictiveOptimization
2 -
Private Link
1 -
Prompt Tuning
1 -
Pyspark
8 -
Pyspark Code
1 -
Pyspark Databricks
1 -
Pytest
1 -
Python
1 -
Query Plan
1 -
QueryProfile
1 -
RBAC
1 -
Reading-excel
2 -
Reliability
1 -
RescuedData
1 -
Rest APIs
1 -
Retail Forecasting
1 -
Retries
1 -
Row Level Security
2 -
SAP
4 -
SAP BW
1 -
Sap Hana Driver
1 -
Scala Code
1 -
Scd Type 2
1 -
Scheduled Tasks
1 -
SchemaEvolution
1 -
Scripting
1 -
SDK
1 -
Secrets
1 -
Security
1 -
Semantic Layer
1 -
serverless
2 -
Service Principals
1 -
Small Business
1 -
SmallFiles
1 -
Smart Routing
1 -
Snowflake
1 -
Spanish
2 -
Spark
9 -
Spark Caching
1 -
Spark Internals
1 -
Spark Performance
1 -
SparkSQL
1 -
SQL
4 -
Sql Scripts
2 -
SQL Serverless
1 -
SQLPerformance
1 -
SQLWarehouse
1 -
Stream
1 -
streaming
2 -
Streaming Tables
1 -
streamlit
3 -
Structured streaming
2 -
Students
2 -
Supervisor Agent
1 -
Supply Chain
1 -
Support Ticket
1 -
Sync
1 -
System Tables
1 -
SystemTables
1 -
Sytem Tags
1 -
Table Formats
1 -
Tags
1 -
terraform
1 -
Timeouts
1 -
Training
1 -
Tutorial
4 -
UCSD
1 -
Unit Test
1 -
Unit testing
1 -
Unity Catalog
36 -
Unity Cataloge
1 -
Unity Catalogue
1 -
Unity Catlog
2 -
Unity Gateway
1 -
UnityCatalog
2 -
UnityGateway
1 -
University Alliance
1 -
VACUUM Command
1 -
Variant
1 -
VisualDataPrep
1 -
Vnet Injection
1 -
Vnet peering
1 -
volumes
1 -
Warehousing
1 -
Web
1 -
Workflow Jobs
1 -
Workflows
10 -
Zerobus
4 -
Zorder
1 -
Zordering
2
- « Previous
- Next »
| User | Count |
|---|---|
| 85 | |
| 77 | |
| 74 | |
| 60 | |
| 43 |