IntroductionThe Challenge with Traditional Streaming ArchitecturesHow Zerobus Ingest Enables Real-Time Ingestion in DatabricksWhy Zerobus Matters for Modern Data ArchitecturesKey Component and Architecture:Zerobus vs Kafka vs Auto Loader: Databricks ...
Hi, I am facing problem where my existing view has stopped working due to unrecognised filed which is a alias field .I am using the same definition and spark configuration.DBR : 14.3 LTS, Spark 3.5.0Any one faced similar problem recently ?
I am trying to replicate my existing spark pipeline in DLT. I am not able to achieve desired result using DLT . Current pipeline : source set up : CSV file ingested in bronze using SCP frequency : monthly bronze dir : /cntdlt/bronze/emp/year=2022 /...
HI @Khaja_Zaffer yes it was actaully issue with privacera version . after invastaigation with privacera team they suggested to upgrade the privacera version to 9.0.35.1.
HI @Khaja_Zaffer , The Date is present in data . The problem i see here :The renamed column in select clause is not identifying with single quotes " ` " when we are passing with double quotes then it is considering the column but filtering is not...
Are you using Azure Databricks ?? have you recently migrated your classic Global Administration role to RBAC global admin in azure we had the same issue we fix it by creating metastore from CLI databricks metastores create {Name} --region {regi...
