Hello !In DBKS we have 2 different autoscaling mechanisms here:- normal compute autoscaling on a job or all purpose cluster : this is the autoscaling you enable on a classic job cluster by setting min or max workers and for structured streaming jobs,...
Hello @Abhishek_sinha ! Thanks for sharing this ! very useful  Few things I can add (from my personal XP), it is better to use the PostgreSQL driver and not the DBKS JDBC driver because Lakebase is PostgreSQL compatible so DBeaver should be configu...
Hi again @Akshay_Petkar !I don't think that all values must be stored in Azure Key Vault. it depends on which Lakebridge reconciliation config version or path you are using.For the older notebook style config, Lakebridge has a secret_scope for sourc...
Hi @yit337 !This is expected for AUTO CDC with SCD2 and it is not doing a simple append because it must upsert incoming CDC rows into the target based on the declared keys and for SCD2 it also maintains historical rows with __START_AT or __END_AT.So...
