DLT run filas with "com.databricks.cdc.spark.DebeziumJDBCMicroBatchProvider not found"

smedegaard — Fri, 19 Apr 2024 21:42:49 GMT

I've created a streaming live table from a foreign catalog. When I run the DLT pipeline it fils with "com.databricks.cdc.spark.DebeziumJDBCMicroBatchProvider not found".

I haven't seen any documentation that suggests I need to install Debezium manually for DLT.
What am I missing?
```
CREATE OR REFRESH STREAMING LIVE TABLE temp_X_1
AS
SELECT
hourvalues.Value
, hourvalues.DateTime
, reduction.EName
, object_descriptions.Description
, units.UnitTxt
FROM
STREAM(`raw-data`.dbo.reduction) AS reduction
INNER JOIN
STREAM(`raw-data`.dbo.hourvalues) AS hourvalues
ON hourvalues.ReportIx = reduction.ReportIx
INNER JOIN
STREAM(`raw-data`.dbo.tbdme_objectdesc) AS object_descriptions
ON object_descriptions.EName = reduction.EName
INNER JOIN
STREAM(`raw-data`.dbo.tbdme_objectUnit) AS units
ON units.EName = reduction.EName
WHERE
reduction.EName LIKE 'XXX%'
```

Re: DLT run filas with "com.databricks.cdc.spark.DebeziumJDBCMicroBatchProvider not found"

smedegaard — Mon, 06 May 2024 12:06:16 GMT

This answer is very similar to what the LLMs told me. And unfortunately not helpfuL in solving my problems.

topic Re: DLT run filas with "com.databricks.cdc.spark.DebeziumJDBCMicroBatchProvider not found" in Data Engineering

DLT run filas with "com.databricks.cdc.spark.DebeziumJDBCMicroBatchProvider not found"

Re: DLT run filas with "com.databricks.cdc.spark.DebeziumJDBCMicroBatchProvider not found"