Can't run Delta Live Tables pipeline while using Mosaic

Gabrosciurti — Wed, 03 Apr 2024 11:08:54 GMT

I'm just learning to use mosaic and delta live table in Databricks. I was following this example https://github.com/databrickslabs/mosaic/tree/main/notebooks/examples/python/OpenStreetMaps and after configuring everything I'm not able to run the pipeline.

The error is in the line where i enable mosaic

mos.enable_mosaic(spark, dbutils)

I also tried to install a specific version of mosaic to downgrade at the mosaic v3 and use the preview version of DLT.

This the configuration file of my DLT
```
{
"id": "<id>",
"pipeline_type": "WORKSPACE",
"clusters": [
{
"label": "default",
"node_type_id": "Standard_DS3_v2",
"num_workers": 1
}
],
"development": true,
"continuous": false,
"channel": "CURRENT",
"photon": true,
"libraries": [
{
"notebook": {
"path": "/Users/<user>/Mosaic-Example/02_Process"
}
}
],
"name": "open_street_map",
"edition": "ADVANCED",
"storage": "/temp/mosaic/open_street_maps",
"target": "open_street_maps",
"data_sampling": false
}
```

What am I missing?

and here the complete Trace Error

topic Can't run Delta Live Tables pipeline while using Mosaic in Data Engineering

Can't run Delta Live Tables pipeline while using Mosaic