Delta Live Tables: BAD_REQUEST: Pipeline cluster is not reachable.

jorgemarmol — Thu, 17 Aug 2023 07:41:57 GMT

Hello community:

I don´t know why my Delta Live table workflow fails into this step. This is the configuration I have for the pipeline:

{
"id": "**",
"pipeline_type": "WORKSPACE",
"clusters": [
{
"label": "default",
"spark_conf": {***},
"num_workers": 3
},
{
"label": "maintenance",
"spark_conf": {****},
"num_workers": 3
}
],
"development": false,
"continuous": false,
"channel": "CURRENT",
"photon": false,
"libraries": [
{
"notebook": {
"path": "/GeneracionAutomatica/DLT Generator (bronze)"
}
},
{
"notebook": {
"path": "/GeneracionAutomatica/DLT Generator (staging)"
}
}
],
"name": "Delta Live Tables (bronze)",
"edition": "ADVANCED",
"storage": "****",
"configuration": {
"pipelines.autoOptimize.zOrderCols": "\"timestamp\"",
"pipelines.numUpdateRetryAttempts": "7"
},
"target": "myrl"
}

Note: *** is information confidential.

The result sometimes is this:

But sometimes it works and complete de pipeline!!

Anyone has any idea? Thanks!!

Re: Delta Live Tables: BAD_REQUEST: Pipeline cluster is not reachable.

jorgemarmol — Thu, 17 Aug 2023 16:08:42 GMT

Hi @Retired_mod , thank you so much for your answer!!

Could you tell me how can I download the logs and what is the meaning of Standalone mode, please?I have download the logs from the cluster driver logs but I cant find the "FAILED_MESSAGE":

Thank you!!

topic Delta Live Tables: BAD_REQUEST: Pipeline cluster is not reachable. in Get Started Discussions

Delta Live Tables: BAD_REQUEST: Pipeline cluster is not reachable.

Re: Delta Live Tables: BAD_REQUEST: Pipeline cluster is not reachable.