<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: pipeline config DAB in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/pipeline-config-dab/m-p/154378#M54092</link>
    <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/226577"&gt;@prakharsachan&lt;/a&gt;&amp;nbsp;,&lt;/P&gt;&lt;P class=""&gt;&lt;STRONG&gt;Continuous&lt;/STRONG&gt; must be set inside the pipeline resource definition&lt;STRONG&gt;,&lt;/STRONG&gt;&amp;nbsp;not under &lt;STRONG&gt;configuration.&lt;/STRONG&gt;&lt;/P&gt;&lt;P class=""&gt;The &lt;STRONG&gt;configuration&lt;/STRONG&gt; block in a SDP (former DLT) pipeline definition is for Spark/pipeline &lt;EM&gt;settings&lt;/EM&gt; (key-value string pairs passed to the runtime), not for pipeline deployment properties. So if you have something like:&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="szymon_dybczak_1-1776108303813.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/25960iB94543834365E39F/image-size/medium?v=v2&amp;amp;px=400" role="button" title="szymon_dybczak_1-1776108303813.png" alt="szymon_dybczak_1-1776108303813.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Databricks will just ignore it as an unrecognized Spark config. The fix is to promote &lt;STRONG&gt;continuous&lt;/STRONG&gt;&amp;nbsp;to a top-level property of the pipeline resource:&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="szymon_dybczak_0-1776108283652.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/25959i8B2F80D72F4EA4EA/image-size/medium?v=v2&amp;amp;px=400" role="button" title="szymon_dybczak_0-1776108283652.png" alt="szymon_dybczak_0-1776108283652.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Mon, 13 Apr 2026 19:25:28 GMT</pubDate>
    <dc:creator>szymon_dybczak</dc:creator>
    <dc:date>2026-04-13T19:25:28Z</dc:date>
    <item>
      <title>pipeline config DAB</title>
      <link>https://community.databricks.com/t5/data-engineering/pipeline-config-dab/m-p/154373#M54090</link>
      <description>&lt;P&gt;I am deploying DLT pipeline in dev environment using DABs. source code is in a python script file. In the pipeline's yml file the configuration key is set to true(with all correct indentations), yet the pipeline isnt deploying in the continuous mode. Whats the reason?&lt;/P&gt;</description>
      <pubDate>Mon, 13 Apr 2026 19:02:52 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/pipeline-config-dab/m-p/154373#M54090</guid>
      <dc:creator>prakharsachan</dc:creator>
      <dc:date>2026-04-13T19:02:52Z</dc:date>
    </item>
    <item>
      <title>Re: pipeline config DAB</title>
      <link>https://community.databricks.com/t5/data-engineering/pipeline-config-dab/m-p/154378#M54092</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/226577"&gt;@prakharsachan&lt;/a&gt;&amp;nbsp;,&lt;/P&gt;&lt;P class=""&gt;&lt;STRONG&gt;Continuous&lt;/STRONG&gt; must be set inside the pipeline resource definition&lt;STRONG&gt;,&lt;/STRONG&gt;&amp;nbsp;not under &lt;STRONG&gt;configuration.&lt;/STRONG&gt;&lt;/P&gt;&lt;P class=""&gt;The &lt;STRONG&gt;configuration&lt;/STRONG&gt; block in a SDP (former DLT) pipeline definition is for Spark/pipeline &lt;EM&gt;settings&lt;/EM&gt; (key-value string pairs passed to the runtime), not for pipeline deployment properties. So if you have something like:&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="szymon_dybczak_1-1776108303813.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/25960iB94543834365E39F/image-size/medium?v=v2&amp;amp;px=400" role="button" title="szymon_dybczak_1-1776108303813.png" alt="szymon_dybczak_1-1776108303813.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Databricks will just ignore it as an unrecognized Spark config. The fix is to promote &lt;STRONG&gt;continuous&lt;/STRONG&gt;&amp;nbsp;to a top-level property of the pipeline resource:&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="szymon_dybczak_0-1776108283652.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/25959i8B2F80D72F4EA4EA/image-size/medium?v=v2&amp;amp;px=400" role="button" title="szymon_dybczak_0-1776108283652.png" alt="szymon_dybczak_0-1776108283652.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Mon, 13 Apr 2026 19:25:28 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/pipeline-config-dab/m-p/154378#M54092</guid>
      <dc:creator>szymon_dybczak</dc:creator>
      <dc:date>2026-04-13T19:25:28Z</dc:date>
    </item>
  </channel>
</rss>

