topic new input sources to a streaming job while retaining the old checkpoint ? in Data Engineering https://community.databricks.com/t5/data-engineering/new-input-sources-to-a-streaming-job-while-retaining-the-old/m-p/17916#M11834 <P>Hello Team, is there any way to add new input sources to a streaming job while retaining the old checkpoint ? I have seen -&nbsp;</P><P><I>Changes in the number or type (i.e. different source) of input sources</I></P><P>: This is not allowed</P><P>&nbsp;. Want to find out if there is any option to prevent processing data from old sources when an additional source gets added to the streaming job. Input sources are Delta tables in this case.</P> Mon, 28 Jun 2021 07:29:31 GMT User16826994223 2021-06-28T07:29:31Z new input sources to a streaming job while retaining the old checkpoint ? https://community.databricks.com/t5/data-engineering/new-input-sources-to-a-streaming-job-while-retaining-the-old/m-p/17916#M11834 <P>Hello Team, is there any way to add new input sources to a streaming job while retaining the old checkpoint ? I have seen -&nbsp;</P><P><I>Changes in the number or type (i.e. different source) of input sources</I></P><P>: This is not allowed</P><P>&nbsp;. Want to find out if there is any option to prevent processing data from old sources when an additional source gets added to the streaming job. Input sources are Delta tables in this case.</P> Mon, 28 Jun 2021 07:29:31 GMT https://community.databricks.com/t5/data-engineering/new-input-sources-to-a-streaming-job-while-retaining-the-old/m-p/17916#M11834 User16826994223 2021-06-28T07:29:31Z Re: new input sources to a streaming job while retaining the old checkpoint ? https://community.databricks.com/t5/data-engineering/new-input-sources-to-a-streaming-job-while-retaining-the-old/m-p/17917#M11835 <P>No you cannot do this, but often you can start a new checkpoint that starts from the same offsets the old one left off at:&nbsp;<A href="https://docs.databricks.com/delta/delta-streaming.html#specify-initial-position" alt="https://docs.databricks.com/delta/delta-streaming.html#specify-initial-position" target="_blank">https://docs.databricks.com/delta/delta-streaming.html#specify-initial-position</A></P> Mon, 28 Jun 2021 07:29:51 GMT https://community.databricks.com/t5/data-engineering/new-input-sources-to-a-streaming-job-while-retaining-the-old/m-p/17917#M11835 User16826994223 2021-06-28T07:29:51Z