<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Different result between manual and automated task run in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/different-result-between-manual-and-automated-task-run/m-p/70375#M34060</link>
    <description>&lt;DIV&gt;&lt;SPAN&gt;I have a notebook where I bring info about a previous task run metadata from the API ".... /jobs/runs/get". The response should be a dictionary that contains information such as&amp;nbsp;task key, run if,&amp;nbsp;run page URL etc.&amp;nbsp;&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;When I run the notebook as part of a scheduled ETL workflow the notebook failed with a key error that the&lt;SPAN class=""&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;SPAN class=""&gt;'&lt;/SPAN&gt;&lt;SPAN class=""&gt;result state&lt;/SPAN&gt;&lt;SPAN class=""&gt;' key was not found in the&amp;nbsp;'state' dictionary. However when I run it manually, the notebook didn't fail and the&amp;nbsp;'result state' key contained a valid value.&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&lt;SPAN class=""&gt;How is it possible to have different result between manual and automated task run? &lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&lt;SPAN class=""&gt;Is there any case that the state of the job or tasks might have been different when the notebook was executed automatically compared to when I ran it manually. For example, the job might have completed and populated all the expected keys by the time I ran it manually.&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/DIV&gt;</description>
    <pubDate>Thu, 23 May 2024 09:19:06 GMT</pubDate>
    <dc:creator>Harispap</dc:creator>
    <dc:date>2024-05-23T09:19:06Z</dc:date>
    <item>
      <title>Different result between manual and automated task run</title>
      <link>https://community.databricks.com/t5/data-engineering/different-result-between-manual-and-automated-task-run/m-p/70375#M34060</link>
      <description>&lt;DIV&gt;&lt;SPAN&gt;I have a notebook where I bring info about a previous task run metadata from the API ".... /jobs/runs/get". The response should be a dictionary that contains information such as&amp;nbsp;task key, run if,&amp;nbsp;run page URL etc.&amp;nbsp;&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;When I run the notebook as part of a scheduled ETL workflow the notebook failed with a key error that the&lt;SPAN class=""&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;SPAN class=""&gt;'&lt;/SPAN&gt;&lt;SPAN class=""&gt;result state&lt;/SPAN&gt;&lt;SPAN class=""&gt;' key was not found in the&amp;nbsp;'state' dictionary. However when I run it manually, the notebook didn't fail and the&amp;nbsp;'result state' key contained a valid value.&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&lt;SPAN class=""&gt;How is it possible to have different result between manual and automated task run? &lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&lt;SPAN class=""&gt;Is there any case that the state of the job or tasks might have been different when the notebook was executed automatically compared to when I ran it manually. For example, the job might have completed and populated all the expected keys by the time I ran it manually.&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/DIV&gt;</description>
      <pubDate>Thu, 23 May 2024 09:19:06 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/different-result-between-manual-and-automated-task-run/m-p/70375#M34060</guid>
      <dc:creator>Harispap</dc:creator>
      <dc:date>2024-05-23T09:19:06Z</dc:date>
    </item>
  </channel>
</rss>

