<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Issue with visualizing dataframe from a job in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/issue-with-visualizing-dataframe-from-a-job/m-p/10291#M5502</link>
    <description>&lt;P&gt;Attaching some more screenshots to add more details.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;This seems to be a bug in the bar chart visualization widget when displaying from job run.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;&lt;/P&gt;</description>
    <pubDate>Thu, 02 Feb 2023 09:15:40 GMT</pubDate>
    <dc:creator>cristianc</dc:creator>
    <dc:date>2023-02-02T09:15:40Z</dc:date>
    <item>
      <title>Issue with visualizing dataframe from a job</title>
      <link>https://community.databricks.com/t5/data-engineering/issue-with-visualizing-dataframe-from-a-job/m-p/10289#M5500</link>
      <description>&lt;P&gt;Greetings,&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;I have the following data set:&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;```sql&lt;/P&gt;&lt;P&gt;SELECT * FROM (&lt;/P&gt;&lt;P&gt;  VALUES &lt;/P&gt;&lt;P&gt;    ('2023-02',113.81::decimal(27,2),'A','X'),&lt;/P&gt;&lt;P&gt;    ('2023-02',112.66::decimal(27,2),'A','Y'),&lt;/P&gt;&lt;P&gt;    ('2023-02',1223.8::decimal(27,2),'B','X'),&lt;/P&gt;&lt;P&gt;    ('2023-02',1234.56::decimal(27,2),'B','Y'),&lt;/P&gt;&lt;P&gt;    ('2023-01',12232.67::decimal(27,2),'B','X'),&lt;/P&gt;&lt;P&gt;    ('2023-01',1321.77::decimal(27,2),'A','X'),&lt;/P&gt;&lt;P&gt;    ('2023-01',12312.24::decimal(27,2),'A','Y'),&lt;/P&gt;&lt;P&gt;    ('2023-01',22221.66::decimal(27,2),'B','Y'),&lt;/P&gt;&lt;P&gt;    ('2022-12',121.89::decimal(27,2),'B','X'),&lt;/P&gt;&lt;P&gt;    ('2022-12',21231231.17::decimal(27,2),'A','X'),&lt;/P&gt;&lt;P&gt;    ('2022-12',12312.46::decimal(27,2),'A','Y'),&lt;/P&gt;&lt;P&gt;    ('2022-12',12312312.68::decimal(27,2),'B','Y'),&lt;/P&gt;&lt;P&gt;    ('2022-11',12122.88::decimal(27,2),'A','Y'),&lt;/P&gt;&lt;P&gt;    ('2022-11',122212.42::decimal(27,2),'B','Y'),&lt;/P&gt;&lt;P&gt;    ('2022-11',23123.68::decimal(27,2),'A','X'),&lt;/P&gt;&lt;P&gt;    ('2022-11',12312.26::decimal(27,2),'B','X'),&lt;/P&gt;&lt;P&gt;    ('2022-10',121.42::decimal(27,2),'B','Y'),&lt;/P&gt;&lt;P&gt;    ('2022-10',1231.9::decimal(27,2),'B','X'),&lt;/P&gt;&lt;P&gt;    ('2022-10',1231.98::decimal(27,2),'A','Y')&lt;/P&gt;&lt;P&gt;) test_table (test_date, test_value, test_type, test_cat)&lt;/P&gt;&lt;P&gt;```&lt;/P&gt;&lt;P&gt;The data set is actually coming from one our real life queries, but has values replaced with dummies.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;The issue seems to be when trying to create a bar chart that has "test_date" on the X axis and "test_value" with SUM on the Y axis.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;In the vizualization editor, in "interactive mode", the values don't show up, but they do in the cell once it is saved, however when running the notebook as a job the bar chart is also wrong, as it was in the editor before saving.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;The expected behavior is that the bar chart shows up in job mode as it does in interactive mode.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;This can be fixed by casting the "test_value" column type to float.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Thanks for letting me know if other information is required.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Regards,&lt;/P&gt;&lt;P&gt;Cristian&lt;/P&gt;</description>
      <pubDate>Wed, 01 Feb 2023 10:14:30 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/issue-with-visualizing-dataframe-from-a-job/m-p/10289#M5500</guid>
      <dc:creator>cristianc</dc:creator>
      <dc:date>2023-02-01T10:14:30Z</dc:date>
    </item>
    <item>
      <title>Re: Issue with visualizing dataframe from a job</title>
      <link>https://community.databricks.com/t5/data-engineering/issue-with-visualizing-dataframe-from-a-job/m-p/10290#M5501</link>
      <description>&lt;P&gt;Greetings,&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;This is interesting actually when I export to HTML the issue is not happening. &lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Sorry but this was a bit confusing, in the previous message the notebooks will not illustrate the problem because of this, therefore I have deleted that message to avoid confusion.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;It is only when looking at the results in the job run view as shown in the screenshot from attachment.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Regards,&lt;/P&gt;&lt;P&gt;Cristian&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;&lt;/P&gt;</description>
      <pubDate>Wed, 01 Feb 2023 12:45:22 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/issue-with-visualizing-dataframe-from-a-job/m-p/10290#M5501</guid>
      <dc:creator>cristianc</dc:creator>
      <dc:date>2023-02-01T12:45:22Z</dc:date>
    </item>
    <item>
      <title>Re: Issue with visualizing dataframe from a job</title>
      <link>https://community.databricks.com/t5/data-engineering/issue-with-visualizing-dataframe-from-a-job/m-p/10291#M5502</link>
      <description>&lt;P&gt;Attaching some more screenshots to add more details.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;This seems to be a bug in the bar chart visualization widget when displaying from job run.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;&lt;/P&gt;</description>
      <pubDate>Thu, 02 Feb 2023 09:15:40 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/issue-with-visualizing-dataframe-from-a-job/m-p/10291#M5502</guid>
      <dc:creator>cristianc</dc:creator>
      <dc:date>2023-02-02T09:15:40Z</dc:date>
    </item>
  </channel>
</rss>

