Uploading Data into Databricks from CSV - Puts Amount column as a string
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-04-2023 11:56 AM
I am attempting in ingesting data into databricks via CSV, with the following statement below, this brings in my data looking perfect:
Although, the bad part is I have to group this data by summing highlighted amt field. Given it is string it spits out all kinds of nulls/0. I then try to change to integer I get the following, it seems as if any values with commas it nulls out (the sum should be displaying the amount of qty * UP):
What statements would be helpful in fixing my issue of being able to change this from string to integer without messing up any values?