Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-03-2025 12:37 AM
Hi @Freshman ,
By converting you datetime columns from AEST to UTC and storing as UTC you are following best practices.
This way you standardize the the time zone and avoid confusion, in case you will have more data from multiple time zones.
When you need to display the data in a local time zone (like AEST for end users), perform the conversion from UTC to the desired time zone in your reporting layer.
Additionally, as per documentation, Databricks does not have any datetime format that would contain the information about the time zone. You need to use TIMESTAMP, so converting to UTC before storing in silver is you safest bet.