Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-03-2025 12:39 AM
@Freshman wrote:Hello,
What is the best practice in Databricks for storing DateTime data in silver layer tables, considering the source data is in AEST and we store it in UTC by default?
Thanks
The best practice for storing DateTime data in the Silver layer of a Databricks data lake is to store it in UTC and include a separate column for the original timezone. This ensures data consistency and allows for accurate time zone conversions during analysis. Utilize Databricks SQL functions like from_utc_timestamp() and to_utc_timestamp() for efficient time zone handling.