topic Re: How to convert Data Chr Strings to Date Strings in Data Engineering

How to convert Data Chr Strings to Date Strings

Jeff1 — Mon, 28 Feb 2022 19:03:40 GMT

Databricks Community

New to Databricks and work in R code. I have a data from with a date field that is a chr string and need to convert to a date field. Tried the standard as.Date(x, format = "%Y-%m-%d") , then tried the dplyr::mutate function and that errored out to. So how does one convert chr date strings to a Date string.

Re: How to convert Data Chr Strings to Date Strings

Hubert-Dudek — Tue, 01 Mar 2022 10:16:46 GMT

you can use universal sql syntax with R dataframes

df <- read.df(path = "/tmp/df.avro", source = "com.databricks.spark.avro")
createOrReplaceTempView(dfView, "df")
species <- sql("SELECT TO_DATE(string_date, 'dd/MM/yy') FROM dfView")

Re: How to convert Data Chr Strings to Date Strings

Jeff1 — Tue, 01 Mar 2022 19:32:53 GMT

Well that was certainly helpful - thank you

Re: How to convert Data Chr Strings to Date Strings

Jeff1 — Fri, 04 Mar 2022 14:34:01 GMT

Based upon the initial response I went with:

my_data.frame <- my_data.frame %>%

mutate(date = to_date(data.frame_variable, "yyyy-mm-dd"))