Does Databricks support writing Geography/Geometry data into BigQuery?

[Prabakar]

Hi @Ayushi Pandey​ are you looking for Geomesa library support? If so please refer this notebook.

https://www.databricks.com/notebooks/geomesa-h3-notebook.html

[109005]

No, I want to know if Databricks supports writing Geography/Geometry data back into BigQuery? When I try to write it to BQ, it shows as incorrect BYTES data.

I performed the below statement and it ran successfully in Databricks:

val wktDF = wktDFText.withColumn("bq_geography", st_geomFromWKT(col("bq_geography"))).cache

 

But when loading this wktDF to BigQuery, data is seen like this:

[109005]

Do let me know if this is an expected behaviour since Spark does not natively support Geography/Geometry types.

[jnb2387 · Accepted solution]

The only method I have been able to successfully write in geography data was to have the table schema already defined with a geography column and then 'APPEND' the data to it. Anytime I would try with OVERWRITE it seemingly changed the data type to string.

[109005]

Thanks a lot! That worked 🙂