Databricks

VVM · 06-16-2023

It appears to me that there's a deceptive bug when using the databricks display function and viewing struct data. For whatever reason, multiple spaces are cut down to only one:from pyspark.sql.functions import struct, col df = spark.createDataFrame...

VVM · 02-27-2023

It seems that due to how Databricks processes SQL cells, it's impossible to escape the $ when it comes to a column name.I would expect the following to work:%sql SELECT 'hi' `$id`The backticks ought to escape everything. And indeed that's exactly wha...

VVM · 06-19-2023

not so sure the community can help here as this appears to be a verifiable and reproducible Databricks bug?

VVM · 02-28-2023

Yes, this is in a Notebook. You can see below that it fails because both instances get detected as query snippets and swapped out with blank, so the query effectively becomes CREATE TABLE my_temp_table( `` int, `` string )

VVM · 02-28-2023

I want to build a table using the CREATE TABLE statement in Databricks SQL. But I can't name the column $id because `$id` does not work (in spite of Databricks' SHOW CREATE saying it should)I understand that I can probably work around this by swappin...

Databricks

User Stats

User Activity

Bug with display function with structs?

Databricks SQL - Unable to Escape Dollar Sign ($) in Column Name

Re: Bug with display function with structs?

Re: Databricks SQL - Unable to Escape Dollar Sign ($) in Column Name

Re: Databricks SQL - Unable to Escape Dollar Sign ($) in Column Name