Hi! I have a SQL query that has a where-clause that checks a string attribute not being equal to e.g. 'シミュレータに接続されていません' (Japanese). This works fine when running the query in SQL Editor ad hoc, but creating a view with the same query, the special characters are converted to '?????' in hive_metastore looking at the view-details. How can I preserve the special characters in the view representation? Right now I've implemented a workaround with hex(encode(string_attribute)).

Running in Azure databricks environment with Spark 3.3.2