Sure, we now have collation support: https://www.databricks.com/blog/introducing-collations-databricksRef: https://docs.databricks.com/aws/en/sql/language-manual/sql-ref-collation
@dmytro yes, but this feature is currently in Private Preview. Please submit a support case in https://help.databricks.com/s/ if you have interest in trying out this new feature.
@skarpeck does your input df contain any filters? The empty codes variable could be due to empty microbatches maybe. Please check the numInputRows from your query's Stream Monitoring Metrics. I recommend you to check if there are input rows for the b...
@MarianoRanu SQL Collation support is now in private preview. If you have interest please reach out the Databricks team responsible for your company's account.
More details about release types: https://docs.databricks.com/en/release-notes/release-ty...