Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-10-2024 06:51 PM
Figured this out with the help of @SamDataWalk 's post https://community.databricks.com/t5/data-engineering/databricks-bug-with-show-tblproperties-redacted...
It happens because Databricks thinks certain keywords in the constrain query columns like "url" or "userid" are sensitive. You can disable this behavior with
spark.conf.set("spark.databricks.behaviorChange.SC102534CommandRedactProperties.enabled", False)