cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Michael_Appiah
Contributor
since ‎08-23-2023
2 weeks ago

User Stats

  • 15 Posts
  • 0 Solutions
  • 3 Kudos given
  • 6 Kudos received

User Activity

Delta Tables: Time-To-Live

11-27-2024
I have seen somewhere (might have been in a Databricks Tech Talk) a Delta Table feature which allows to specify the "expiration date" of data stored in Delta Tables. Once rows surpass their time-to-live, they are automatically deleted or archived. Do...

Granting Permission on Notification Destinations

08-22-2024
We are trying to add Slack as a "Notification destination" under "Workspace Settings" in our Databricks workspace.However, there is no option to actually grant permission on that destination to define who gets to actually use that destination. This i...

Display Limits Catalog Explorer

01-22-2024
It seems as if the Catalog Explorer can only display a maximum of 1000 folders within a UC Volume. I just ran into this issue when I added new folders to a volume which were not displayed in the Catalog Explorer (only folders 1-1000). I was able to r...

Parameterized spark.sql() not working

01-05-2024
Spark 3.4 introduced parameterized SQL queries and Databricks also discussed this new functionality in a recent blog post (https://www.databricks.com/blog/parameterized-queries-pyspark)Problem: I cannot run any of the examples provided in the PySpark...

Hashing Functions in PySpark

10-14-2023
Hashes are commonly used in SCD2 merges to determine whether data has changed by comparing the hashes of the new rows in the source with the hashes of the existing rows in the target table. PySpark offers multiple different hashing functions like:MD5...