cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
yanchr
New Contributor III
since ‎05-05-2026
Friday

User Stats

  • 5 Posts
  • 0 Solutions
  • 0 Kudos given
  • 3 Kudos received

User Activity

DLT pipeline cloning to another workspace.

Friday
I know about the clone API:<databricks-instance>/api/2.0/pipelines/<pipeline-id>/clonebut it only works within the same workspace.Is it possible to achieve the same result manually?As I understand:I can't choose where checkpoints are migrated to in U...

CHECKPOINT_RDD_BLOCK_ID_NOT_FOUND randomly appears

a month ago
[CHECKPOINT_RDD_BLOCK_ID_NOT_FOUND] Checkpoint block not found! Either the executor that originally checkpointed this partition is no longer alive, or the original RDD is unpersisted.After switching from reliable checkpoint() to localCheckpoint() to ...

foreachPartition

06-10-2026
Is there any difference between pyspark.RDD.foreachPartition vs pyspark.sql.DataFrame.foreachPartition under the hood? The PySpark documentation describes pyspark.sql.DataFrame.foreachPartition as "a shorthand for df.rdd.foreachPartition()"If DataFra...

Migrating external tables to managed tables from HMS to UC

05-05-2026
I think the easiest way to do that is to use DEEP CLONE. However, since the SET MANAGED approach was introduced in DBR 17, wouldn't it be better to first migrate the table as external and then convert it to managed using SET MANAGED? The Databricks a...