Showing results for 
Search instead for 
Did you mean: 
New Contributor III
since ‎03-07-2023

User Stats

  • 11 Posts
  • 0 Solutions
  • 4 Kudos given
  • 3 Kudos received

User Activity

As part of my batch processing I archive a large number of small files received from the source system each day using the command. This takes hours as moves the files one at a time.How can I speed this up?
When running spark under yarn each script has it's own self contained set of logs:- In databricks all I see if a list of jobs and stages that have been run on the cluster:- From a support perspective this is a nightmare.How can notebooks logs be grou...
I am using the delta format and occasionaly get the following error:-"xx.parquet referenced in the transaction log cannot be found. This occurs when data has been manually deleted from the file system rather than using the table `DELETE` statement"FS...
I have have started getting an error message when running the following optimize command:-deltaTable.optimize().executeCompaction()Error:-java.util.concurrent.ExecutionException: java.lang.IllegalStateException: Number of records changed after Optimi...
I have created a number of workflows in the Databricks UI. I now need to deploy them to a different workspace.How can I do that?Code can be deployed via Git, but the job definitions are stored in the workspace only.