@Atiquzzaman Ankur​  -- I think that this issue might be memory related. I think perhaps it happens when R tries to use more memory than is available to the Databricks cluster. Suggest monitoring the Ganglia UI just before you run a process that causes the crash. See if it 'tops out' the memory.