can you share what the *newtitanic* is I think that you would have done something similar

spark.sql("create table newtitanic as select * from titanic")

something like this works for me, but the issue is i first make a temp view then again create a table which would be persisted in memory.