MEMORY_ONLY not working

gpzz
New Contributor III

val doubledAmount = premiumCustomers.map(x=>(x._1, x._2*2)).persist(StorageLevel.MEMORY_ONLY)

error: not found: value StorageLevel

Chaitanya_Raju
Honored Contributor

Hi @Gaurav Poojary​ ,

Can you please try the below as displayed in the image it is working for me without any issues.

2Happy Learning!!

Thanks for reading and like if this is useful and for improvements or feedback please comment.

gpzz
New Contributor III

@Ratna Chaitanya Raju Bandaru​ 

how to convert to rdd before storing. I want to do some transformations

i am attaching the whole code

val input = sc.textFile("dbfs:/FileStore/shared_uploads/Recent9/customerorders.csv")

val mappedInput = input.map(x=>(x.split(",")(0), x.split(",")(2).toFloat))

val totalByCustomer = mappedInput.reduceByKey(_+_)

val premiumCustomers = totalByCustomer.filter(x => x._2 > 5000)

val doubledAmount = premiumCustomers.map(x=>(x._1, x._2*2)).persist(StorageLevel.MEMORY_ONLY)