How to calculate correlation matrix (with all columns at once) in pyspark dataframe?

washim
New Contributor III
 

washim
New Contributor III

got it use -

features = dataset.map(lambda row: row[0:])

from pyspark.mllib.stat import Statistics

corr_mat=Statistics.corr(features, method="pearson")

View solution in original post