cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to get the DBR version details on a HC Cluster

User16869510359
Esteemed Contributor
 
1 ACCEPTED SOLUTION

Accepted Solutions

User16869510359
Esteemed Contributor

The below code snippet can be used to get the DBR details on a HC cluster

print("hadoopVersion:" + sc._gateway.jvm.org.apache.hadoop.util.VersionInfo.getVersion())
print("baseVersion:" + sc._gateway.jvm.org.apache.spark.BuildInfo.sparkBranch())
print("baseSha" +sc._gateway.jvm.org.apache.spark.BuildInfo.apacheBase())
print("dbrSha:"+ sc._gateway.jvm.org.apache.spark.BuildInfo.gitHash())

View solution in original post

1 REPLY 1

User16869510359
Esteemed Contributor

The below code snippet can be used to get the DBR details on a HC cluster

print("hadoopVersion:" + sc._gateway.jvm.org.apache.hadoop.util.VersionInfo.getVersion())
print("baseVersion:" + sc._gateway.jvm.org.apache.spark.BuildInfo.sparkBranch())
print("baseSha" +sc._gateway.jvm.org.apache.spark.BuildInfo.apacheBase())
print("dbrSha:"+ sc._gateway.jvm.org.apache.spark.BuildInfo.gitHash())

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.