Data Platform Tips 66 - Apache Hadoop components available with Azure HDInsight

Azure HDInsight supports multiple Hadoop cluster versions that can be deployed at any time.

The default cluster version used by Azure HDInsight is 3.6. The default version for the HDInsight service might change without notice.

If you have a version dependency, specify the HDInsight version when you create your clusters with the .NET SDK with Azure PowerShell and Azure Classic CLI.

You can use the Ambari REST API to check the Hadoop components and to verify which versions are being used for a cluster. Also, the GetComponentInformation command retrieves information about service components.

Component	HDInsight 4.0	HDInsight 3.6 (Default)
Apache Hadoop and YARN	3.1.1	2.7.3
Apache Tez	0.9.1	0.7.0
Apache Pig	0.16.0	0.16.0
Apache Hive	3.1.0	2.1.0, 1.2.1
Apache Tez Hive2	-	0.8.4
Apache Ranger	1.1.0	0.7.0
Apache HBase	2.0.2	1.1.2
Apache Sqoop	1.4.7	1.4.6
Apache Oozie	4.3.1	4.2.0
Apache Zookeeper	3.4.6	3.4.6
Apache Storm	-	1.1.0
Apache Mahout	-	0.9.0+
Apache Phoenix	5	4.7.0
Apache Spark	2.3.1, 2.4	2.3.0, 2.2.0, 2.1.0
Apache Livy	0.5	0.4, 0.4, 0.3
Apache Ambari	2.7.0	2.6.0
Apache Zeppelin	0.8.0	0.7.3
Mono	4.2.1	4.2.1