Tuesday, January 28, 2020

Data Platform Tips 62 - Comparing Azure HDInsight cluster Storage options

When you plan to provision Storage for HDInsight clusters you have an option to select from 3 storage options.

a) Azure Storage
b) Azure Data Lake Storage Gen2
c) Azure Data Lake Storage Gen1

Account type Namespace Type Supported services Supported performance tiers Supported access tiers HDInsight Version Cluster type
Azure Data Lake Storage Gen2 General-purpose V2 Hierarchical (filesystem) Blob Standard Hot, Cool, Archive 3.6+ All
Azure Storage General-purpose V2 Object Blob Standard Hot, Cool, Archive 3.6+ All
Azure Storage General-purpose V1 Object Blob Standard N/A All All
Azure Storage Blob Storage** Object Block Blob Standard Hot, Cool, Archive All All
Azure Data Lake Storage Gen1 N/A Hierarchical (filesystem) N/A N/A N/A 3.6 Only All except HBase

No comments:

Post a Comment