Apache Kafka is an open-source distributed streaming platform used to build real time pipelines. Kafka on HDInsight provides a Kafka as a managed, highly scalable, and highly available service in Azure.
In this post we will look at how to provision Azure HDInsight Kafka cluster using the Azure Portal.
a) Log on to the Azure Portal.
b) Search for HDInsight in the Azure Marketplace.
c) Select the Cluster type and in this case we are going to provision the "Kafka" Cluster.
d) Choose the storage type and in this case we are provisioning Azure Storage.
e) Once provisioned you can see the Azure Kafka Cluster and it provides functionality similar to a publish-subscribe message queue.