In this article, you will learn how to create storage and Hadoop Cluster from Azure Management Portal.
Introduction This article will help you create the storage and Hadoop Cluster from Azure Management Portal. Go through my previous articles to understand in detail about Hadoop, HDInsight, and Hive queries in Azure.
What is Hadoop? Hadoop is a framework that helps in distributing the storage and distributed processing of very large datasets on Computer Clusters built from commodity hardware. What is HDInsight? HDInsight provides data storage concepts like HDFS (Hadoop Distributed File System) and a simple MapReduce programming model to process and analyze the data. Why do we need storage? Azure HDInsight works with Azure Storage to store the data. When we create an HDInsight cluster, we need to specify the storage account in which a specific blob container is used. But, the file system should be of HDFS (Hadoop Distributed File System). Follow the below steps to create a cluster and to create storage. Step 1 - Log into Azure new portal using www.portal.azure.com and click on New >> Data + Analytics >> HDInsight. Step 2 - Enter the Cluster Name, select Subscription, Cluster type, credentials, Data Source, pricing, and Resource group details. In my case, I will be entering the following details.
Azure Web Apps for Developers