Saturday, November 21, 2015

Hadoop Installation and Map reduce execution

Take reference from site
http://www.srccodes.com/p/article/38/build-install-configure-run-apache-hadoop-2.2.0-microsoft-windows-os
for hadoop setup on window

start


c:\hadoop>sbin\start-dfs
c:\hadoop>sbin\start-yarn
starting yarn daemons

To execute map reduce

first make folder
execute following command
bin\hdfs dfs -mkdir /user

bin\hdfs dfs -mkdir /user/Dell

bin\hdfs dfs -mkdir /user/Dell/input

it will create user directory
/user/Dell/input

After that

load data on that directory /user/Dell/input

create folder c:/file/file1.txt
execute following command

bin\hdfs dfs -copyFromLocal c:/file/file1.txt /user/Dell/input


now execute bin\yarn jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar wordcount input output

Reference
http://www.srccodes.com/p/article/45/run-hadoop-wordcount-mapreduce-example-windows


localhost:50070/dfsnodelist.jsp
http://localhost:8088/cluster

No comments:

Post a Comment