博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
ubuntu安装hadoop2.6
阅读量:4562 次
发布时间:2019-06-08

本文共 3444 字,大约阅读时间需要 11 分钟。

一:单机版

1.sudo gedit ~/.bashrc 加入JDK路径

#HADOOP VARIABLES START  export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-amd64export HADOOP_INSTALL=/home/sendi/hadoop-2.6.0 export PATH=$PATH:$HADOOP_INSTALL/bin  export PATH=$PATH:$HADOOP_INSTALL/sbin  export HADOOP_MAPRED_HOME=$HADOOP_INSTALL  export HADOOP_COMMON_HOME=$HADOOP_INSTALL  export HADOOP_HDFS_HOME=$HADOOP_INSTALL  export YARN_HOME=$HADOOP_INSTALL  export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native  export HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib"  #HADOOP VARIABLES END

ubantu下jdk路径可用如下命令取得:

update-alternatives --config java

2.执行下面命令使改动生效:

source ~/.bashrc

3.修改hadoop-env.sh的配置:

sudo gedit /usr/local/hadoop/etc/hadoop/hadoop-env.sh

找到JAVA_HOME改为:

/usr/lib/jvm/java-1.7.0-openjdk-amd64

 再在下面加上一行代码:

export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib:$HADOOP_PREFIX/lib/native"

二:伪分布式:

1.sudo gedit /usr/local/hadoop/etc/hadoop/core-site.xml

hadoop.tmp.dir
/home/sendi/hadoop-2.6.0/tmp
Abase for other temporary directories.
fs.defaultFS
hdfs://localhost:9000

2.sudo gedit /usr/local/hadoop/etc/hadoop/mapred-site.xm

mapred.job.tracker
localhost:9001

3.sudo gedit /usr/local/hadoop/etc/hadoop/yarn-site.xml

mapreduce.framework.name
yarn
yarn.nodemanager.aux-services
mapreduce_shuffle

4.sudo gedit /usr/local/hadoop/etc/hadoop/hdfs-site.xml

dfs.replication
1
dfs.namenode.name.dir
/home/sendi/hadoop-2.6.0/dfs/name
dfs.datanode.data.dir
/home/sendi/hadoop-2.6.0/dfs/data
dfs.permissions
false

 

5.sudo gedit /usr/local/hadoop/etc/hadoop/masters 添加:localhost

6.sudo gedit /usr/local/hadoop/etc/hadoop/slaves  添加:localhost

7.初始化文件系统HDFS

bin/hdfs namenode -format

8.启动,启动之后用下面链接查看结果

sbin/start-dfs.sh  sbin/start-yarn.sh ------------------------------------------------------------------------------------------------------------------------------------------- sendi@sendijia:~/hadoop-2.6.0$ sbin/start-dfs.sh Starting namenodes on [localhost] localhost: starting namenode, logging to /home/sendi/hadoop-2.6.0/logs/hadoop-sendi-namenode-sendijia.out localhost: starting datanode, logging to /home/sendi/hadoop-2.6.0/logs/hadoop-sendi-datanode-sendijia.out Starting secondary namenodes [0.0.0.0] 0.0.0.0: starting secondarynamenode, logging to /home/sendi/hadoop-2.6.0/logs/hadoop-sendi-secondarynamenode-sendijia.out sendi@sendijia:~/hadoop-2.6.0$ sbin/start-yarn.sh starting yarn daemons starting resourcemanager, logging to /home/sendi/hadoop-2.6.0/logs/yarn-sendi-resourcemanager-sendijia.out localhost: starting nodemanager, logging to /home/sendi/hadoop-2.6.0/logs/yarn-sendi-nodemanager-sendijia.out

转载于:https://www.cnblogs.com/aijianiula/p/4538180.html

你可能感兴趣的文章
【推荐系统篇】--推荐系统之训练模型
查看>>
Mysql篇--Linux中安装Mysql
查看>>
CSS3实现图片木桶布局
查看>>
Flask入门之Virtualvenv的安装及使用(windows)
查看>>
Coder-Strike 2014 - Finals (online edition, Div. 2) B. Start Up
查看>>
(转载)软件开发模式对比(瀑布、迭代、螺旋、敏捷)
查看>>
eclipse中AndroidA工程依赖B工程设置
查看>>
Oracle - 查询
查看>>
SVN入门教程
查看>>
angular2
查看>>
24点游戏 程序(二)
查看>>
linux ----> centos 网络、tomcat、vi、等等的配置和使用
查看>>
Hive导入数据
查看>>
【剑指offer】数值的整数次方
查看>>
CentOS 7 系统服务详解
查看>>
最小生成树------Kruskal算法
查看>>
手动构建镜像
查看>>
实际描述和固定描述的取值
查看>>
MyEclipse优化设置(最详细版本)
查看>>
Company & Corporation
查看>>