hadoop任务运行错误之container is running beyond virtual memory limits

默认最简配置的单节点hadoop运行任务竟然出现“container is running beyond virtual memory limits”的错误

看错误是申请虚拟内存超出限制了，根据stackoverflow的指导，在yarn-site.xml添加下面的配置信息，然后重启hadoop然后再次运行任务就正常了

<name>yarn.nodemanager.vmem-check-enabled</name>

<value>false</value>

<description>Whether virtual memory limits will be enforced for containers</description>

</property>

<name>yarn.nodemanager.vmem-pmem-ratio</name>

<description>Ratio between virtual memory to physical memory when setting memory limits for containers</description>

</property>

粗略的感觉了hadoop，想要达到了解还需要继续学习啊...接下来要用三台虚拟机安装一个完整的HDFS

mowblog