hive执行sql:stage-1 map = 0 reduce = 0

2023年3月20日 510次阅读 来源: soycici

问题描述：
在hive shell中执行sql,如
insert into person_base1 select * from person_base;

运行日志中一直显示如下信息

hive> insert into person_base1 select * from person_base;
WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = root_20180824151434_b0b979fe-7a85-4ac6-b924-33dd40897a28
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_1535114415498_0379, Tracking URL = http://master:8088/proxy/application_1535114415498_0379/
Kill Command = /opt/hadoop-2.7.4/bin/hadoop job  -kill job_1535114415498_0379
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
2018-08-24 15:14:57,985 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:15:58,823 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:16:59,579 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:18:00,262 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:19:00,912 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:20:01,566 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:21:02,214 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:22:02,841 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:23:03,480 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:24:04,120 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:25:04,711 Stage-1 map = 0%,  reduce = 0%
2018-08-24 15:26:05,313 Stage-1 map = 0%,  reduce = 0%

解决方式:
修改yarn-site.xml中的yarn.nodemanager.resource.memory-mb值大小(2G->4G)
原先设置

<property>
      <name>yarn.nodemanager.resource.memory-mb</name>
      <value>2048</value>
</property>

修改后设置

<property>
      <name>yarn.nodemanager.resource.memory-mb</name>
      <value>4096</value>
</property>
    原文作者：soycici
    原文地址: https://www.jianshu.com/p/c6543b65cb77
    本文转自网络文章，转载此文章仅为分享知识，如有侵权，请联系博主进行删除。
点赞