分类存档: Hive

java.net.ConnectException: to 0.0.0.0:10020 failed on connection exception

作者: Michael 日期: 2014 年 4 月 11 日没有评论 | 8,001 views

在DataNode节点中的Hive CLI中执行 select count(*) from table_name 查询时报错：

java.io.IOException: java.net.ConnectException: Call From Slave7.Hadoop/192.168.8.207 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
	at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:331)
	at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:416)
	at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:522)
	at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:183)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:580)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:578)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:416)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
	at org.apache.hadoop.mapred.JobClient.getJobUsingCluster(JobClient.java:578)
	at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:596)
	at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:288)
	at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:547)
	at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:426)
	at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:136)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1472)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1239)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1057)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:884)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:874)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:616)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

java.io.IOException: java.net.ConnectException: Call From Slave7.Hadoop/192.168.8.207 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:331)

at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:416)

at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:522)

at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:183)

at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:580)

at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:578)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:416)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)

at org.apache.hadoop.mapred.JobClient.getJobUsingCluster(JobClient.java:578)

at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:596)

at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:288)

at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:547)

at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:426)

at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:136)

at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)

at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)

at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1472)

at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1239)

at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1057)

at org.apache.hadoop.hive.ql.Driver.run(Driver.java:884)

at org.apache.hadoop.hive.ql.Driver.run(Driver.java:874)

at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)

at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)

at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)

at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:616)

at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

从[……]

Hive和HBase整合

作者: Michael 日期: 2014 年 4 月 4 日 3 条评论 | 3,329 views

本文主要描述Hive和HBase 环境整合配置的详细过程：

基本环境
整合配置
测试验证

[一]、基本环境

各设备对应的信息/角色/用途：

hostname[……]

HiveException:Not a host:port pair: PBUF

作者: Michael 日期: 2014 年 4 月 1 日 3 条评论 | 3,654 views

HBase和Hive整合后，在Hive shell中执行建表语句时错误信息如下：

14/03/28 16:41:59 ERROR exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException: Not a host:port pair: PBUF

Master.Hadoop��ظ׽�(
	at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:602)
	at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3661)
	at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:252)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:151)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:65)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1414)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1192)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1020)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: java.lang.IllegalArgumentException: Not a host:port pair: PBUF

14/03/28 16:41:59 ERROR exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException: Not a host:port pair: PBUF

Master.Hadoop��ظ׽�(

at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:602)

at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3661)

at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:252)

at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:151)

at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:65)

at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1414)

at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1192)

at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1020)

at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)

at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)

at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)

at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)

at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

Caused by: java.lang.IllegalArgumentException: Not a host:port pair: PBUF

一般这样的错误信息是由于：<HIVE_HO[……]

Hive自定义分隔符InputFormat

作者: Michael 日期: 2014 年 2 月 24 日 1 条评论 | 4,136 views

Hive默认创建的表字段分隔符为：\001(ctrl-A)，也可以通过 ROW FORMAT DELIMITED FIELDS TERMINATED BY 指定其他字符，但是该语法只支持单个字符，如果[……]

Hive教程之metastore的三种模式

作者: Michael 日期: 2014 年 2 月 20 日没有评论 | 19,644 views

Hive中metastore（元数据存储）的三种方式：

内嵌Derby方式
Local方式
Remote方式

[一]、内嵌Derby方式

这个是Hive默认的启动模式，一般[……]

Hive教程之DML数据导入导出

作者: Michael 日期: 2014 年 2 月 12 日没有评论 | 1,317 views

文章基本目录结构：

数据导入
- 导入本地文件
- 导入hdfs文件
数据导出
- 导出到新表
- 导出到本地文件
- 导出到hdfs文件

本文的测试基于Ha[……]

Hive教程之DDL+DML

作者: Michael 日期: 2014 年 2 月 11 日没有评论 | 1,336 views

在完成 Hive安装配置后自然而然就是它的基本应用，本文就基本操作进行一些演示：

DDL操作
DML操作

ps：Hive 依赖于Hadoop，当然在做基本操作之前确保Hadoop的[……]

Hive安装配置详解

作者: Michael 日期: 2014 年 2 月 10 日没有评论 | 9,610 views

本文主要是在Hadoop单机模式中演示Hive默认（嵌入式derby 模式）安装配置过程，目录结构如下：

基础环境
Hive安装配置
启动及演示

[一]、基础环境

Mac[……]

micmiu – 软件开发+生活点滴

分类存档: Hive

java.net.ConnectException: to 0.0.0.0:10020 failed on connection exception

Hive和HBase整合

HiveException:Not a host:port pair: PBUF

Hive自定义分隔符InputFormat

Hive教程之metastore的三种模式

Hive教程之DML数据导入导出

Hive教程之DDL+DML

Hive安装配置详解

近期文章

浏览

分类目录

文章归档

标签云(3D)

近期评论

技术链接

功能