在CentOS中安装jdk1.7报错:
/var/tmp/rpm-tmp.wzG6RB: /usr/java/jdk1.7.0_75/bin/unpack200: /lib/ld-linux.s[……]
在CentOS中安装jdk1.7报错:
/var/tmp/rpm-tmp.wzG6RB: /usr/java/jdk1.7.0_75/bin/unpack200: /lib/ld-linux.s[……]
[一]、查看系统OpenJDK版本
1 2 3 4 |
# java -version java version "1.6.0_24" OpenJDK Runtime Environment (IcedTea6 1.11.1) (rhel-1.45.1.11.1.el6-x86_64) OpenJDK 64-Bit Server VM (build 20.0-b12, mixed mode) |
[二]、查询相关安装包详细信息
1 2 3 4 5 6 7 8 9 10 11 12 13 |
# rpm -qa | grep java tzdata-java-2012c-1.el6.noarch subversion-javahl-1.6.11-7.el6.x86_64 java-1.5.0-gcj-1.5.0.0-29.1.el6.x86_64 eclipse-mylyn-java-3.4.2-9.el6.x86_64 libvirt-java-0.4.7-1.el6.noarch libvirt-java-devel-0.4.7-1.el6.noarch java-1.6.0-openjdk-devel-1.6.0.0-1.45.1.11.1.el6.x86_64 lpg-java-compat-1.1.0-4.1.el6.noarch java-1.6.0-openjdk-1.6.0.0-1.45.1.11.1.el6.x86_64 ant-javamail-1.7.1-13.el6.x86_64 java-1.6.0-openjdk-javadoc-1.6.0.0-1.45.1.11.1.el6.x86_64 java_cup-0.10k-5.el6.x86_64 |
打开jdk官方下载的页面 :http://www.oracle.com/technetwork/java/javase/downloads/index.html ,找到你需要的对应版本下载链接,以li[……]
本文的主要目标是描述如何在IntelliJ IDEA 开发工具中导入Nutch源码(以Nutch2.x为例),配置实现Nutch的开发环境。
目录
[……]
下面演示的过程是基于目前 Nutch 2.2.1 自己编译配置的版本。
在编译后 bin目录下有两个脚本文件:nutch
和 crawl
,在命令行下执行各命令即可查看具体使用说明:
[cra[……]
Nutch 抓取时错误提示信息:
1 2 3 4 5 6 7 8 9 10 |
FetcherJob: starting FetcherJob: batchId: 1420598193-2940 Fetcher: No agents listed in 'http.agent.name' property. Exception in thread "main" java.lang.IllegalArgumentException: Fetcher: No agents listed in 'http.agent.name' property. at org.apache.nutch.fetcher.FetcherJob.checkConfiguration(FetcherJob.java:240) at org.apache.nutch.fetcher.FetcherJob.run(FetcherJob.java:152) at org.apache.nutch.fetcher.FetcherJob.fetch(FetcherJob.java:219) at org.apache.nutch.fetcher.FetcherJob.run(FetcherJob.java:301) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.nutch.fetcher.FetcherJob.main(FetcherJob.java:307) |
原因: 没有配置 http.agent.name
属性值
解决办法: 打开 $NUTCH_[......]
下载github上Nutch源码 2.x 分支 编译有错误信息:
1 2 3 4 |
[javac] /Users/micmiu/no_sync/opensource_code/nutch/nutch-src-github/src/plugin/indexer-elastic/src/java/org/apache/nutch/indexwriter/elastic/ElasticIndexWriter.java:111: cannot access java.lang.AutoCloseable [javac] class file for java.lang.AutoCloseable not found [javac] client = node.client(); [javac] ^ |
解决办法:
指定 jdk1.7+ 重新编译即可。
———[……]
Nutch 2.2.1 编译安装后,执行 nutch inject
命令后报错信息如下:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
micmiu@micmiu-mbp: ~/tmp/nutch $ nutch inject urls -crawlId micmiublog InjectorJob: starting at 2014-12-31 14:13:19 InjectorJob: Injecting urlDir: urls InjectorJob: org.apache.gora.util.GoraException: java.lang.RuntimeException: java.lang.IllegalArgumentException: Not a host:port pair: ?6460@micmiu-mbp.local192.168.1.100,62142,1420001742333 at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:167) at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:135) at org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:75) at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:221) at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:251) at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:273) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:282) Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Not a host:port pair: ?6460@micmiu-mbp.local192.168.1.100,62142,1420001742333 at org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore.java:127) at org.apache.gora.store.DataStoreFactory.initializeDataStore(DataStoreFactory.java:102) at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:161) ... 7 more Caused by: java.lang.IllegalArgumentException: Not a host:port pair: ?6460@micmiu-mbp.local192.168.1.100,62142,1420001742333 at org.apache.hadoop.hbase.HServerAddress.<init>(HServerAddress.java:60) at org.apache.hadoop.hbase.MasterAddressTracker.getMasterAddress(MasterAddressTracker.java:63) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:354) at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:94) at org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore.java:109) ... 9 more |
一般这样的错误信息是由于 $NUTCH_[......]
近期评论