BYR Achieve · 镜像论坛

eclipse里面已经配置过mr master端口6001，dfs端口6000，和hadoop的配置文件一致，为什么还一直连接默认的dfs8020端口？不改hadoop配置文件怎么解决这个问题？我在代码里加上conf.set("fs.default.name", "hdfs://10.103.244.246:6000"); 报错Exception in thread "main" java.io.IOException: Incomplete HDFS URI, no host: hdfs://10.103.244.246:6000 14/05/10 10:32:14 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 14/05/10 10:32:14 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 14/05/10 10:32:35 INFO hdfs.DFSClient: Exception in createBlockOutputStream java.net.ConnectException: Connection timed out: no further information 14/05/10 10:32:35 INFO hdfs.DFSClient: Abandoning block blk_8893743192517849946_182409 14/05/10 10:32:35 INFO hdfs.DFSClient: Waiting to find target node: 10.103.244.249:50010 14/05/10 10:32:43 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 0 time(s). 14/05/10 10:32:45 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 1 time(s). 14/05/10 10:32:47 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 2 time(s). 14/05/10 10:32:49 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 3 time(s). 14/05/10 10:32:51 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 4 time(s). 14/05/10 10:32:53 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 5 time(s). 14/05/10 10:32:55 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 6 time(s). 14/05/10 10:32:57 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 7 time(s). 14/05/10 10:32:59 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 8 time(s). 14/05/10 10:33:01 INFO ipc.Client: Retrying connect to server: /10.103.244.246:8020. Already tried 9 time(s). Exception in thread "main" java.net.ConnectException: Call to /10.103.244.246:8020 failed on connection exception: java.net.ConnectException: Connection refused: no further information at org.apache.hadoop.ipc.Client.wrapException(Client.java:767) at org.apache.hadoop.ipc.Client.call(Client.java:743) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) at $Proxy0.getProtocolVersion(Unknown Source) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359) at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175) at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:122) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:770) at org.apache.hadoop.mapreduce.Job.submit(Job.java:432) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447) at WordCount.main(WordCount.java:69) Caused by: java.net.ConnectException: Connection refused: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:701) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:304) at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:176) at org.apache.hadoop.ipc.Client.getConnection(Client.java:860) at org.apache.hadoop.ipc.Client.call(Client.java:720) ... 17 more

【小白求助】win下eclipse连接远程集群hadoop，报错8020端口连