Loading Profile...
Can't connect to the DFS
I'm having trouble with the HDFS. I followed all the instructions in the wiki but apparently can connect to the hdfs. I get the following error when I try to copy the conf from my local machine to the dfs.
$ bin/hadoop dfs -copyFromLocal conf input
09/02/15 21:19:53 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 0 time(s).
09/02/15 21:19:54 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 1 time(s).
09/02/15 21:19:55 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 2 time(s).
09/02/15 21:19:56 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 3 time(s).
09/02/15 21:19:57 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 4 time(s).
09/02/15 21:19:58 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 5 time(s).
09/02/15 21:19:59 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 6 time(s).
09/02/15 21:20:00 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 7 time(s).
09/02/15 21:20:01 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 8 time(s).
09/02/15 21:20:02 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 9 time(s).
Bad connection to FS. command aborted.
I also tried bin/hadoop dfs -help
and got the same error.
The only part of the Wiki where I had trouble was when I had allow login without password. The authorized_key file did not exist and I had to make it.
Does anybody know what the error means? or how to fix it?
Thanks!
Juan
$ bin/hadoop dfs -copyFromLocal conf input
09/02/15 21:19:53 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 0 time(s).
09/02/15 21:19:54 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 1 time(s).
09/02/15 21:19:55 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 2 time(s).
09/02/15 21:19:56 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 3 time(s).
09/02/15 21:19:57 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 4 time(s).
09/02/15 21:19:58 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 5 time(s).
09/02/15 21:19:59 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 6 time(s).
09/02/15 21:20:00 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 7 time(s).
09/02/15 21:20:01 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 8 time(s).
09/02/15 21:20:02 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:58273. Already tried 9 time(s).
Bad connection to FS. command aborted.
I also tried bin/hadoop dfs -help
and got the same error.
The only part of the Wiki where I had trouble was when I had allow login without password. The authorized_key file did not exist and I had to make it.
Does anybody know what the error means? or how to fix it?
Thanks!
Juan
I’m frustrated
3
people have this question
I have this question, too!
Tell me when someone answers.
The more people who ask this question, the more it gets noticed.
The more people who ask this question, the more it gets noticed.
Create a customer community for your own organization
Plans starting at $19/month
-
-
Inappropriate?I encountered the same problem on family-guy so i switched over to the simpsons and when i try to set up the dfs i get a host verification failed error. any solutions?
I’m sadd
-
Inappropriate?When I had this happen it was because input already existed.
Try "bin/hadoop dfs -rmr input" to blow it away
Then try again.
Also make sure you don't leave a machine without running stop-all so that processes aren't randomly left running.
-
Inappropriate?the fact that the authorized_key file did not already exist is okay.
You may have some port contention issues with someone else running on the same machines. I'm going to upgrade the wiki to try and give some more guidance to navigating these problems.
-
Inappropriate?I changed machines and it worked. I also tried again today and it worked on the same computer it didn't work last time :)
I'm guessing port problem right?
I’m unconcerned
-
Inappropriate?Maybe.... check out the updated configuration file here:
https://eee.uci.edu/wiki/index.php/IN...
We added some additional port information to help deconflict with other users on the same machine. Hadoop usually does this automatically, but some people have found that manually setting the other ports helps.
I’m confident
-
EMPLOYEE
