not reducing?
for some reason my job stops running after mapping.
the last line would be
09/03/01 00:28:34 INFO mapred.JobClient: map 100% reduce 0%
and nothing else happens. Does it have anything to do with the ICS servers being down?
the last line would be
09/03/01 00:28:34 INFO mapred.JobClient: map 100% reduce 0%
and nothing else happens. Does it have anything to do with the ICS servers being down?
1
person has this question
I have this question, too!
Tell me when someone answers.
The more people who ask this question, the more it gets noticed.
The more people who ask this question, the more it gets noticed.
Create a customer community for your own organization
Plans starting at $19/month
-
Inappropriate?How long is it taking?
-
Inappropriate?The cluster can only do 74 reduces at a time, so if there are 74 running, all the rest are queued.
-
Inappropriate?if you look at the processes, none of the jobs are reducing...only mapping
-
Inappropriate?There are 63 reduce processes running...
-
Inappropriate?i see.
-
Inappropriate?Now checking it out seems like a LOT of the jobs failed from last night......
-
Inappropriate?My bad. It appears the log file on palantir boomed to 42GB and killed the drive space.
-
Inappropriate?Ok, I am bringing the system back online. Give me a few mins
-
Inappropriate?Also make sure you are using the reporter.setstatus() function in your reduce function.
-
Inappropriate?My job stopped reducing at 44% just now it was on 100%map and 44% reduce... then it went to 99% map and is still on 44%reduce... apparently I lost the connection to palintir...
INFO ipc.Client: Retrying connect to server: palantir.ics.uci.edu/128.195.58.105:1751. Already tried 0 time(s).
09/03/02 14:02:39 INFO ipc.Client: Retrying connect to server: palantir.ics.uci.edu/128.195.58.105:1751. Already tried 1 time(s).
does anybody know if it will continue running or is it stuck? it hasn't moved for something like 30 minutes now...
I’m anxious
-
Inappropriate?My job stopped reducing at 44% just now it was on 100%map and 44% reduce... then it went to 99% map and is still on 44%reduce... apparently I lost the connection to palintir...
INFO ipc.Client: Retrying connect to server: palantir.ics.uci.edu/128.195.58.105:1751. Already tried 0 time(s).
09/03/02 14:02:39 INFO ipc.Client: Retrying connect to server: palantir.ics.uci.edu/128.195.58.105:1751. Already tried 1 time(s).
does anybody know if it will continue running or is it stuck? it hasn't moved for something like 30 minutes now...
I’m anxious
-
Inappropriate?I restarted the job tracker. Your task is still running, (but probably not in the window you have open).
Loading Profile...




EMPLOYEE