apioli's dashboard

apioli replied on March 04, 2009 06:01 to the question "Space full???" in LUCI:

Yeah. Lemme know if you use cygwin and need help. Also, you can try compressing it and sending it to yourself using.

to create a compressed file type: tar -cz list_of_files > newFileName.tar.gz
to uncompress it type: tar -xzf newFileName.tar.gz

apioli replied on March 04, 2009 05:49 to the question "Space full???" in LUCI:

Oh, got it. Umm, not with winscp. But cygwin will work. Althought it might not be worth installing it and all that jazz...

apioli replied on March 04, 2009 05:46 to the question "Space full???" in LUCI:

You can use a program called "WinSCP"... or cygwin which is basically a unix emulator for windows.

Also, in unix just type, "tail -n 1000 filename > newFilename" where filename is the whole posting list, and newFilename is the name of the file where you want to store the last 1000 lines to

apioli replied on March 04, 2009 05:38 to the question "Space full???" in LUCI:

You can also copy them onto your local machine with scp and merge them there...

apioli replied on March 03, 2009 23:31 to the question "Jobs restarted?" in LUCI:

Is there any way we can put more resources into reducing? It seems like these tasks take the longest and are the hang ups...

apioli replied on March 03, 2009 21:45 to the question "Jobs restarted?" in LUCI:

You can change it in your main class. I think its how many tasks it will be broken into. If you change it, you might be disrupting the load balancing. One dude put 250, which I think will negatively impact all of us.

apioli asked a question in LUCI on March 03, 2009 17:45:

Jobs restarted?

Did hadoop die and have all the processes restarted? I went to bed around 2am with 100% mapping done, and 72% reducing done, and woke up to find 99% mapping and only 25% reducing done...

Also, trying to view the job's details for any running job is broken...

apioli replied on March 02, 2009 00:17 to the question "Server down?" in LUCI:

I killed that directory, and I still keep getting that error, any more ideas?

I'm pretty sure this is what's stopping my reduce from running...

apioli replied on March 02, 2009 00:12 to the question "Extension possible?" in LUCI:

Same here...

apioli replied on March 01, 2009 20:46 to the question "Server down?" in LUCI:

Looks like the jar errors are still happening, and mine hangs on reduce...are they related?

Also, I'm getting worried that I won't be able to finish the project on time, with all of the server errors we are having :-(

09/03/01 12:39:19 INFO mapred.JobClient: Task Id : attempt_200903011033_0025_r_000002_0, Status : FAILED
Error initializing attempt_200903011033_0025_r_000002_0:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid local directory for taskTracker/jobcache/job_200903011033_0025/jars
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:335)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:753)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1636)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:102)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1602)

apioli replied on March 01, 2009 08:55 to the question "not reducing?" in LUCI:

How long is it taking?

apioli replied on March 01, 2009 07:44 to the question "Wierd error" in LUCI:

k. I hope you're getting an A+ in this class Mitch

apioli replied on March 01, 2009 07:26 to the question "Wierd error" in LUCI:

We are having many of the same errors. We also get a lot of job failed errors, and I'm assuming it has to do with the hadoop cluster...

apioli replied on March 01, 2009 05:46 to the question "Is there an easy way to kill a hadoop job?" in LUCI:

ahh, thank you!!!

apioli reported a problem in LUCI on March 01, 2009 02:15:

The inf 141 website seems to be down...

http://www.ics.uci.edu/~djp3/classes/... Won't load...

apioli asked a question in LUCI on March 01, 2009 01:50:

Is there an easy way to kill a hadoop job?

I'm wondering if there is an easy way to to terminate a currently pending, or running hadoop job.

Any ideas?

apioli replied on March 01, 2009 00:04 to the question "Can't connect by ssh" in LUCI:

Maybe...I got into too... hopefully its all better now

apioli replied on February 28, 2009 23:59 to the question "Can't connect by ssh" in LUCI:

Yup, I get the same error. I hope this gets fixed soon....

apioli replied on February 28, 2009 23:42 to the question "Can't connect by ssh" in LUCI:

What exactly are you trying to connect to?

apioli replied on February 23, 2009 06:56 to the question "Login Exception" in LUCI:

FYI, the .bashrc file is in your home directory. To get there type "cd ~" and edit the .bashrc file with "nano .bashrc" or "vi .bashrc"