Loading Profile...
PIG nightly RPM builds
I will be very interested in nightly builds of PIG RPMS from PIG SVN. The last official release of PIG is quite old and most people use SVN version which have many improvements.
1
person has this question
I have this question, too!
Tell me when someone answers.
The more people who ask this question, the more it gets noticed.
The more people who ask this question, the more it gets noticed.
-
Inappropriate?Hey Vadim, this is a good suggestion. It's theoretically not that difficult, but we'd need to figure out how to make sure users can choose between "nightly" and "stable." We'd love for you to be able to get the nightly code with "yum update."
What is the current stable version of pig missing that you'd like to see? -
Inappropriate?released pig version does not support schemas - major new feature.
there are also many of other small and not-so-small improvements.
SVN version is fairly stable AFAIK and nearing release.
Maybe you can specail 'unstable' repository with PRM for bleeding
edge stuff like new PIG, or hadoop-19 RPS. Users like me can chose whenever to add this repository to their yum.conf. I believe RedHat does something like this for their unstable packages. -
Inappropriate?I also read that BZIP2 support was changed recently in SVN and it is recommended to us SVN version if you are using BZIP2 -compressed files.
-
Inappropriate?Vadim, would this stop you from using the rest of the Cloudera RPMs, or will you just manage Pig yourself until we come up with a solution for this?
-
Inappropriate?It would not stop me from using the rest of RPMs.
Please consider this "nice-to-have" request. -
Inappropriate?Vadim, glad to hear's it's a nice to have.
Also, we're a bit ashamed not to have a proper manifest to describe the differences, but it's coming.
And Bzip2 is in our release, but it wasn't enable by default. We're fixing this and you can get it with a YUM update soon. -
Inappropriate?Pig-types is much faster, useful and mature than the 1.1 release.
Pig itself is so new that in many ways the SVN is a more robust choice. I've been using a nightly from right after they landed the 'types' branch (Jan 13th), as I know they did a lot of QA in order to land that. You'll want to choose a later nightly to ensure 1.9 compatibility.
(This would not stop me from using the rest of the Cloudera RPMs -- I'd simply manage my own Pig).
I’m living on the edge
-
Inappropriate?Flip, can you provide a little more detail about the nightly you're using - enough info for us to grab it out of SVN? If we can verify compatibility and run it through our test harness, this sounds like it would be really useful for pig users.
Thanks! -
Inappropriate?I'm using
URL: http://svn.apache.org/repos/asf/hadoo...
Repository Root: http://svn.apache.org/repos/asf
Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
Revision: 734274
Last Changed Author: omalley
Last Changed Rev: 733924
Last Changed Date: 2009-01-12 16:04:29 -0600 (Mon, 12 Jan 2009)
It worksforme on my still-Hadoop 1.8 production cluster. As I mentioned, there's a patch which must be applied to ensure 1.9 compatibility.
A message to pig-user from Mar 13th says they plan to release 1.0.0 in "the next couple weeks" -- and looking at the commit log, perhaps days now -- so it might make more sense to start testing the about-to-be-stable latest rev.
I’m excited for 1.0
-
Inappropriate?Thanks Flip, we'll look into this.
EMPLOYEE
