Apache Sorl
by gil
hi
is almost ready
if some one can take these reviews
# https://bugzilla.redhat.com/show_bug.cgi?id=1002154
BuildRequires: mvn(com.spatial4j:spatial4j)
BuildRequires: mvn(commons-cli:commons-cli)
BuildRequires: mvn(commons-codec:commons-codec)
BuildRequires: mvn(commons-fileupload:commons-fileupload)
BuildRequires: mvn(commons-io:commons-io)
BuildRequires: mvn(commons-lang:commons-lang)
BuildRequires: mvn(jakarta-regexp:jakarta-regexp)
BuildRequires: mvn(javax.mail:mail)
BuildRequires: mvn(javax.servlet:servlet-api)
BuildRequires: mvn(joda-time:joda-time)
BuildRequires: mvn(net.sourceforge.nekohtml:nekohtml)
BuildRequires: mvn(org.apache.commons:commons-compress)
BuildRequires: mvn(org.apache.httpcomponents:httpclient)
BuildRequires: mvn(org.apache.httpcomponents:httpmime)
BuildRequires: mvn(org.apache.tika:tika-parsers)
BuildRequires: mvn(org.apache.velocity:velocity)
BuildRequires: mvn(org.apache.velocity:velocity-tools)
BuildRequires: mvn(org.apache.zookeeper:zookeeper)
# https://bugzilla.redhat.com/show_bug.cgi?id=1002170
BuildRequires: mvn(org.carrot2:morfologik-polish)
BuildRequires: mvn(org.codehaus.woodstox:woodstox-core-asl)
BuildRequires: mvn(org.eclipse.jetty:jetty-server)
BuildRequires: mvn(org.eclipse.jetty:jetty-servlet)
BuildRequires: mvn(org.eclipse.jetty:jetty-util)
BuildRequires: mvn(org.eclipse.jetty:jetty-webapp)
# https://bugzilla.redhat.com/show_bug.cgi?id=1005930
BuildRequires: mvn(org.noggit:noggit)
# https://bugzilla.redhat.com/show_bug.cgi?id=1005904
10 years, 8 months
Re: build break help
by Peter MacKinnon
Hmmm...and it's still failing?
Tim, Rob: did zk-java somehow drift?
\Pete
On 10/18/2013 11:01 AM, Amir Sanjar wrote:
>
> Thanks Peter, i had installed zookeer from f20 yum repository, is
> there a different ZK i have to use?
>
> [xxxx@localhost hadoop-common]$ rpm -ql zookeeper-java
> /usr/share/doc/zookeeper-java
> /usr/share/doc/zookeeper-java/CHANGES.txt
> /usr/share/doc/zookeeper-java/LICENSE.txt
> /usr/share/doc/zookeeper-java/NOTICE.txt
> /usr/share/doc/zookeeper-java/README.txt
> /usr/share/java/zookeeper
> /usr/share/java/zookeeper/zookeeper-ZooInspector.jar
> /usr/share/java/zookeeper/zookeeper-test.jar
> /usr/share/java/zookeeper/zookeeper.jar
> /usr/share/maven-fragments/zookeeper
> /usr/share/maven-poms/JPP.zookeeper-zookeeper-ZooInspector.pom
> /usr/share/maven-poms/JPP.zookeeper-zookeeper-test.pom
> /usr/share/maven-poms/JPP.zookeeper-zookeeper.pom
>
> [xxxx@localhost hadoop-common]$ rpm -qa | grep zookeeper
> zookeeper-java-3.4.5-12.fc20.noarch
>
> Best Regards
> Amir Sanjar
>
> PowerLinux Open Source Hadoop Architect
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>
>
>
> Inactive hide details for Peter MacKinnon ---10/15/2013 08:14:30
> AM---On 10/15/2013 08:58 AM, Amir Sanjar wrote: >Peter MacKinnon
> ---10/15/2013 08:14:30 AM---On 10/15/2013 08:58 AM, Amir Sanjar wrote: >
>
> From: Peter MacKinnon <pmackinn(a)redhat.com>
> To: Amir Sanjar/Austin/IBM@IBMUS
> Date: 10/15/2013 08:14 AM
> Subject: Re: build break help
>
> ------------------------------------------------------------------------
>
>
>
> On 10/15/2013 08:58 AM, Amir Sanjar wrote:
>
>
> thanks peter, that fix my issue. However I get a new error further
> down the build process, I have already installed zookeeper 3.4.5
> (not sure if it includes zookeeper-test.jar):
> [ERROR] Failed to execute goal on project hadoop-common: Could not
> resolve dependencies for project
> org.apache.hadoop:hadoop-common:jar:2.0.5-alpha: Cannot access
> apache.snapshots.https
> (_https://repository.apache.org/content/repositories/snapshots_)
> in offline mode and the artifact
> org.apache.zookeeper:zookeeper-test:jar:tests:3.4.5 has not been
> downloaded from it before. -> [Help 1]
>
>
>
> Please make sure you have the zookeeper-java package from Fedora
> installed.
>
> $ rpm -ql zookeeper-java
> /usr/share/doc/zookeeper-java-3.4.5
> /usr/share/doc/zookeeper-java-3.4.5/CHANGES.txt
> /usr/share/doc/zookeeper-java-3.4.5/LICENSE.txt
> /usr/share/doc/zookeeper-java-3.4.5/NOTICE.txt
> /usr/share/doc/zookeeper-java-3.4.5/README.txt
> /usr/share/java/zookeeper/zookeeper-ZooInspector.jar*
> /usr/share/java/zookeeper/zookeeper-test.jar*
> /usr/share/java/zookeeper/zookeeper.jar
> /usr/share/maven-fragments/zookeeper
> /usr/share/maven-poms/JPP.zookeeper-zookeeper-ZooInspector.pom
> /usr/share/maven-poms/JPP.zookeeper-zookeeper-test.pom
> /usr/share/maven-poms/JPP.zookeeper-zookeeper.pom
>
>
>
> Best Regards
> Amir Sanjar
>
> PowerLinux Open Source Hadoop Architect
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>
>
>
> Inactive hide details for Peter MacKinnon ---10/15/2013 06:07:04
> AM---On 10/14/2013 09:39 PM, Amir Sanjar wrote: >Peter MacKinnon
> ---10/15/2013 06:07:04 AM---On 10/14/2013 09:39 PM, Amir Sanjar
> wrote: >
>
> From: Peter MacKinnon _<pmackinn(a)redhat.com>_
> <mailto:pmackinn@redhat.com>
> To: Fedora Big Data SIG _<bigdata(a)lists.fedoraproject.org>_
> <mailto:bigdata@lists.fedoraproject.org>
> Cc: Amir Sanjar/Austin/IBM@IBMUS
> Date: 10/15/2013 06:07 AM
> Subject: Re: build break help
> ------------------------------------------------------------------------
>
>
>
> On 10/14/2013 09:39 PM, Amir Sanjar wrote:
>
> Following below instructions listed at Test Suite section at
> _https://fedoraproject.org/wiki/Changes/Hadoop#Test_suite_*
>
> Test suite *
> In order to /attempt/ to run any part of the test suite, you
> must first build the components (F18,F19):
>
> 1. git clone
> _git://github.com/fedora-bigdata/hadoop-common.git_
> 2. cd hadoop-common
> 3. git checkout -b fedora-2.0.5-alpha-test
> origin/fedora-2.0.5-alpha-test
> Sorry, Amir. We have a newer branch for test and integration. Try
> using git checkout -b fedora19-2.0.5-alpha-test
> origin/fedora19-2.0.5-alpha-test
>
> I'll update the wiki page.
>
> \Pete
> 4. mvn-rpmbuild -Pdist,native -DskipTest -DskipTests -DskipIT
> install
> I get following errors (in red), any help in advance would be
> appreciated .
>
> [ERROR]
> /home/sanjar/development/hadoop/fedora/release-2.0.5/hadoop-common/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[98,30]
> cannot find symbol
> symbol: method setHost(java.lang.String)
> location: interface org.eclipse.jetty.server.Connector
> [ERROR]
> /home/sanjar/development/hadoop/fedora/release-2.0.5/hadoop-common/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[99,30]
> cannot find symbol
> symbol: method setPort(int)
> location: interface org.eclipse.jetty.server.Connector
> [INFO] 2 errors
> [INFO]
> -------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Hadoop Main ................................
> SUCCESS [4.908s]
> [INFO] Apache Hadoop Project POM .........................
> SUCCESS [2.963s]
> [INFO] Apache Hadoop Annotations .........................
> SUCCESS [6.105s]
> [INFO] Apache Hadoop Assemblies ..........................
> SUCCESS [0.385s]
> [INFO] Apache Hadoop Project Dist POM ....................
> SUCCESS [2.299s]
> [INFO] Apache Hadoop Maven Plugins .......................
> SUCCESS [6.384s]
> [INFO] Apache Hadoop Auth ................................
> FAILURE [3.240s]
> [INFO] Apache Hadoop Auth Examples ....................... SKIPPED
>
> Best Regards
> Amir Sanjar
>
> PowerLinux Open Source Hadoop Architect
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>
>
>
> _______________________________________________
> bigdata mailing list_
> __bigdata(a)lists.fedoraproject.org_
> <mailto:bigdata@lists.fedoraproject.org>_
> __https://admin.fedoraproject.org/mailman/listinfo/bigdata_
>
> --
> Peter MacKinnon
> MRG Grid/Big Data
> Red Hat Inc.
> Raleigh, NC
>
>
>
> --
> Peter MacKinnon
> MRG Grid/Big Data
> Red Hat Inc.
> Raleigh, NC
>
--
Peter MacKinnon
MRG Grid/Big Data
Red Hat Inc.
Raleigh, NC
10 years, 8 months
Fwd: Re: [VOTE] Release Apache Hadoop 2.2.0
by Matthew Farrellee
FYI
-------- Original Message --------
Subject: Re: [VOTE] Release Apache Hadoop 2.2.0
Date: Tue, 15 Oct 2013 21:35:06 -0700
From: Arun C Murthy <acm(a)hortonworks.com>
Reply-To: common-dev(a)hadoop.apache.org
To: common-dev(a)hadoop.apache.org <common-dev(a)hadoop.apache.org>,
hdfs-dev(a)hadoop.apache.org <hdfs-dev(a)hadoop.apache.org>,
yarn-dev(a)hadoop.apache.org <yarn-dev(a)hadoop.apache.org>,
mapreduce-dev(a)hadoop.apache.org <mapreduce-dev(a)hadoop.apache.org>
With 31 +1s (15 binding) and no -1s the vote passes.
Congratulations to all, Hadoop 2 is now GA!
thanks,
Arun
On Oct 7, 2013, at 12:00 AM, Arun C Murthy <acm(a)hortonworks.com> wrote:
> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.2.0 that I would like to get released - this release fixes a small number of bugs and some protocol/api issues which should ensure they are now stable and will not change in hadoop-2.x.
>
> The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.2.0-rc0
> The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.2.0-rc0
>
> The maven artifacts are available via repository.apache.org.
>
> Please try the release and vote; the vote will run for the usual 7 days.
>
> thanks,
> Arun
>
> P.S.: Thanks to Colin, Andrew, Daryn, Chris and others for helping nail down the symlinks-related issues. I'll release note the fact that we have disabled it in 2.2. Also, thanks to Vinod for some heavy-lifting on the YARN side in the last couple of weeks.
>
>
>
>
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
10 years, 8 months
build break help
by Amir Sanjar
Following below instructions listed at Test Suite section at
https://fedoraproject.org/wiki/Changes/Hadoop#Test_suite
Test suite
In order to attempt to run any part of the test suite, you must first build
the components (F18,F19):
1. git clone git://github.com/fedora-bigdata/hadoop-common.git
2. cd hadoop-common
3. git checkout -b fedora-2.0.5-alpha-test
origin/fedora-2.0.5-alpha-test
4. mvn-rpmbuild -Pdist,native -DskipTest -DskipTests -DskipIT install
I get following errors (in red), any help in advance would be appreciated .
[ERROR] /home/sanjar/development/hadoop/fedora/release-2.0.5/hadoop-common/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[98,30]
cannot find symbol
symbol: method setHost(java.lang.String)
location: interface org.eclipse.jetty.server.Connector
[ERROR] /home/sanjar/development/hadoop/fedora/release-2.0.5/hadoop-common/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[99,30]
cannot find symbol
symbol: method setPort(int)
location: interface org.eclipse.jetty.server.Connector
[INFO] 2 errors
[INFO] -------------------------------------------------------------
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [4.908s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [2.963s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [6.105s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.385s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [2.299s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [6.384s]
[INFO] Apache Hadoop Auth ................................ FAILURE [3.240s]
[INFO] Apache Hadoop Auth Examples ....................... SKIPPED
Best Regards
Amir Sanjar
PowerLinux Open Source Hadoop Architect
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
10 years, 8 months
thrift 0.9.1 now available in testing
by Will Benton
Thrift 0.9.1 is now available for f19, f20, and rawhide. Please let me know about your experiences using it in various ecosystem projects. Lots of thanks are due to Gil for a thorough review and some great advice along the way!
best,
wb
----- Forwarded Message -----
> From: "Fedora Koji Build System" <buildsys(a)fedoraproject.org>
> To: willb(a)fedoraproject.org
> Sent: Monday, October 14, 2013 1:29:38 PM
> Subject: thrift-0.9.1-7.fc20 successfully tagged into f20-updates-testing-pending by bodhi
>
> Package: thrift
> NVR: thrift-0.9.1-7.fc20
> User: bodhi
> Status: complete
> Tag Operation: tagged
> Into Tag: f20-updates-testing-pending
>
> thrift-0.9.1-7.fc20 successfully tagged into f20-updates-testing-pending by
> bodhi
>
>
10 years, 8 months
Scala updates and a call for participation
by Will Benton
Friends,
The Scala package has been broken in Fedora for F19 and up for some time, which is a bummer since some cool projects like Spark depend on it. Some of you know that I've been working on getting Scala working in Fedora again lately. My efforts are up on the web at
https://github.com/willb/scala-packaging
http://freevariable.com/scala/scala-2.10.2-1.fc19.src.rpm
What I have is a build of Scala 2.10 (not ideal for Spark, but necessary for Java 7) that builds on f19 and rawhide locally and in Koji (see the git tag V2.10.2-1). This build has a couple of limitations:
1. it doesn't build the scala-partest jar (due to a couple of missing dependencies),
2. it doesn't run the test suite as part of the build (due to many more missing dependencies), although the spec patches the test suite to eliminate spurious failures when it is possible to run it as part of a build,
3. it relies on bootstrap binaries in the first release (as per Fedora policy); it isn't clear to me whether or not it is currently possible to bootstrap Scala without Scala
Here's how you can help:
1. The current Scala maintainers have been unresponsive for some time (see threads on fedora-devel). If you're a provenpackager, you can commit the new package and get Scala available in Fedora again.
2. If you're a Scala user, you can try the new package and let me know if it works for you.
3. If you're experienced with Java packaging, you can package (or review) missing dependencies for the Scala test suite.
4. If you're interested in getting involved with packaging other Scala ecosystem projects (like sbt and Akka), there will be a chance to do that as well.
5. If you're interested in improving the quality of my Scala package and can provide actionable feedback, please do so.
thanks,
wb
10 years, 8 months
Pig packaging wiki
by Peter MacKinnon
Got bacon?
I have assembled an Apache Pig packaging wiki
<https://fedoraproject.org/wiki/SIGs/bigdata/packaging/Pig>. More
straightforward than its Ivy-based sister Hive, but still not without
some limitations courtesy of jruby, jython, hive and hbase.
Let me know if you have any questions.
\Pete
--
Peter MacKinnon
MRG Grid/Big Data
Red Hat Inc.
Raleigh, NC
10 years, 8 months