maven - Building hadoop 2.3.0 - An Ant BuildException has occured: exec returned: 2 -


i facing warn util.nativecodeloader: unable load native-hadoop library platform... using builtin-java classes applicable while working on hadoop 2.3.0 stuffs in ubuntu 64 bits. internet says build hadoop source , put output lib.

steps followed here https://github.com/prayagupd/hadoop-prayaman/blob/master/prayaman.sh#l316

so, created following script build hadoop 2.3.0,

[full script @ github]

configurehadooplib(){    sudo apt-get install -y cmake    sudo apt-get install -y build-essential    sudo apt-get install g++ autoconf automake    sudo apt-get install zlib1g-dev    sudo apt-get install libssl-dev    wget http://apache.mirror.anlx.net/hadoop/core/hadoop-2.3.0/hadoop-2.3.0-src.tar.gz    tar -zxvf hadoop-2.3.0-src.tar.gz    cd hadoop-2.3.0-src/    #cd $hadoop_home/src    echo    echo "#######################################################################"    echo "[info] packaging hadoop source"    echo "#######################################################################"    #mvn package -pdist,native -dskiptests -dtar    mvn -e package -dmaven.javadoc.skip=true -pdist,native -dskiptests -dtar    echo    echo "#######################################################################"    echo "[info] packaging hadoop source - completed"    echo "#######################################################################"     #cp $hadoop_home/src/hadoop-dist/target/hadoop-2.3.0-cdh5.0.1/lib/native/*  $hadoop_home/lib/native/    #cat ~/.bash_profile > export hadoop_common_lib_native_dir=$hadoop_home/lib/native    #cat ~/.bash_profile > export hadoop_opts="-djava.library.path=$hadoop_home/lib" }

i fail following error => failed execute goal o.a.m.p:maven-antrun-plugin:1.7:run (make) on project hadoop-common, 

[info] apache hadoop distribution ........................ skipped [info] ------------------------------------------------------------------------ [info] build failure [info] ------------------------------------------------------------------------ [info] total time: 1:06.730s [info] finished at: mon aug 18 18:22:00 npt 2014 [info] final memory: 67m/635m [info] ------------------------------------------------------------------------ [error] failed execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project hadoop-common: ant buildexception has occured: exec returned: 2 [error] around ant part ...<exec dir="/home/prayagupd/backup/hacker_/w.jvm/hadoop-prayaman/hadoop-2.3.0-src/hadoop-common-project/hadoop-common/target/native" executable="make" failonerror="true">... @ 7:172 in /home/prayagupd/backup/hacker_/w.jvm/hadoop-prayaman/hadoop-2.3.0-src/hadoop-common-project/hadoop-common/target/antrun/build-main.xml [error] -> [help 1] org.apache.maven.lifecycle.lifecycleexecutionexception: failed execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project hadoop-common: ant buildexception has occured: exec returned: 2 around ant part ...<exec dir="/home/prayagupd/backup/hacker_/w.jvm/hadoop-prayaman/hadoop-2.3.0-src/hadoop-common-project/hadoop-common/target/native" executable="make" failonerror="true">... @ 7:172 in /home/prayagupd/backup/hacker_/w.jvm/hadoop-prayaman/hadoop-2.3.0-src/hadoop-common-project/hadoop-common/target/antrun/build-main.xml     @ org.apache.maven.lifecycle.internal.mojoexecutor.execute(mojoexecutor.java:217)     @ org.apache.maven.lifecycle.internal.mojoexecutor.execute(mojoexecutor.java:153)     @ org.apache.maven.lifecycle.internal.mojoexecutor.execute(mojoexecutor.java:145)     @ org.apache.maven.lifecycle.internal.lifecyclemodulebuilder.buildproject(lifecyclemodulebuilder.java:84)     @ org.apache.maven.lifecycle.internal.lifecyclemodulebuilder.buildproject(lifecyclemodulebuilder.java:59)     @ org.apache.maven.lifecycle.internal.lifecyclestarter.singlethreadedbuild(lifecyclestarter.java:183)     @ org.apache.maven.lifecycle.internal.lifecyclestarter.execute(lifecyclestarter.java:161)     @ org.apache.maven.defaultmaven.doexecute(defaultmaven.java:320)     @ org.apache.maven.defaultmaven.execute(defaultmaven.java:156)     @ org.apache.maven.cli.mavencli.execute(mavencli.java:537)     @ org.apache.maven.cli.mavencli.domain(mavencli.java:196)     @ org.apache.maven.cli.mavencli.main(mavencli.java:141)     @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)     @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)     @ java.lang.reflect.method.invoke(method.java:601)     @ org.codehaus.plexus.classworlds.launcher.launcher.launchenhanced(launcher.java:290)     @ org.codehaus.plexus.classworlds.launcher.launcher.launch(launcher.java:230)     @ org.codehaus.plexus.classworlds.launcher.launcher.mainwithexitcode(launcher.java:409)     @ org.codehaus.plexus.classworlds.launcher.launcher.main(launcher.java:352) caused by: org.apache.maven.plugin.mojoexecutionexception: ant buildexception has occured: exec returned: 2 around ant part ...<exec dir="/home/prayagupd/backup/hacker_/w.jvm/hadoop-prayaman/hadoop-2.3.0-src/hadoop-common-project/hadoop-common/target/native" executable="make" failonerror="true">... @ 7:172 in /home/prayagupd/backup/hacker_/w.jvm/hadoop-prayaman/hadoop-2.3.0-src/hadoop-common-project/hadoop-common/target/antrun/build-main.xml     @ org.apache.maven.plugin.antrun.antrunmojo.execute(antrunmojo.java:355)     @ org.apache.maven.plugin.defaultbuildpluginmanager.executemojo(defaultbuildpluginmanager.java:101)     @ org.apache.maven.lifecycle.internal.mojoexecutor.execute(mojoexecutor.java:209)     ... 19 more caused by: /home/prayagupd/backup/hacker_/w.jvm/hadoop-prayaman/hadoop-2.3.0-src/hadoop-common-project/hadoop-common/target/antrun/build-main.xml:7: exec returned: 2     @ org.apache.tools.ant.taskdefs.exectask.runexecute(exectask.java:646)     @ org.apache.tools.ant.taskdefs.exectask.runexec(exectask.java:672)     @ org.apache.tools.ant.taskdefs.exectask.execute(exectask.java:498)     @ org.apache.tools.ant.unknownelement.execute(unknownelement.java:291)     @ sun.reflect.generatedmethodaccessor29.invoke(unknown source)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)     @ java.lang.reflect.method.invoke(method.java:601)     @ org.apache.tools.ant.dispatch.dispatchutils.execute(dispatchutils.java:106)     @ org.apache.tools.ant.task.perform(task.java:348)     @ org.apache.tools.ant.target.execute(target.java:390)     @ org.apache.tools.ant.target.performtasks(target.java:411)     @ org.apache.tools.ant.project.executesortedtargets(project.java:1399)     @ org.apache.tools.ant.project.executetarget(project.java:1368)     @ org.apache.maven.plugin.antrun.antrunmojo.execute(antrunmojo.java:327)     ... 21 more [error]  [error] re-run maven using -x switch enable full debug logging. [error]  [error] more information errors , possible solutions, please read following articles: [error] [help 1] http://cwiki.apache.org/confluence/display/maven/mojoexecutionexception [error]  [error] after correcting problems, can resume build command [error]   mvn <goals> -rf :hadoop-common  ####################################################################### [info] packaging hadoop source - completed #######################################################################

protoc version

$ protoc --version libprotoc 2.5.0

mvn version is 

$ mvn --version apache maven 3.0.4 maven home: /usr/share/maven java version: 1.7.0, vendor: oracle corporation java home: /usr/local/jdk1.7.0/jre default locale: en_us, platform encoding: ansi_x3.4-1968 os name: "linux", version: "3.8.0-19-generic", arch: "amd64", family: "unix"

ant version is

$ ant -version apache ant(tm) version 1.8.2 compiled on may 18 2012

funny thing on 2 different machines, build fails @ 2 different projects same ant error.

references

http://www.elcct.com/installing-hadoop-2-3-0-on-ubuntu-13-10/

https://stackoverflow.com/a/17135947/432903

https://stackoverflow.com/a/23127967/432903

hadoop 2.4 failed execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7

if in rush,you use pre-compiled version of hadoop native library downloading https://github.com/mehikmat/hadoop-install/tree/cdh5/native-libs


Comments

Post a Comment

Popular posts from this blog

javascript - Jquery show_hide, what to add in order to make the page scroll to the bottom of the hidden field once button is clicked -

i have button on website when clicked, reveals map. button can seen when page first loads up, when clicked, section holding map slides open , goes out of screen since page loads @ top (normal). want page scroll down bottom of div select when button pushed, if map out of screen. if page scrolled down, , clicks show map button, don't want page jump bottom of map. i tried figure out myself, no luck. seasoned jquery coders able give me guidance? many thanks! map = mapdiv.gmap3("get"); infobox = new infobox({ pixeloffset: new google.maps.size(-220, -310), closeboxurl: '', enableeventpropagation: true }); mapdiv.delegate('.infobox .close','click',function () { infobox.close(); }); jquery(".slidingdiv").hide(); jquery(".show_hide").show(); jquery('.show_hide').click(function(){ lastcenter=map.getcenter(); jquery(".slidingdiv...
Read more

python - Django-cities exits with "killed" -

i trying install django-cities on server 500mb ram. whenever run: manage.py cities the system exits saying killed. trying run: manage.py cities --import=country --force worked, guessing matter of running out of memory. to bypass, tried refer package local copy of cities' data file. still didn't work. any ideas on how can migrate data without having increase memory on server? based on suggestion comments, solved setting temporary swap file. if unfamiliar it, can follow these steps: set swap file touch /var/swap.img chmod 600 /var/swap.img set swap file size cd /var dd if=/dev/zero of=/var/swap.img bs=1024k count=1000 this create 1gb swap file. prepare disk image mkswap /var/swap.img activate swap memory swapon /var/swap.img once done, can turn off swap image: swapoff /var/swap.img more information on virtual memory , swap files can found here: https://www.digitalocean.com/community/tutorials/how-to-configure-virtual-me...
Read more

python - How to get a widget position inside it's layout in Kivy? -

i have gridlayout , added image widgets on after adding of images want draw rectangle in each image using canvas couldn't because don't know exact image widgets positions on gridlayout. code: http://paste.ofcode.org/3bdp9yhjrcrzmsztbu9hqp4 http://paste.ofcode.org/3az3gx4fxzr9dlhe2ami97c in last line of python code : rectangle(pos = (child.x - 2.4, child.y + 467), size = (70, 70)) how draw rectangle in child(my method not good^), also why gridlayout not coming in center after setting it's pos_hint = {"center_x" : .5}? if understand question right, try use such methods to_local() , to_parent() , to_widget() , to_window() . try substract position of gridlayout widgets' positions.
Read more