hadoop 3 / accumulo 1.9 accumulo-site.xml classpath updates

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

hadoop 3 / accumulo 1.9 accumulo-site.xml classpath updates

Bulldog20630405
configured accumulo 1.9.2 with hadoop 3.1.1; it required the following updates to the "general classpath" of accumulo-site.xml; see below:

(note: if i missed something; please let me know; else, maybe update the config file for next release?

<!-- Hadoop 3 requirements -->
$HADOOP_PREFIX/share/hadoop/client/[^.].*.jar,
<!-- new config:
1) needed commons-configuration-*.jar (hadoop 3 comes with commons-configuration2-*.jar) => i stuck it in accumulo_home/lib/ext for my pseudo cluster; however probably not the best places
2) needed many commons-*.jar => took them from hadoop3 share/hadoop/common/lib
3) needed htrace => took it from hadoop3 share/common/lib
-->
$ACCUMULO_HOME/lib/ext/commons-configuration-.*.jar,
$HADOOP_PREFIX/share/hadoop/common/lib/commons-[^.].*.jar,
$HADOOP_PREFIX/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar,

Reply | Threaded
Open this post in threaded view
|

Re: hadoop 3 / accumulo 1.9 accumulo-site.xml classpath updates

Christopher Tubbs-2
A build of the 1.9.3 source (once released) should now be bundled with
the commons-configuration, so that should help a little. If you're
interested in doing a pull request to contribute and testing it, the
other changes could be added to the
assemble/conf/templates/accumulo-site.xml for use with
bin/bootstrap_config.sh

On Wed, Dec 19, 2018 at 2:31 PM Bulldog20630405
<[hidden email]> wrote:

>
> configured accumulo 1.9.2 with hadoop 3.1.1; it required the following updates to the "general classpath" of accumulo-site.xml; see below:
>
> (note: if i missed something; please let me know; else, maybe update the config file for next release?
>
> <!-- Hadoop 3 requirements -->
> $HADOOP_PREFIX/share/hadoop/client/[^.].*.jar,
> <!-- new config:
> 1) needed commons-configuration-*.jar (hadoop 3 comes with commons-configuration2-*.jar) => i stuck it in accumulo_home/lib/ext for my pseudo cluster; however probably not the best places
> 2) needed many commons-*.jar => took them from hadoop3 share/hadoop/common/lib
> 3) needed htrace => took it from hadoop3 share/common/lib
> -->
> $ACCUMULO_HOME/lib/ext/commons-configuration-.*.jar,
> $HADOOP_PREFIX/share/hadoop/common/lib/commons-[^.].*.jar,
> $HADOOP_PREFIX/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar,
>