Ubuntu logo

Developer Summit

Bigdata Filesystem Support in Ubuntu

Rationale:

Hadoop HDFS is a relatively heavy weight solution written in Java which has performance issues as its stands today on lighter weight CPU architectures such as ARM.

Ubuntu should provide alternatives to Hadoop HDFS to enable use of Bigdata applications on non-x86 architectures.

Calxeda have already ported QFS to ARM (patches now upstream).

Ceph already have support for use with Hadoop (integration currently being improved with delivery targetted for late 2012).

Goal:

Package QFS for Ubuntu 12.10.

Update Ceph packaging as required to support use with Hadoop.

Update Hadoop charms to support these two options.