Background

Bigtop Ambari Mpack 3.1.0:
Mpack是由Bigtop提供的供Ambari使用Bigtop Stack的安装包。由于HDP已经收费了，大部分用户无法使用HDP，并且Ambari2.8.0的开发需要较长的时间，所以Bigtop 3.1.0 Mpack + Ambari 2.7.5是一个理想的方式先让用户能够使用社区版Hadoop。
Mpack开发类似于为Ambari自定义组件，主要基于Ambari的框架进行编码。
为Mpack编写的代码后续可以直接提交到Ambari 2.8.0。

The Mpack provide by Bigtop which can be used in Ambari, since HDP is behind the paywall, and Ambari 2.8.0 need long time to release, it’ll be great if we can provide Bigtop 3.1.0 Mpack for Ambari 2.7.5, so users can use Hadoop Community Edition as soon as possible.
Mpack Development is more like we add custom components to Ambari, the development is based on Ambari’s framework.
The code commit to Mpack can be easily copy and commit to Ambari 2.8.0.

Bigtop 3.2.0:
Bigtop 3.1.0提供的组件较少，目前流行组件缺失严重，所以需要新增更多的组件，未被集成进Bigtop的组件，后续也不会出现在Ambari中。
Bigtop组件新增的原理为，从源码编译组件，并且提供RPM、DEB脚本来将组件构建为对应的系统包。Puppet manifest以及由Groovy编写的冒烟测试用例也需要提供，但如果不熟悉，社区可以帮助你。

Components included in Bigtop 3.1.0 may not be enough for some users, so we may add more components, and component which is not included in Bigtop, it won’t be included in Ambari in the future.
If we want to add a component to Bigtop, we need compile the component from source, and then write RPM DEB build scripts to provide rpm/deb package. Puppet manifests for deployment and smoke tests written in Groovy are also required, but if you’re unfamiliar with them, community members can help you first.

TODO

  • Bigtop Ambari Mpack 3.1.0
    • Provided
      • Hadoop
      • Yarn
      • MapReduce2
      • Zookeeper
      • Kafka
      • Sqoop
    • PR Created

    • In Progress
      • Hive
      • Tez
      • HBase
      • Zeppelin
      • ElasticSearch
      • LogStash
      • Kibana
      • Flink
    • Needed
      • Alluxio
      • Gpdb
      • Livy
      • Oozie
      • Phoenix
      • Solr
      • Spark
      • Ycsb
  • Bigtop 3.2.0
    • The following components are welcome to be added if you’re willing to maintain them for a long term
      • ClickHouse
      • Presto
      • Trino
      • Atlas
      • DolphinScheduler
      • SeaTunnel
      • Hue
      • Iceberg
      • Hudi
      • Impala
      • Kudu
      • …more