1、 配置方法
进入 /etc/awaken/SERVICE-SPARK-e6f4a9c48d224b98adb2907c37b85b26
vim spark-env.sh 修改这个文件

- SPARK_HISTORY_OPTS, to set config properties only for the history server (e.g. “-Dx=y”)

SPARK_HISTORY_OPTS=”-Dspark.history.store.path=/tmp/shs/cache
-Dspark.history.fs.logDirectory=hdfs://awaken152/tmp/spark-logs/“
只需要修改一台服务器即可？
2、/lib/medusa/SERVICE-SPARK-4df9f4a8a7614e7b87c2f8233008bab7/sbin/start-history-server.sh 启动历史服务器
3、提交一个spark任务，使用HistoryServer
spark-shell —master yarn —conf spark.eventLog.enabled=true —conf spark.eventLog.dir=hdfs://awaken152/tmp/spark-logs/
4、进入http://10.3.71.120:18080 查看History UI