日志收集架构：
    fluent bit —> elasticsearch —> kibana
    fluent bit —> kafka —> logstash —> elasticsearch —> kibana

    租户级别日志
    https://github.com/kubesphere-sigs/fluent-operator-walkthrough

    fluentbit-operator
    https://github.com/fluent/fluentbit-operator

    image.pngkubesphere-logging-system - 图2

    FluentBit Operator CRDS
    FluentBit Operator 定义的 CRD 包括：

    • FluentBit：用于创建 Fluent Bit DaemonSet。
    • FluentBitConfig：用于选择 FluentBit Operator 需要管理的插件。
    • Input：用于定义 Fluent Bit Input 插件。
    • Parser：用于定义Fluent Bit Parser 插件。
    • Filter：用于定义Fluent Bit Filter 插件。
    • Output：用于定义Fluent Bit Output 插件。

    kubesphere-logging-system - 图3

    1. [root@ur-scm-master01 ~]# kubectl -n kubesphere-logging-system get pod 
    2. NAME                                                              READY   STATUS      RESTARTS   AGE
    3. elasticsearch-logging-curator-elasticsearch-curator-163172cp7tw   0/1     Completed   0          2d8h
    4. elasticsearch-logging-curator-elasticsearch-curator-163181hb4sq   0/1     Completed   0          32h
    5. elasticsearch-logging-curator-elasticsearch-curator-163189s6kgt   0/1     Completed   0          8h
    6. elasticsearch-logging-data-0                                      1/1     Running     6          10d
    7. elasticsearch-logging-discovery-0                                 1/1     Running     0          10d
    8. fluent-bit-7d88r                                                  1/1     Running     0          88d
    9. fluent-bit-7gddt                                                  1/1     Running     0          88d
    10. fluent-bit-96t2x                                                  1/1     Running     1          88d
    11. fluent-bit-j9rpv                                                  1/1     Running     1          88d
    12. fluent-bit-vdwg9                                                  1/1     Running     1          88d
    13. fluent-bit-wc59v                                                  1/1     Running     2          88d
    14. fluentbit-operator-85cbc8c7b6-4vxdc                               1/1     Running     2          10d
    15. ks-events-exporter-5bc4d9f496-dc7dk                               2/2     Running     0          34d
    16. ks-events-operator-8dbf7fccc-d24xm                                1/1     Running     0          10d
    17. ks-events-ruler-698b7899c7-4ft62                                  2/2     Running     1          10d
    18. ks-events-ruler-698b7899c7-c9jh4                                  2/2     Running     0          34d
    19. kube-auditing-operator-6ddc8db4b-8wmqc                            1/1     Running     0          10d
    20. kube-auditing-webhook-deploy-b74bfb885-h8mkb                      1/1     Running     1          10d
    21. kube-auditing-webhook-deploy-b74bfb885-s5mf8                      1/1     Running     2          34d
    22. logsidecar-injector-deploy-74c66bfd85-7gssk                       2/2     Running     0          10d
    23. logsidecar-injector-deploy-74c66bfd85-l7vpq                       2/2     Running     0          34d
    24. [root@ur-scm-master01 ~]#
    • elasticsearch-curator：负责定期删除过期日志
    • fluent-bit：负责节点上采集转发日志的 agent
    • ks-events-xxx：K8s 事件持久化功能的组件，非日志组件
    • kube-auditing-xxx：KubeSphere 审计功能的组件，非日志组件
    • logsidecar-injector：落盘日志转发功能的组件