时间戳

首页 > 解决方案 > 为 docker 配置 fluent-bit helm chart

docker - 为 docker 配置 fluent-bit helm chart

问题描述

我想通过 fluent-bit 将我的日志发送到弹性搜索。我已经配置values.yaml如下。

parsers:
  enabled: true
  json:
    - name: docker
      timeKey: time
      timeFormat: "%Y-%m-%dT%H:%M:%S.%L"
      timeKeep: on
      decodeFieldAs: json
backend:
  type: es
  es:
    host: myhost
    port: 9243
    http_user: elastic
    http_passwd: elastic
    tls: "on"

日志来自弹性搜索，但日志字段未解码为 JSON。您能否帮助使用此 YAML 将log字段解码为 JSON。

fluent-bit 生成的示例日志/文档

{
  "_index": "kubernetes_cluster-2019.03.30",
  "_type": "flb_type",
  "_id": "xdTVzGkBmTc6-uH5QzgK",
  "_version": 1,
  "_score": null,
  "_source": {
    "@timestamp": "2019-03-30T04:09:02.259Z",
    "log": "{\"time\":\"2019-03-30T04:09:02.258+00:00\",\"@version\":1,\"logger_name\":\"com.org.activemq.ActiveMQQueueUtility\",\"thread_name\":\"ORDER RESYNC TASK-0\",\"level\":\"INFO\",\"eventName\":\"syncOrder\",\"requestId\":\"LadyXhg0Hy8m7jJSQ2f\",\"eventMessage\":\"{\"sendEmail\":false,\"storeId\":61549}\",\"childRequestId\":\"LbBmKjCDuyaXQ-HwKL_\",\"action\":\"messagePublished\",\"isSent\":true,\"elapseTime\":101,\"queue\":\"HPT.SYNC.SYNC_O\",\"caller_class_name\":\"com.org.activemq.ActiveMQQueueUtility$ActiveMQProducer\",\"caller_method_name\":\"produce\",\"caller_file_name\":\"ActiveMQQueueUtility.java\",\"caller_line_number\":202}\n",
    "stream": "stdout",
    "time": "2019-03-30T04:09:02.259158471Z",
    "kubernetes": {
      "pod_name": "backend-c88bbb8f9-jtpfr",
      "namespace_name": "dev",
      "pod_id": "8700ba57-4d51-11e9-a90b-06fcff7cc9aa",
      "labels": {
        "app": "backend",
        "pod-template-hash": "744666495",
        "release": "dev"
      },
      "annotations": {
        "checksum/config": "ceb71980bda81a95c3175a83f3d5cbe622c7e712d2c399a36d8045c8c4bcd467",
        "checksum/secret": "eca5e141d20b020ec66cd82d784347e9550d01a139e494f9010ebd4e790538f1"
      },
      "host": "ip-xxx-xx-xx-xx.us-east-2.compute.internal",
      "container_name": "backend",
      "docker_id": "a2b8d61d0bd35e61f42a2524be8e1d04be96a2e7ce74b4620ce058cac2101357"
    }
  },
  "fields": {
    "@timestamp": [
      "2019-03-30T04:09:02.259Z"
    ],
    "time": [
      "2019-03-30T04:09:02.259Z"
    ]
  },
  "sort": [
    1553918942259
  ]
}

标签： dockerkubernetesfluent-bit

解决方案

推荐阅读