How do I get Kubernetes metadata about the Pods in Fargate Logs?

[yorinasub17]

I deployed the eks-fargate-container-logs module module as a part of eks-core-services module. The log message is in a json object with a single key, log:

{
    "log": "2022-09-09T15:30:45.534811998Z stdout F "
}

Is there anyway I can get more information, such as the pod labels?

---

Tracked in ticket #109233

[yorinasub17]

This is because by default the Fargate fluent-bit instance does not extract the Kubernetes metadata from the pods when shipping the logs to the destination. You can configure the fluent-bit instance to scrape the metadata by configuring the kubernetes filter as an extra filter in the module. To do this, add the following to your module block or inputs map in terragrunt.hcl when calling the eks-core-services module:

  fargate_fluent_bit_extra_filters = <<-EOF
  [FILTER]
    Name             kubernetes
    Match            kube.*
    Merge_Log           On
    Buffer_Size         0
    Kube_Meta_Cache_TTL 300s
  EOF