Vector doesn't process k8s/Openshift pod logs using kubernetes_logs source

[drook]

Question

Vector doesn't process k8s/Openshift pod logs, like at all. I have one source of kubernetes_logs configured, but vector is idling, logging nothing even in debug mode. The console test input/sink to the same place successfully ships logs to victoriametrics server.

I ran an nginx pod after deploying vector (although there's tons of other pods running whose logs aren't checkpointed) which produced the following logs:

> oc logs nginx
/docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
/docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
/docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
10-listen-on-ipv6-by-default.sh: info: Getting the checksum of /etc/nginx/conf.d/default.conf
10-listen-on-ipv6-by-default.sh: info: Enabled listen on IPv6 in /etc/nginx/conf.d/default.conf
/docker-entrypoint.sh: Sourcing /docker-entrypoint.d/15-local-resolvers.envsh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh
/docker-entrypoint.sh: Configuration complete; ready for start up
2025/09/28 15:11:29 [notice] 1#1: using the "epoll" event method
2025/09/28 15:11:29 [notice] 1#1: nginx/1.29.1
2025/09/28 15:11:29 [notice] 1#1: built by gcc 12.2.0 (Debian 12.2.0-14+deb12u1)
2025/09/28 15:11:29 [notice] 1#1: OS: Linux 6.1.18-200.fc37.x86_64
2025/09/28 15:11:29 [notice] 1#1: getrlimit(RLIMIT_NOFILE): 1048576:1048576
2025/09/28 15:11:29 [notice] 1#1: start worker processes
2025/09/28 15:11:29 [notice] 1#1: start worker process 29
2025/09/28 15:11:29 [notice] 1#1: start worker process 30
2025/09/28 15:11:29 [notice] 1#1: start worker process 31
2025/09/28 15:11:29 [notice] 1#1: start worker process 32
2025/09/28 15:11:29 [notice] 1#1: start worker process 33
2025/09/28 15:11:29 [notice] 1#1: start worker process 34
2025/09/28 15:11:29 [notice] 1#1: start worker process 35
2025/09/28 15:11:29 [notice] 1#1: start worker process 36
2025/09/28 15:11:29 [notice] 1#1: start worker process 37
2025/09/28 15:11:29 [notice] 1#1: start worker process 38
2025/09/28 15:11:29 [notice] 1#1: start worker process 39
2025/09/28 15:11:29 [notice] 1#1: start worker process 40
2025/09/28 15:11:29 [notice] 1#1: start worker process 41
2025/09/28 15:11:29 [notice] 1#1: start worker process 42
2025/09/28 15:11:29 [notice] 1#1: start worker process 43
2025/09/28 15:11:29 [notice] 1#1: start worker process 44
2025/09/28 15:11:29 [notice] 42#42: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 40#40: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 44#44: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 37#37: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 35#35: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 39#39: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 43#43: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 41#41: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 36#36: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 34#34: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 31#31: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 33#33: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 38#38: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 32#32: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 29#29: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 30#30: signal 28 (SIGWINCH) received
2025/09/28 15:11:29 [notice] 1#1: signal 28 (SIGWINCH) received

Below I attach the vector pod log from the same node that nginx pod was scheduled at. As you can see there's nothiing about the newly created pod logs in it.

Vector also did not checkpoint any of the logs in it's data directory:

> oc -n devops-logs exec -it vector-kzt7s -c vector -- sh
/ # cat /vector-data-dir/okd/checkpoints.json
{"version":"1","checkpoints":[]}/#

Vector DaemonSet

apiVersion: apps/v1
kind: DaemonSet
metadata:
  name: vector
  labels:
    app.kubernetes.io/name: vector
    app.kubernetes.io/instance: vector
    app.kubernetes.io/component: Aggregator
    app.kubernetes.io/version: "0.50.0-alpine"
  annotations: {}
spec:
  replicas: 1
  podManagementPolicy: OrderedReady
  selector:
    matchLabels:
      app.kubernetes.io/name: vector
      app.kubernetes.io/instance: vector
      app.kubernetes.io/component: Aggregator
  minReadySeconds: 0
  serviceName: vector-headless
  template:
    metadata:
      annotations: {}
      labels:
        app.kubernetes.io/name: vector
        app.kubernetes.io/instance: vector
        app.kubernetes.io/component: Aggregator
        vector.dev/exclude: "true"
    spec:
      serviceAccountName: vector
      securityContext:
        privileged: true
        runAsGroup: 0
        runAsUser: 0
      dnsPolicy: ClusterFirst
      containers:
        - name: vector
          #image: "timberio/vector:0.50.0-distroless-libc"
          image: "timberio/vector:0.50.0-alpine"
          imagePullPolicy: IfNotPresent
          args:
            - --config-dir
            - /etc/vector/
          env:
            - name: VECTOR_LOG
              value: "debug"
            - name: VECTOR_SELF_NODE_NAME
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
          securityContext:
            privileged: true
            readOnlyRootFilesystem: true
          ports:
            - name: datadog-agent
              containerPort: 8282
              protocol: TCP
            - name: fluent
              containerPort: 24224
              protocol: TCP
            - name: logstash
              containerPort: 5044
              protocol: TCP
            - name: splunk-hec
              containerPort: 8080
              protocol: TCP
            - name: statsd
              containerPort: 8125
              protocol: TCP
            - name: syslog
              containerPort: 9000
              protocol: TCP
            - name: vector
              containerPort: 6000
              protocol: TCP
            - name: prom-exporter
              containerPort: 9090
              protocol: TCP
          volumeMounts:
            - name: data
              mountPath: "/vector-data-dir"
            - name: config
              mountPath: "/etc/vector/"
              readOnly: true
            - name: containerlogs
              mountPath: "/var/log/pods"
              readOnly: true
      terminationGracePeriodSeconds: 60
      volumes:
        - name: data
          emptyDir: {}
        - name: config
          projected:
            sources:
              - configMap:
                  name: vector
        - name: containerlogs
          hostPath:
            path: /var/log/pods
            type: Directory
  volumeClaimTemplates:

Vector Config

data_dir: /vector-data-dir
api:
  enabled: true
  address: 127.0.0.1:8686
  playground: false
sources:
  in:
    type: "stdin"
  okd:
    type: kubernetes_logs
    self_node_name: ${HOSTNAME}
sinks:
  out:
    inputs:
      - in
    type: console
    encoding:
      codec: text
  out2victorialogs:
    inputs:
      - in
    type: http
    uri: http://10.42.137.114:9428/insert/jsonline?_stream_fields=host,container_name&_msg_field=message&_time_field=timestamp
    compression: gzip
    encoding:
      codec: json
    framing:
      method: newline_delimited
    healthcheck:
      enabled: false
  vlogs:
    inputs:
      - okd
    type: http
    uri: http://10.42.137.114:9428/insert/jsonline?_stream_fields=host,container_name&_msg_field=message&_time_field=timestamp
    compression: gzip
    encoding:
      codec: json
    framing:
      method: newline_delimited
    healthcheck:
      enabled: false

Vector Logs

> oc -n devops-logs logs vector-kzt7s
2025-09-28T15:04:02.383109Z DEBUG vector::app: Internal log rate limit configured. internal_log_rate_secs=10
2025-09-28T15:04:02.383161Z  INFO vector::app: Log level is enabled. level="debug"
2025-09-28T15:04:02.383236Z DEBUG vector::app: messaged="Building runtime." worker_threads=16
2025-09-28T15:04:02.385355Z  INFO vector::app: Loading configs. paths=["/etc/vector"]
2025-09-28T15:04:02.387626Z DEBUG vector::config::loading: No secret placeholder found, skipping secret resolution.
2025-09-28T15:04:02.388826Z DEBUG vector::topology::builder: Building new source. component=in
2025-09-28T15:04:02.389669Z DEBUG vector::topology::builder: Building new source. component=okd
2025-09-28T15:04:02.389844Z  INFO vector::sources::file_descriptors: Capturing stdin.
2025-09-28T15:04:02.390440Z  INFO source{component_kind="source" component_id=okd component_type=kubernetes_logs}: vector::sources::kubernetes_logs: Obtained Kubernetes Node name to collect logs for (self). self_node_name="vector-kzt7s"
2025-09-28T15:04:02.399826Z  INFO source{component_kind="source" component_id=okd component_type=kubernetes_logs}: vector::sources::kubernetes_logs: Including matching files. ret=["**/*"]
2025-09-28T15:04:02.399848Z  INFO source{component_kind="source" component_id=okd component_type=kubernetes_logs}: vector::sources::kubernetes_logs: Excluding matching files. ret=["**/*.gz", "**/*.tmp"]
2025-09-28T15:04:02.399882Z DEBUG vector::topology::builder: Building new sink. component=out
2025-09-28T15:04:02.400000Z DEBUG vector::topology::builder: Building new sink. component=out2victorialogs
2025-09-28T15:04:02.406792Z DEBUG sink{component_kind="sink" component_id=out2victorialogs component_type=http}: vector_core::tls::settings: Fetching system root certs.
2025-09-28T15:04:02.413395Z DEBUG sink{component_kind="sink" component_id=out2victorialogs component_type=http}: vector_core::tls::settings: Fetching system root certs.
2025-09-28T15:04:02.420364Z DEBUG vector::topology::builder: Building new sink. component=vlogs
2025-09-28T15:04:02.426627Z DEBUG sink{component_kind="sink" component_id=vlogs component_type=http}: vector_core::tls::settings: Fetching system root certs.
2025-09-28T15:04:02.433245Z DEBUG sink{component_kind="sink" component_id=vlogs component_type=http}: vector_core::tls::settings: Fetching system root certs.
2025-09-28T15:04:02.440216Z  INFO vector::topology::running: Running healthchecks.
2025-09-28T15:04:02.440242Z DEBUG vector::topology::running: Connecting changed/added component(s).
2025-09-28T15:04:02.440251Z DEBUG vector::topology::running: Configuring outputs for source. component=okd
2025-09-28T15:04:02.440264Z DEBUG vector::topology::running: Configuring output for component. component=okd output_id=None
2025-09-28T15:04:02.440279Z DEBUG vector::topology::running: Configuring outputs for source. component=in
2025-09-28T15:04:02.440283Z DEBUG vector::topology::running: Configuring output for component. component=in output_id=None
2025-09-28T15:04:02.440289Z DEBUG vector::topology::running: Connecting inputs for sink. component=out2victorialogs
2025-09-28T15:04:02.440298Z DEBUG vector::topology::running: Adding component input to fanout. component=out2victorialogs fanout_id=in
2025-09-28T15:04:02.440305Z DEBUG vector::topology::running: Connecting inputs for sink. component=out
2025-09-28T15:04:02.440309Z DEBUG vector::topology::running: Adding component input to fanout. component=out fanout_id=in
2025-09-28T15:04:02.440318Z DEBUG vector::topology::running: Connecting inputs for sink. component=vlogs
2025-09-28T15:04:02.440325Z DEBUG vector::topology::running: Adding component input to fanout. component=vlogs fanout_id=okd
2025-09-28T15:04:02.440342Z DEBUG vector::topology::running: Spawning new source. key=okd
2025-09-28T15:04:02.440377Z DEBUG vector::topology::running: Spawning new source. key=in
2025-09-28T15:04:02.440424Z  INFO vector::topology::builder: Healthcheck disabled.
2025-09-28T15:04:02.440459Z  INFO vector::topology::builder: Healthcheck passed.
2025-09-28T15:04:02.440469Z  INFO vector::topology::builder: Healthcheck disabled.
2025-09-28T15:04:02.440490Z  INFO vector: Vector has started. debug="false" version="0.50.0" arch="x86_64" revision="9053198 2025-09-23 14:18:50.944442940"
2025-09-28T15:04:02.440485Z DEBUG source{component_kind="source" component_id=in component_type=stdin}: vector::topology::builder: Source pump supervisor starting.
2025-09-28T15:04:02.440502Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}: vector::topology::builder: Source pump supervisor starting.
2025-09-28T15:04:02.440515Z DEBUG source{component_kind="source" component_id=in component_type=stdin}: vector::topology::builder: Source pump starting.
2025-09-28T15:04:02.440517Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}: vector::topology::builder: Source pump starting.
2025-09-28T15:04:02.440529Z DEBUG sink{component_kind="sink" component_id=out2victorialogs component_type=http}: vector::topology::builder: Sink starting.
2025-09-28T15:04:02.440529Z DEBUG sink{component_kind="sink" component_id=out component_type=console}: vector::topology::builder: Sink starting.
2025-09-28T15:04:02.440524Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}: vector::topology::builder: Source starting.
2025-09-28T15:04:02.440542Z DEBUG source{component_kind="source" component_id=in component_type=stdin}: vector::topology::builder: Source starting.
2025-09-28T15:04:02.440571Z DEBUG sink{component_kind="sink" component_id=vlogs component_type=http}: vector::topology::builder: Sink starting.
2025-09-28T15:04:02.440593Z DEBUG vector::utilization: utilization=1
2025-09-28T15:04:02.440648Z DEBUG vector::utilization: utilization=1
2025-09-28T15:04:02.440651Z DEBUG vector::utilization: utilization=1
2025-09-28T15:04:02.440729Z DEBUG source{component_kind="source" component_id=in component_type=stdin}: vector::sources::file_descriptors: Finished sending.
2025-09-28T15:04:02.440748Z DEBUG source{component_kind="source" component_id=in component_type=stdin}: vector::topology::builder: Source finished normally.
2025-09-28T15:04:02.440759Z DEBUG source{component_kind="source" component_id=in component_type=stdin}: vector::topology::builder: Source pump finished normally.
2025-09-28T15:04:02.440801Z DEBUG source{component_kind="source" component_id=in component_type=stdin}: vector::topology::builder: Source pump supervisor task finished normally.
2025-09-28T15:04:02.440856Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:04:02.440967Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/namespaces?&labelSelector=vector.dev%2Fexclude%21%3Dtrue&limit=500 otel.name="list" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:04:02.441046Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/namespaces?&labelSelector=vector.dev%2Fexclude%21%3Dtrue&limit=500 otel.name="list" otel.kind="client"}: hyper_util::client::legacy::connect::http: connecting to 172.30.0.1:443
2025-09-28T15:04:02.441088Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:04:02.441108Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/nodes?&fieldSelector=metadata.name%3Dvector-kzt7s&limit=500 otel.name="list" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:04:02.441137Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:04:02.441145Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/nodes?&fieldSelector=metadata.name%3Dvector-kzt7s&limit=500 otel.name="list" otel.kind="client"}: hyper_util::client::legacy::connect::http: connecting to 172.30.0.1:443
2025-09-28T15:04:02.441190Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/pods?&fieldSelector=spec.nodeName%3Dvector-kzt7s&labelSelector=vector.dev%2Fexclude%21%3Dtrue&limit=500 otel.name="list" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:04:02.441247Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/pods?&fieldSelector=spec.nodeName%3Dvector-kzt7s&labelSelector=vector.dev%2Fexclude%21%3Dtrue&limit=500 otel.name="list" otel.kind="client"}: hyper_util::client::legacy::connect::http: connecting to 172.30.0.1:443
2025-09-28T15:04:02.441509Z  INFO source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source_common::checkpointer: Attempting to read legacy checkpoint files.
2025-09-28T15:04:02.441690Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/nodes?&fieldSelector=metadata.name%3Dvector-kzt7s&limit=500 otel.name="list" otel.kind="client"}: hyper_util::client::legacy::connect::http: connected to 172.30.0.1:443
2025-09-28T15:04:02.441736Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/pods?&fieldSelector=spec.nodeName%3Dvector-kzt7s&labelSelector=vector.dev%2Fexclude%21%3Dtrue&limit=500 otel.name="list" otel.kind="client"}: hyper_util::client::legacy::connect::http: connected to 172.30.0.1:443
2025-09-28T15:04:02.441760Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/namespaces?&labelSelector=vector.dev%2Fexclude%21%3Dtrue&limit=500 otel.name="list" otel.kind="client"}: hyper_util::client::legacy::connect::http: connected to 172.30.0.1:443
2025-09-28T15:04:02.441993Z  INFO vector::internal_events::api: API server running. address=127.0.0.1:8686 playground=off graphql=http://127.0.0.1:8686/graphql
2025-09-28T15:04:02.448139Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/nodes?&fieldSelector=metadata.name%3Dvector-kzt7s&limit=500 otel.name="list" otel.kind="client"}: hyper_util::client::legacy::pool: pooling idle connection for ("https", 172.30.0.1)
2025-09-28T15:04:02.448216Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:04:02.448243Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/nodes?&watch=true&timeoutSeconds=290&fieldSelector=metadata.name%3Dvector-kzt7s&allowWatchBookmarks=true&resourceVersion=16218670 otel.name="watch" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:04:02.448252Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/nodes?&watch=true&timeoutSeconds=290&fieldSelector=metadata.name%3Dvector-kzt7s&allowWatchBookmarks=true&resourceVersion=16218670 otel.name="watch" otel.kind="client"}: hyper_util::client::legacy::pool: reuse idle connection for ("https", 172.30.0.1)
2025-09-28T15:04:02.451922Z DEBUG hyper_util::client::legacy::pool: pooling idle connection for ("https", 172.30.0.1)
2025-09-28T15:04:02.453884Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:04:02.453927Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/namespaces?&watch=true&timeoutSeconds=290&labelSelector=vector.dev%2Fexclude%21%3Dtrue&allowWatchBookmarks=true&resourceVersion=16218670 otel.name="watch" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:04:02.453950Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/namespaces?&watch=true&timeoutSeconds=290&labelSelector=vector.dev%2Fexclude%21%3Dtrue&allowWatchBookmarks=true&resourceVersion=16218670 otel.name="watch" otel.kind="client"}: hyper_util::client::legacy::pool: reuse idle connection for ("https", 172.30.0.1)
2025-09-28T15:04:02.484699Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/pods?&fieldSelector=spec.nodeName%3Dvector-kzt7s&labelSelector=vector.dev%2Fexclude%21%3Dtrue&limit=500 otel.name="list" otel.kind="client"}: hyper_util::client::legacy::pool: pooling idle connection for ("https", 172.30.0.1)
2025-09-28T15:04:02.484795Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:04:02.484832Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/pods?&watch=true&timeoutSeconds=290&fieldSelector=spec.nodeName%3Dvector-kzt7s&labelSelector=vector.dev%2Fexclude%21%3Dtrue&allowWatchBookmarks=true&resourceVersion=16218670 otel.name="watch" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:04:02.484846Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/pods?&watch=true&timeoutSeconds=290&fieldSelector=spec.nodeName%3Dvector-kzt7s&labelSelector=vector.dev%2Fexclude%21%3Dtrue&allowWatchBookmarks=true&resourceVersion=16218670 otel.name="watch" otel.kind="client"}: hyper_util::client::legacy::pool: reuse idle connection for ("https", 172.30.0.1)
2025-09-28T15:04:07.390252Z DEBUG vector::utilization: utilization=0.10003648374577975
2025-09-28T15:04:07.390305Z DEBUG vector::utilization: utilization=0.10003429074245102
2025-09-28T15:04:07.390309Z DEBUG vector::utilization: utilization=0.09999261203543426
2025-09-28T15:04:12.390318Z DEBUG vector::utilization: utilization=0.010003648374577973
2025-09-28T15:04:12.390348Z DEBUG vector::utilization: utilization=0.010003429074245099
2025-09-28T15:04:12.390351Z DEBUG vector::utilization: utilization=0.009999261203543424
2025-09-28T15:04:17.390068Z DEBUG vector::utilization: utilization=0.001000364837457797
2025-09-28T15:04:17.390103Z DEBUG vector::utilization: utilization=0.0010003429074245096
2025-09-28T15:04:17.390107Z DEBUG vector::utilization: utilization=0.000999926120354342
2025-09-28T15:04:22.390285Z DEBUG vector::utilization: utilization=0.00010003648374577968
2025-09-28T15:04:22.390320Z DEBUG vector::utilization: utilization=0.00010003429074245095
2025-09-28T15:04:22.390323Z DEBUG vector::utilization: utilization=0.00009999261203543419
2025-09-28T15:04:27.390087Z DEBUG vector::utilization: utilization=0.000010003648374577966
2025-09-28T15:04:27.390120Z DEBUG vector::utilization: utilization=0.000010003429074245092
2025-09-28T15:04:27.390123Z DEBUG vector::utilization: utilization=0.000009999261203543416
2025-09-28T15:04:32.390101Z DEBUG vector::utilization: utilization=0.0000010003648374577963
2025-09-28T15:04:32.390144Z DEBUG vector::utilization: utilization=0.0000010003429074245089
2025-09-28T15:04:32.390148Z DEBUG vector::utilization: utilization=0.0000009999261203543415
2025-09-28T15:04:37.389954Z DEBUG vector::utilization: utilization=0.00000010003648374577961
2025-09-28T15:04:37.389988Z DEBUG vector::utilization: utilization=0.00000010003429074245086
2025-09-28T15:04:37.389991Z DEBUG vector::utilization: utilization=0.00000009999261203543412
2025-09-28T15:04:42.390407Z DEBUG vector::utilization: utilization=0.000000010003648374577959
2025-09-28T15:04:42.390438Z DEBUG vector::utilization: utilization=0.000000010003429074245085
2025-09-28T15:04:42.390441Z DEBUG vector::utilization: utilization=0.00000000999926120354341
2025-09-28T15:04:47.390331Z DEBUG vector::utilization: utilization=0.0000000010003648374577957
2025-09-28T15:04:47.390366Z DEBUG vector::utilization: utilization=0.0000000010003429074245082
2025-09-28T15:04:47.390368Z DEBUG vector::utilization: utilization=0.0000000009999261203543408
2025-09-28T15:04:52.389455Z DEBUG vector::utilization: utilization=0.00000000010003648374577956
2025-09-28T15:04:52.389485Z DEBUG vector::utilization: utilization=0.00000000010003429074245081
2025-09-28T15:04:52.389487Z DEBUG vector::utilization: utilization=0.00000000009999261203543406
2025-09-28T15:04:57.389868Z DEBUG vector::utilization: utilization=0.000000000010003648374577953
2025-09-28T15:04:57.389905Z DEBUG vector::utilization: utilization=0.000000000010003429074245079
2025-09-28T15:04:57.389909Z DEBUG vector::utilization: utilization=0.000000000009999261203543404
2025-09-28T15:05:02.389783Z DEBUG vector::utilization: utilization=0.0000000000010003648374577952
2025-09-28T15:05:02.389818Z DEBUG vector::utilization: utilization=0.0000000000010003429074245076
2025-09-28T15:05:02.389821Z DEBUG vector::utilization: utilization=0.0000000000009999261203543402
2025-09-28T15:05:02.443695Z DEBUG vector::internal_events::file::source: Files checkpointed. count=0 duration_ms=0
2025-09-28T15:05:03.928436Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source::file_server: event_throughput=0.000/sec bytes_throughput=0.000/sec ratios={"discovery": 4.6840207e-9, "other": 1.422942e-5, "sending": 1.0427915e-5, "sleeping": 0.9999753}
2025-09-28T15:05:07.389695Z DEBUG vector::utilization: utilization=0.0000000000001000364837457795
2025-09-28T15:05:07.389729Z DEBUG vector::utilization: utilization=0.00000000000010003429074245074
2025-09-28T15:05:07.389733Z DEBUG vector::utilization: utilization=0.000000000000099992612035434
2025-09-28T15:05:12.389531Z DEBUG vector::utilization: utilization=0.000000000000010003648374577947
2025-09-28T15:05:12.389573Z DEBUG vector::utilization: utilization=0.000000000000010003429074245071
2025-09-28T15:05:12.389577Z DEBUG vector::utilization: utilization=0.000000000000009999261203543398
2025-09-28T15:05:17.389919Z DEBUG vector::utilization: utilization=0.0000000000000010003648374577944
2025-09-28T15:05:17.389956Z DEBUG vector::utilization: utilization=0.0000000000000010003429074245069
2025-09-28T15:05:17.389960Z DEBUG vector::utilization: utilization=0.0000000000000009999261203543395
2025-09-28T15:05:22.390284Z DEBUG vector::utilization: utilization=0.00000000000000010003648374577942
2025-09-28T15:05:22.390311Z DEBUG vector::utilization: utilization=0.00000000000000010003429074245066
2025-09-28T15:05:22.390314Z DEBUG vector::utilization: utilization=0.00000000000000009999261203543393
2025-09-28T15:05:27.390009Z DEBUG vector::utilization: utilization=0.00000000000000001000364837457794
2025-09-28T15:05:27.390058Z DEBUG vector::utilization: utilization=0.000000000000000010003429074245065
2025-09-28T15:05:27.390061Z DEBUG vector::utilization: utilization=0.000000000000000009999261203543391
2025-09-28T15:05:32.389650Z DEBUG vector::utilization: utilization=0.0000000000000000010003648374577938
2025-09-28T15:05:32.389680Z DEBUG vector::utilization: utilization=0.0000000000000000010003429074245063
2025-09-28T15:05:32.389683Z DEBUG vector::utilization: utilization=0.000000000000000000999926120354339
2025-09-28T15:05:37.389383Z DEBUG vector::utilization: utilization=0.00000000000000000010003648374577936
2025-09-28T15:05:37.389415Z DEBUG vector::utilization: utilization=0.00000000000000000010003429074245061
2025-09-28T15:05:37.389419Z DEBUG vector::utilization: utilization=0.00000000000000000009999261203543387
2025-09-28T15:05:42.390294Z DEBUG vector::utilization: utilization=0.000000000000000000010003648374577934
2025-09-28T15:05:42.390332Z DEBUG vector::utilization: utilization=0.000000000000000000010003429074245059
2025-09-28T15:05:42.390335Z DEBUG vector::utilization: utilization=0.000000000000000000009999261203543384
2025-09-28T15:05:47.389810Z DEBUG vector::utilization: utilization=0.0000000000000000000010003648374577931
2025-09-28T15:05:47.389843Z DEBUG vector::utilization: utilization=0.0000000000000000000010003429074245056
2025-09-28T15:05:47.389846Z DEBUG vector::utilization: utilization=0.0000000000000000000009999261203543382
2025-09-28T15:05:52.390402Z DEBUG vector::utilization: utilization=0.00000000000000000000010003648374577929
2025-09-28T15:05:52.390430Z DEBUG vector::utilization: utilization=0.00000000000000000000010003429074245054
2025-09-28T15:05:52.390433Z DEBUG vector::utilization: utilization=0.0000000000000000000000999926120354338
2025-09-28T15:05:57.390434Z DEBUG vector::utilization: utilization=0.000000000000000000000010003648374577926
2025-09-28T15:05:57.390478Z DEBUG vector::utilization: utilization=0.000000000000000000000010003429074245052
2025-09-28T15:05:57.390482Z DEBUG vector::utilization: utilization=0.000000000000000000000009999261203543378
2025-09-28T15:06:02.389708Z DEBUG vector::utilization: utilization=0.0000000000000000000000010003648374577925
2025-09-28T15:06:02.389743Z DEBUG vector::utilization: utilization=0.0000000000000000000000010003429074245049
2025-09-28T15:06:02.389746Z DEBUG vector::utilization: utilization=0.0000000000000000000000009999261203543376
2025-09-28T15:06:02.445299Z DEBUG vector::internal_events::file::source: Files checkpointed. count=0 duration_ms=0
2025-09-28T15:06:05.403831Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source::file_server: event_throughput=0.000/sec bytes_throughput=0.000/sec ratios={"discovery": 2.5392298e-8, "other": 1.1923042e-5, "sending": 8.184796e-6, "sleeping": 0.99997985}
2025-09-28T15:06:07.389441Z DEBUG vector::utilization: utilization=0.00000000000000000000000010003648374577922
2025-09-28T15:06:07.389490Z DEBUG vector::utilization: utilization=0.00000000000000000000000010003429074245047
2025-09-28T15:06:07.389493Z DEBUG vector::utilization: utilization=0.00000000000000000000000009999261203543374
2025-09-28T15:06:12.389796Z DEBUG vector::utilization: utilization=0.00000000000000000000000001000364837457792
2025-09-28T15:06:12.389832Z DEBUG vector::utilization: utilization=0.000000000000000000000000010003429074245044
2025-09-28T15:06:12.389836Z DEBUG vector::utilization: utilization=0.000000000000000000000000009999261203543371
2025-09-28T15:06:17.390328Z DEBUG vector::utilization: utilization=0.0000000000000000000000000010003648374577917
2025-09-28T15:06:17.390370Z DEBUG vector::utilization: utilization=0.0000000000000000000000000010003429074245042
2025-09-28T15:06:17.390374Z DEBUG vector::utilization: utilization=0.0000000000000000000000000009999261203543369
2025-09-28T15:06:22.390205Z DEBUG vector::utilization: utilization=0.00000000000000000000000000010003648374577915
2025-09-28T15:06:22.390241Z DEBUG vector::utilization: utilization=0.0000000000000000000000000001000342907424504
2025-09-28T15:06:22.390244Z DEBUG vector::utilization: utilization=0.00000000000000000000000000009999261203543367
2025-09-28T15:06:27.389831Z DEBUG vector::utilization: utilization=0.000000000000000000000000000010003648374577913
2025-09-28T15:06:27.389867Z DEBUG vector::utilization: utilization=0.000000000000000000000000000010003429074245037
2025-09-28T15:06:27.389870Z DEBUG vector::utilization: utilization=0.000000000000000000000000000009999261203543364
2025-09-28T15:06:32.390432Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000010003648374577911
2025-09-28T15:06:32.390470Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000010003429074245035
2025-09-28T15:06:32.390474Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000009999261203543362
2025-09-28T15:06:37.389601Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000001000364837457791
2025-09-28T15:06:37.389636Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000010003429074245034
2025-09-28T15:06:37.389639Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000009999261203543359
2025-09-28T15:06:42.389968Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000010003648374577907
2025-09-28T15:06:42.390011Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000010003429074245032
2025-09-28T15:06:42.390016Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000009999261203543356
2025-09-28T15:06:47.389822Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000010003648374577904
2025-09-28T15:06:47.389865Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000001000342907424503
2025-09-28T15:06:47.389869Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000009999261203543354
2025-09-28T15:06:52.389939Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000010003648374577901
2025-09-28T15:06:52.389981Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000010003429074245027
2025-09-28T15:06:52.389985Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000009999261203543352
2025-09-28T15:06:57.389850Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000010003648374577899
2025-09-28T15:06:57.389892Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000010003429074245025
2025-09-28T15:06:57.389895Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000999926120354335
2025-09-28T15:07:02.389986Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000010003648374577896
2025-09-28T15:07:02.390025Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000010003429074245022
2025-09-28T15:07:02.390029Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000009999261203543347
2025-09-28T15:07:02.446647Z DEBUG vector::internal_events::file::source: Files checkpointed. count=0 duration_ms=0
2025-09-28T15:07:06.876657Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source::file_server: event_throughput=0.000/sec bytes_throughput=0.000/sec ratios={"discovery": 3.8586197e-8, "other": 1.2503652e-5, "sending": 7.379187e-6, "sleeping": 0.9999801}
2025-09-28T15:07:07.389417Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000010003648374577893
2025-09-28T15:07:07.389445Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000010003429074245021
2025-09-28T15:07:07.389448Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000009999261203543344
2025-09-28T15:07:12.389931Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000001000364837457789
2025-09-28T15:07:12.389974Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000010003429074245019
2025-09-28T15:07:12.389977Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000009999261203543342
2025-09-28T15:07:17.389995Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000010003648374577888
2025-09-28T15:07:17.390028Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000010003429074245017
2025-09-28T15:07:17.390031Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000009999261203543339
2025-09-28T15:07:22.390303Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000010003648374577885
2025-09-28T15:07:22.390341Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000010003429074245015
2025-09-28T15:07:22.390346Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000009999261203543336
2025-09-28T15:07:27.389874Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000010003648374577883
2025-09-28T15:07:27.389907Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000010003429074245012
2025-09-28T15:07:27.389910Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000009999261203543333
2025-09-28T15:07:32.390209Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000001000364837457788
2025-09-28T15:07:32.390246Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000001000342907424501
2025-09-28T15:07:32.390250Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000999926120354333
2025-09-28T15:07:37.389897Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000010003648374577879
2025-09-28T15:07:37.389930Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000010003429074245007
2025-09-28T15:07:37.389933Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000009999261203543329
2025-09-28T15:07:42.389504Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000010003648374577877
2025-09-28T15:07:42.389546Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000010003429074245005
2025-09-28T15:07:42.389550Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000009999261203543326
2025-09-28T15:07:47.390081Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000010003648374577875
2025-09-28T15:07:47.390108Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000010003429074245003
2025-09-28T15:07:47.390111Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000009999261203543325
2025-09-28T15:07:52.389710Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000010003648374577873
2025-09-28T15:07:52.389737Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000010003429074245002
2025-09-28T15:07:52.389740Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000009999261203543322
2025-09-28T15:07:57.389634Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000010003648374577871
2025-09-28T15:07:57.389673Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000010003429074245
2025-09-28T15:07:57.389676Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000999926120354332
2025-09-28T15:08:02.390211Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000010003648374577868
2025-09-28T15:08:02.390242Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000010003429074244998
2025-09-28T15:08:02.390245Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000009999261203543318
2025-09-28T15:08:02.447754Z DEBUG vector::internal_events::file::source: Files checkpointed. count=0 duration_ms=0
2025-09-28T15:08:07.389656Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000010003648374577866
2025-09-28T15:08:07.389692Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000010003429074244996
2025-09-28T15:08:07.389695Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000009999261203543315
2025-09-28T15:08:08.352029Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source::file_server: event_throughput=0.000/sec bytes_throughput=0.000/sec ratios={"discovery": 3.8161662e-8, "other": 1.23437685e-5, "sending": 6.7013575e-6, "sleeping": 0.99998087}
2025-09-28T15:08:12.389931Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000010003648374577864
2025-09-28T15:08:12.389969Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000010003429074244993
2025-09-28T15:08:12.389973Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000009999261203543314
2025-09-28T15:08:17.389935Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000010003648374577861
2025-09-28T15:08:17.389968Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000010003429074244992
2025-09-28T15:08:17.389971Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000009999261203543312
2025-09-28T15:08:22.389662Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000010003648374577858
2025-09-28T15:08:22.389697Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000010003429074244989
2025-09-28T15:08:22.389700Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000999926120354331
2025-09-28T15:08:27.390101Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000010003648374577856
2025-09-28T15:08:27.390134Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000010003429074244987
2025-09-28T15:08:27.390137Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000009999261203543308
2025-09-28T15:08:32.390421Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000010003648374577853
2025-09-28T15:08:32.390459Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000010003429074244984
2025-09-28T15:08:32.390463Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000009999261203543305
2025-09-28T15:08:37.389591Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000010003648374577852
2025-09-28T15:08:37.389625Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000010003429074244981
2025-09-28T15:08:37.389628Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000009999261203543302
2025-09-28T15:08:42.389610Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000010003648374577849
2025-09-28T15:08:42.389650Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000010003429074244979
2025-09-28T15:08:42.389652Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000099992612035433
2025-09-28T15:08:47.390349Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000010003648374577847
2025-09-28T15:08:47.390385Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000010003429074244977
2025-09-28T15:08:47.390388Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000009999261203543298
2025-09-28T15:08:52.390410Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000010003648374577846
2025-09-28T15:08:52.390443Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000010003429074244975
2025-09-28T15:08:52.390446Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000009999261203543296
2025-09-28T15:08:52.450042Z DEBUG hyper_util::client::legacy::pool: pooling idle connection for ("https", 172.30.0.1)
2025-09-28T15:08:52.450125Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:08:52.450233Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/nodes?&watch=true&timeoutSeconds=290&fieldSelector=metadata.name%3Dvector-kzt7s&allowWatchBookmarks=true&resourceVersion=16221163 otel.name="watch" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:08:52.450292Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/nodes?&watch=true&timeoutSeconds=290&fieldSelector=metadata.name%3Dvector-kzt7s&allowWatchBookmarks=true&resourceVersion=16221163 otel.name="watch" otel.kind="client"}: hyper_util::client::legacy::pool: reuse idle connection for ("https", 172.30.0.1)
2025-09-28T15:08:52.455428Z DEBUG hyper_util::client::legacy::pool: pooling idle connection for ("https", 172.30.0.1)
2025-09-28T15:08:52.455482Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:08:52.455535Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/namespaces?&watch=true&timeoutSeconds=290&labelSelector=vector.dev%2Fexclude%21%3Dtrue&allowWatchBookmarks=true&resourceVersion=16221175 otel.name="watch" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:08:52.455550Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/namespaces?&watch=true&timeoutSeconds=290&labelSelector=vector.dev%2Fexclude%21%3Dtrue&allowWatchBookmarks=true&resourceVersion=16221175 otel.name="watch" otel.kind="client"}: hyper_util::client::legacy::pool: reuse idle connection for ("https", 172.30.0.1)
2025-09-28T15:08:52.487368Z DEBUG hyper_util::client::legacy::pool: pooling idle connection for ("https", 172.30.0.1)
2025-09-28T15:08:52.487452Z DEBUG tower::buffer::worker: service.ready=true processing request
2025-09-28T15:08:52.487516Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/pods?&watch=true&timeoutSeconds=290&fieldSelector=spec.nodeName%3Dvector-kzt7s&labelSelector=vector.dev%2Fexclude%21%3Dtrue&allowWatchBookmarks=true&resourceVersion=16221156 otel.name="watch" otel.kind="client"}: kube_client::client::builder: requesting
2025-09-28T15:08:52.487540Z DEBUG HTTP{http.method=GET http.url=https://172.30.0.1/api/v1/pods?&watch=true&timeoutSeconds=290&fieldSelector=spec.nodeName%3Dvector-kzt7s&labelSelector=vector.dev%2Fexclude%21%3Dtrue&allowWatchBookmarks=true&resourceVersion=16221156 otel.name="watch" otel.kind="client"}: hyper_util::client::legacy::pool: reuse idle connection for ("https", 172.30.0.1)
2025-09-28T15:08:57.389521Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000010003648374577843
2025-09-28T15:08:57.389556Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000010003429074244973
2025-09-28T15:08:57.389559Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000009999261203543294
2025-09-28T15:09:02.390077Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000010003648374577842
2025-09-28T15:09:02.390114Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000001000342907424497
2025-09-28T15:09:02.390118Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000009999261203543292
2025-09-28T15:09:02.448724Z DEBUG vector::internal_events::file::source: Files checkpointed. count=0 duration_ms=0
2025-09-28T15:09:07.390320Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000001000364837457784
2025-09-28T15:09:07.390358Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000010003429074244969
2025-09-28T15:09:07.390361Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000999926120354329
2025-09-28T15:09:09.827968Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source::file_server: event_throughput=0.000/sec bytes_throughput=0.000/sec ratios={"discovery": 6.1292326e-8, "other": 1.1947075e-5, "sending": 7.1288114e-6, "sleeping": 0.99998087}
2025-09-28T15:09:12.389842Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000001000364837457784
2025-09-28T15:09:12.389878Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000010003429074244967
2025-09-28T15:09:12.389881Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000009999261203543289
2025-09-28T15:09:17.390326Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000010003648374577837
2025-09-28T15:09:17.390358Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000010003429074244964
2025-09-28T15:09:17.390361Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000009999261203543286
2025-09-28T15:09:22.390221Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000010003648374577835
2025-09-28T15:09:22.390254Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000010003429074244962
2025-09-28T15:09:22.390257Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000009999261203543285
2025-09-28T15:09:27.390256Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000010003648374577834
2025-09-28T15:09:27.390320Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000001000342907424496
2025-09-28T15:09:27.390323Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000009999261203543282
2025-09-28T15:09:32.389902Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000010003648374577832
2025-09-28T15:09:32.389944Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000010003429074244957
2025-09-28T15:09:32.389947Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000999926120354328
2025-09-28T15:09:37.389958Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000001000364837457783
2025-09-28T15:09:37.389992Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000010003429074244954
2025-09-28T15:09:37.389995Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000009999261203543278
2025-09-28T15:09:42.389702Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000010003648374577828
2025-09-28T15:09:42.389736Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000010003429074244952
2025-09-28T15:09:42.389739Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000009999261203543275
2025-09-28T15:09:47.390314Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000010003648374577826
2025-09-28T15:09:47.390349Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000001000342907424495
2025-09-28T15:09:47.390352Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000009999261203543273
2025-09-28T15:09:52.390108Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000010003648374577824
2025-09-28T15:09:52.390144Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000010003429074244948
2025-09-28T15:09:52.390147Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000999926120354327
2025-09-28T15:09:57.389773Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000010003648374577822
2025-09-28T15:09:57.389805Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000010003429074244945
2025-09-28T15:09:57.389808Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000009999261203543267
2025-09-28T15:10:02.389938Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000001000364837457782
2025-09-28T15:10:02.389973Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000010003429074244942
2025-09-28T15:10:02.389976Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000009999261203543265
2025-09-28T15:10:02.449686Z DEBUG vector::internal_events::file::source: Files checkpointed. count=0 duration_ms=0
2025-09-28T15:10:07.389694Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000010003648374577818
2025-09-28T15:10:07.389730Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000001000342907424494
2025-09-28T15:10:07.389734Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000009999261203543263
2025-09-28T15:10:11.307697Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source::file_server: event_throughput=0.000/sec bytes_throughput=0.000/sec ratios={"discovery": 5.035812e-8, "other": 1.2162056e-5, "sending": 8.572999e-6, "sleeping": 0.9999792}
2025-09-28T15:10:12.390343Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000010003648374577816
2025-09-28T15:10:12.390381Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000010003429074244937
2025-09-28T15:10:12.390385Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000009999261203543261
2025-09-28T15:10:17.389757Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000010003648374577814
2025-09-28T15:10:17.389799Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000010003429074244935
2025-09-28T15:10:17.389802Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000999926120354326
2025-09-28T15:10:22.389540Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000010003648374577813
2025-09-28T15:10:22.389583Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000010003429074244932
2025-09-28T15:10:22.389587Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000009999261203543257
2025-09-28T15:10:27.390306Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000001000364837457781
2025-09-28T15:10:27.390341Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000001000342907424493
2025-09-28T15:10:27.390345Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543254
2025-09-28T15:10:32.389964Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577808
2025-09-28T15:10:32.390004Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244927
2025-09-28T15:10:32.390025Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543252
2025-09-28T15:10:37.390302Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577806
2025-09-28T15:10:37.390338Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244926
2025-09-28T15:10:37.390341Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000999926120354325
2025-09-28T15:10:42.390029Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577803
2025-09-28T15:10:42.390069Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244924
2025-09-28T15:10:42.390073Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543249
2025-09-28T15:10:47.389661Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577801
2025-09-28T15:10:47.389713Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244921
2025-09-28T15:10:47.389716Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543247
2025-09-28T15:10:52.390385Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577799
2025-09-28T15:10:52.390426Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244918
2025-09-28T15:10:52.390429Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543245
2025-09-28T15:10:57.389531Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577796
2025-09-28T15:10:57.389567Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244917
2025-09-28T15:10:57.389570Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543242
2025-09-28T15:11:02.389955Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577794
2025-09-28T15:11:02.389994Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244914
2025-09-28T15:11:02.389998Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543239
2025-09-28T15:11:02.450557Z DEBUG vector::internal_events::file::source: Files checkpointed. count=0 duration_ms=0
2025-09-28T15:11:07.389651Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577792
2025-09-28T15:11:07.389684Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244912
2025-09-28T15:11:07.389687Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543237
2025-09-28T15:11:12.390349Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000001000364837457779
2025-09-28T15:11:12.390382Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000001000342907424491
2025-09-28T15:11:12.390385Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543235
2025-09-28T15:11:12.783402Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source::file_server: event_throughput=0.000/sec bytes_throughput=0.000/sec ratios={"discovery": 3.58516e-8, "other": 1.25813895e-5, "sending": 6.514108e-6, "sleeping": 0.99998087}
2025-09-28T15:11:17.390318Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577789
2025-09-28T15:11:17.390354Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244907
2025-09-28T15:11:17.390358Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543234
2025-09-28T15:11:22.390324Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577786
2025-09-28T15:11:22.390357Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244905
2025-09-28T15:11:22.390360Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543232
2025-09-28T15:11:27.390124Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577784
2025-09-28T15:11:27.390159Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244903
2025-09-28T15:11:27.390162Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000999926120354323
2025-09-28T15:11:32.390088Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577781
2025-09-28T15:11:32.390122Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244902
2025-09-28T15:11:32.390125Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543228
2025-09-28T15:11:37.389848Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001000364837457778
2025-09-28T15:11:37.389878Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244899
2025-09-28T15:11:37.389881Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543226
2025-09-28T15:11:42.389514Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577777
2025-09-28T15:11:42.389543Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244896
2025-09-28T15:11:42.389546Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543224
2025-09-28T15:11:47.390384Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577774
2025-09-28T15:11:47.390412Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244894
2025-09-28T15:11:47.390415Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543221
2025-09-28T15:11:52.389517Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577773
2025-09-28T15:11:52.389547Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244893
2025-09-28T15:11:52.389550Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000999926120354322
2025-09-28T15:11:57.389655Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577771
2025-09-28T15:11:57.389707Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001000342907424489
2025-09-28T15:11:57.389711Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543217
2025-09-28T15:12:02.390356Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001000364837457777
2025-09-28T15:12:02.390395Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244887
2025-09-28T15:12:02.390398Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543215
2025-09-28T15:12:02.452085Z DEBUG vector::internal_events::file::source: Files checkpointed. count=0 duration_ms=0
2025-09-28T15:12:07.389627Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577768
2025-09-28T15:12:07.389668Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244886
2025-09-28T15:12:07.389671Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543212
2025-09-28T15:12:12.389785Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577766
2025-09-28T15:12:12.389824Z DEBUG vector::utilization: utilization=0.000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244883
2025-09-28T15:12:12.389827Z DEBUG vector::utilization: utilization=0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000999926120354321
2025-09-28T15:12:14.257541Z DEBUG source{component_kind="source" component_id=okd component_type=kubernetes_logs}:file_server: file_source::file_server: event_throughput=0.000/sec bytes_throughput=0.000/sec ratios={"discovery": 4.213158e-8, "other": 1.1583663e-5, "sending": 7.3010124e-6, "sleeping": 0.99998105}
2025-09-28T15:12:17.390411Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003648374577765
2025-09-28T15:12:17.390452Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010003429074244882
2025-09-28T15:12:17.390455Z DEBUG vector::utilization: utilization=0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009999261203543208

[thomasqueirozb]

Your configuration is likely wrong as the utilization metric and file source show that nothing is being written and no files are being observed. It is possible no files are present in /var/log/pods. I'd sh into the container and ls /var/log/pods

I also suggest following the official redhat guide if you're using openshift 4: https://developers.redhat.com/articles/2025/09/04/how-migrate-fluentd-vector-openshift-4?sc_cid=RHCTG0240000434042#migrate_fluentd_to_vector_in_openshift