Skip to content

Seems like the query "stuck" and return the same value (probably latest value) #319

@benrurepo

Description

@benrurepo

Describe the bug
randomly getting the error:

[error    ] database error                 database=<hostname>
Traceback (most recent call last):
  File "/virtualenv/lib/python3.13/site-packages/query_exporter/db.py", line 482, in connect
    await self._conn.open()
  File "/virtualenv/lib/python3.13/site-packages/query_exporter/db.py", line 346, in open
    self._create_worker()
    ~~~~~~~~~~~~~~~~~~~^^
  File "/virtualenv/lib/python3.13/site-packages/query_exporter/db.py", line 378, in _create_worker
    assert not self._worker
           ^^^^^^^^^^^^^^^^
AssertionError

Also, seems like the query "stuck" and return the same value (probably latest value)

A clear and concise description of what the bug is and when it happens.

Installation details
Using helm chart

keep-connection: false

  • operating system: [OS and version]
    EKS
  • query-exporter installation type:
    • docker image: tag: "3.2.1"

To Reproduce
we are not sure how to reproduce - its happening randomly
we have changed from replicacount: 2 to replicacount: 1 but problem still exist

If possible, please provide detailed steps to reproduce the behavior:

  1. Config file content (redacted of secrets if needed)
    As describe in the readme

  2. Ran query-exporter with the following command line ...
    args: ["--config", "./config1.yaml", "--config", "./config2.yaml"]

  3. Got the error when

  • running on EKS
  • replicacount: 1 or 2 - still getting the error
  • different databases - each DB have dedicated pod and this happening in all of the pods
  • resting the pod "fix" the problem and the problem return randomly after few hours
  • tcpdump on the pod show no traffic when we see the error

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions