Skip to content

Verify tests are fully independent #256

@ArBridgeman

Description

@ArBridgeman

Summary

Use a library (e.g. pytest-randomly) or a nox session modification to run the tests in a random (yet reproducibly random order).

Verify that all tests can be run independent of one another by executing the random order at least 5 different ways.

Create a list of any tests that cannot be run independently and create follow up tasks to resolve:

  • ./test/integration/formatter_test.py  test_complex_format_string affects test/integration/metadata_test.py test_list_indices. Without the former being run, the latter fails locally and in the CI.

Metadata

Metadata

Assignees

No one assigned

    Labels

    refactoringCode improvement without behavior change

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions