Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Ref doc: /wiki/spaces/DEV/pages/18251777

Why do this?


QRMS (and other PwC teams) run(s) Running parallel test cases (automated and manual) against the same environment (lab). This is an anti-pattern not recommended by sealights that has downsides (listed in red below)

...

  • First test stage start that Sealights detects starts the test stage, last test stage end recieved will end the test stage

  • Coverage will be for all the test cases executed during the time the test stage is open. The downside of this is the coverage report presented by sealights won't be able to distinguish which test suite was responsible for coverage.

  • In general if testing stages use the same environment at the same time then they must use the same test stage name and the coverage presented for that test stage would represent coverage of all testing done during that test stage.

  • In order to get recommendations for a particular test stage / test type, make sure that periodically (every week / two for example) you are able to run just that test stage, without running other test stages in parallel.

...