Verified Home

Verified Systems International GmbH

Quality Assurance for Embedded Systems

WARNING: Major bug in RT-Tester 7.0.4 may ignore error-timeout of cluster tests

Posted on April 29, 2024 in category Releases/RT-Tester

In rare circumstances, a timeout of a multi-node cluster test (which should result in TESTERROR) can lead to a situation where

  1. No abstract machine reports this TESTERROR.
  2. The verdicts of test cases (and the test procedure) remains PASS,
    despite the fact that this result is not reliable.

Symptoms:

  • testdata/SUM.tags contains a line:
    ANONYMOUS/<TP-NAME>,TESTERROR,TM 00000000000,SUM.tags#TERMINATION
  • testdata/ALL-TC-COV.csv contains lines with both verdict TESTERROR and other verdicts (like PASS)

Affected Versions:

  • RTT 7.0.0 - RTT 7.0.4
  • It might also happen in older versions, which contain fewer safeguards concerning TESTERROR.

Mitigation:

  • Check testdata/ALL-TC-COV.csv for occurrences of ,TESTERROR,
  • If TESTERROR occurs, but the test procedure / test case verdict does say PASS (or FAIL),
    then the test results are not reliable.

Latest Releases

Publications