Hosting test results "Failed" for tests that do not perform assertions.

[costdev]

Several hosts have raised concerns about the "Failed" status showing on the ​Hosting Test Results page.

A recent commit in Core revealed test methods that do not perform assertions. Investigation and resolution of these test methods is ongoing.

However, in looking at the markup of the "Failed" status:

title="13432 tests, 0 failed, 30 errors"

From what I can tell:

1. Risky tests are marked as errors.
2. Errors create a "Failed" result.

Is this the intended behaviour, or can risky tests like these be excluded so as not to create concern with hosts?

[dd32]

The Test Reporter and Test Runner codebases live on GitHub:

​https://github.com/WordPress/phpunit-test-reporter
​https://github.com/WordPress/phpunit-test-runner

This probably should live on one of those repo's, and discussion had with the #hosting team on slack directly.

[costdev]

Thanks @dd32!

I've opened an issue on the Test Runner repo. Setting this ticket to invalid as the discussion and resolution belong elsewhere.

[dd32]

Thanks @costdev!

​https://github.com/WordPress/phpunit-test-runner/issues/167