tree 913dd95b434481eb6dd2ef62eb982974b5b99d3d
parent 304a3e0e7aa78aed76a545dc030148f50a53e15a
author Paul Jolly <paul@myitcv.io> 1613487352 +0000
committer Paul Jolly <paul@myitcv.org.uk> 1613558787 +0000

internal/cuetest: add support for issue-based conditions/checkers

Often tests (whether pure Go tests or testscript scripts) need to be
skipped until such a time as a linked issue is fixed.

This change adds support for a testscript condition and a Go testing
helper function that take a Go/CUE issue link as an argument. In the
case of a testscript condition, it is satisfied unless the
CUE_NON_ISSUES environment variable contains a regular expression that
matches the argument, indicating such issues are no longer issues. This
condition is generally used in conjunction with the skip command. The Go
testing helping function skips a test under the same condition.

The CUE_NON_ISSUES environment variable can therefore be set to
different patterns in order to vary which tests are run (i.e. not
skipped). CUE_NON_ISSUES=. will cause all tests guarded by this check to
be run (assuming the testscript condition is used in conjunction with
skip). Et cetera.

Having structured skips of this sort makes it easier in future to
analyse and verify that issues remain issues, etc.

Change-Id: I6545c87b1c60d3fdf13abb301d90eca6d615153d
Reviewed-on: https://cue-review.googlesource.com/c/cue/+/8761
Reviewed-by: CUE cueckoo <cueckoo@gmail.com>
Reviewed-by: Paul Jolly <paul@myitcv.org.uk>
Reviewed-by: Marcel van Lohuizen <mpvl@golang.org>