We currently only check on test runs, but if you have a syntax error (in my case, usually a bit of Python 3-only valid syntax that then gets caught in CI on Python 2), it would be nice to have the ...