Rewrite the functional test harness in pytest #488

New issue

Closed

opened 2024-08-25 19:10:41 +00:00 by jade · 2 comments

jade commented

2024-08-25 19:10:41 +00:00

Owner

Obviously it has to be compatible with the current library of shell based tests, but it should be possible to achieve this. Or maybe it's a separate functional-py test suite, I don't really care the exact way it's implemented.

Having a test harness written in pytest would bring a few advantages like better maintainability, better control over subprocess lifetime (with context managers) and the ability to write tests in Python. Obviously it has to be compatible with the current library of shell based tests, but it should be possible to achieve this. Or maybe it's a separate functional-py test suite, I don't really care the exact way it's implemented.

jade added the

devx

E/help wanted

labels 2024-08-25 19:10:41 +00:00

piegames commented

2024-08-28 15:23:20 +00:00

Member

On my wish list of things the new test harness should support to help me test my lang v2 experiments

Be able to test relative paths
feature matrix test with experimental features
different test outcomes with different feature flags

On my wish list of things the new test harness should support to help me test my lang v2 experiments - Be able to test relative paths - feature matrix test with experimental features - different test outcomes with different feature flags

jade added the

testing

label 2024-09-14 19:22:50 +00:00

lix-bot commented

2024-10-05 06:27:13 +00:00

Member

This issue was mentioned on Gerrit on the following CLs:

commit message in cl/2036 ("testsuite: add a functional2 test suite based on pytest")

This issue was mentioned on Gerrit on the following CLs: * commit message in [cl/2036](https://gerrit.lix.systems/c/lix/+/2036) ("testsuite: add a functional2 test suite based on pytest")