The number of lines of code in #curl has of course exploded over time, from 100 in late 1996 to almost 180,000 today, but interestingly our tests seem to generally keep up. Number of tests per KLOC is now over 12. (and yes, a single test can be very simple or very complex, it's not a very precise measurement)
systemd-jaded.scope
in reply to daniel:// stenberg:// • • •i do wonder if the test styles in use aren't keeping up with catching unknown unknowns introduced by ongoing development though: myself and my colleagues on the lix project has spent weeks chasing down three separate bugs in curl since the start of this year (two of which were iirc regressions) relating to various misbehavior related to http/2 and stream pauses. i suspect we simply exercise that feature far more than either anyone else or the test suite.
i wonder if some sort of generative property tests (maybe using a grammar to give possible actions of the server and curl user which are then selected at random) is necessary to reduce the number and severity of state machine bugs reaching users. or maybe doing this genre of property testing with antithesis.com.
Antithesis: autonomous software testing
antithesis.comdaniel:// stenberg://
in reply to systemd-jaded.scope • • •