Automatic Testing: Difference between revisions
Jenningsjwj (talk | contribs) |
Jenningsjwj (talk | contribs) No edit summary |
||
Line 1: | Line 1: | ||
==Quick Test== | ==Quick Test== | ||
To run a "quick" test run this command from <tt>$RSFSRC</tt>: | |||
<bash>admin/quick_test.csh</bash> | |||
The set of 147 examples make 4GB of total data. They run in about 2 minutes total on my system when nothing needs to be updated, and 15 minutes when everything is rebuilt from scratch. Your mileage will vary. | |||
Seven of the 147 examples do not pass all the tests on my system, perhaps because of bugs not yet found :-( These examples are: | |||
book/gee/mda/levint | |||
book/jsg/lpf/lpf | |||
book/sep/bspl/plane3 | |||
book/sep/pwd/alias | |||
book/sep/pwd/hole | |||
book/sep/pwd/signoi | |||
book/sep/stack/miginv | |||
Your mileage will probably vary on this as well. Indeed, I will be curious to see how the tests work on your system (hint, hint :-) | |||
==Testing Scripts== | ==Testing Scripts== |
Revision as of 18:39, 19 June 2010
Quick Test
To run a "quick" test run this command from $RSFSRC:
<bash>admin/quick_test.csh</bash>
The set of 147 examples make 4GB of total data. They run in about 2 minutes total on my system when nothing needs to be updated, and 15 minutes when everything is rebuilt from scratch. Your mileage will vary.
Seven of the 147 examples do not pass all the tests on my system, perhaps because of bugs not yet found :-( These examples are:
book/gee/mda/levint book/jsg/lpf/lpf book/sep/bspl/plane3 book/sep/pwd/alias book/sep/pwd/hole book/sep/pwd/signoi book/sep/stack/miginv
Your mileage will probably vary on this as well. Indeed, I will be curious to see how the tests work on your system (hint, hint :-)
Testing Scripts
The following commands use sfbooklist and sffiglist. Run them from $RSFSRC.
- List all the examples in book that use <program>
sfbooklist uses=<program> list=filter book
- rebuild all the examples in book that use <program>
sfbooklist uses=<program> list=filter command=scons book
- Compare the newly generated figs with the corresponding reference figs stored in $RSFFIGS (defaulted to $RSFROOT/share/figs)
sfbooklist uses=<program> list=filter command="sffiglist rsftest=y list=none" book
- Display any figs that are different from their $RSFFIGS counterparts
sfbooklist uses=<program> list=filter command="sffiglist rsftest=y list=none show=diff" book