Automatic Testing: Difference between revisions
Jenningsjwj (talk | contribs) No edit summary |
Jenningsjwj (talk | contribs) |
||
| Line 5: | Line 5: | ||
<bash>admin/quick_test.csh</bash> | <bash>admin/quick_test.csh</bash> | ||
This script currently (June 19, 2010) runs a set of 147 examples make 4GB of total data. They run in about 2 minutes total on a 2.4 GHz Intel Core 2 Duo MacBook when nothing needs to be updated, and 15 minutes when everything is rebuilt from scratch. Your mileage will vary. | |||
Seven of the 147 examples do not pass all the tests on my system, perhaps because of bugs not yet found :-( These examples are: | Seven of the 147 examples do not pass all the tests on my system, perhaps because of bugs not yet found :-( These examples are: | ||
| Line 17: | Line 17: | ||
book/sep/stack/miginv | book/sep/stack/miginv | ||
Your mileage will probably vary on this as well. Indeed, I will be curious to see how the tests work on your system (hint, hint :-) | Your mileage will probably vary on this as well. Indeed, I will be curious to see how the tests work on your system (hint, hint :-) Post your testing report on rsf-devel. | ||
==Testing Scripts== | ==Testing Scripts== | ||
Revision as of 18:42, 19 June 2010
Quick Test
To run a "quick" test run this command from $RSFSRC:
<bash>admin/quick_test.csh</bash>
This script currently (June 19, 2010) runs a set of 147 examples make 4GB of total data. They run in about 2 minutes total on a 2.4 GHz Intel Core 2 Duo MacBook when nothing needs to be updated, and 15 minutes when everything is rebuilt from scratch. Your mileage will vary.
Seven of the 147 examples do not pass all the tests on my system, perhaps because of bugs not yet found :-( These examples are:
book/gee/mda/levint book/jsg/lpf/lpf book/sep/bspl/plane3 book/sep/pwd/alias book/sep/pwd/hole book/sep/pwd/signoi book/sep/stack/miginv
Your mileage will probably vary on this as well. Indeed, I will be curious to see how the tests work on your system (hint, hint :-) Post your testing report on rsf-devel.
Testing Scripts
The following commands use sfbooklist and sffiglist. Run them from $RSFSRC.
- List all the examples in book that use <program>
sfbooklist uses=<program> list=filter book
- rebuild all the examples in book that use <program>
sfbooklist uses=<program> list=filter command=scons book
- Compare the newly generated figs with the corresponding reference figs stored in $RSFFIGS (defaulted to $RSFROOT/share/figs)
sfbooklist uses=<program> list=filter command="sffiglist rsftest=y list=none" book
- Display any figs that are different from their $RSFFIGS counterparts
sfbooklist uses=<program> list=filter command="sffiglist rsftest=y list=none show=diff" book