Automatic Testing

From Madagascar
Revision as of 18:39, 19 June 2010 by Jenningsjwj (talk | contribs)
Jump to navigation Jump to search

Quick Test

To run a "quick" test run this command from $RSFSRC:

<bash>admin/quick_test.csh</bash>

The set of 147 examples make 4GB of total data. They run in about 2 minutes total on my system when nothing needs to be updated, and 15 minutes when everything is rebuilt from scratch. Your mileage will vary.

Seven of the 147 examples do not pass all the tests on my system, perhaps because of bugs not yet found :-( These examples are:

book/gee/mda/levint book/jsg/lpf/lpf book/sep/bspl/plane3 book/sep/pwd/alias book/sep/pwd/hole book/sep/pwd/signoi book/sep/stack/miginv

Your mileage will probably vary on this as well. Indeed, I will be curious to see how the tests work on your system (hint, hint :-)


Testing Scripts

The following commands use sfbooklist and sffiglist. Run them from $RSFSRC.

  1. List all the examples in book that use <program>
    sfbooklist uses=<program> list=filter book
  2. rebuild all the examples in book that use <program>
    sfbooklist uses=<program> list=filter command=scons book
  3. Compare the newly generated figs with the corresponding reference figs stored in $RSFFIGS (defaulted to $RSFROOT/share/figs)
    sfbooklist uses=<program> list=filter command="sffiglist rsftest=y list=none" book
  4. Display any figs that are different from their $RSFFIGS counterparts
    sfbooklist uses=<program> list=filter command="sffiglist rsftest=y list=none show=diff" book