Coming from a completely different field (computational linguistics), Ted Pedersen argues that

releasing software that makes it easy to reproduce and modify experiments should be an essential part of the publication process, to the point where we might one day only accept for publication articles that are accompanied by working software that allows for immediate and reliable reproduction of results.

See also slides (and listen to audio) from Ted’s keynote presentation at the 2009 NACCL conference.