|
Before releasing a new version we go through an exhaustive test
procedure. Whereas most companies test their products we feel that
this is a bit nice. Our aim is to kill ImageGlue using any method
possible. We try to break it so that you won't.
We run all our tests on a variety of operating systems on both
single and multi-processor machines.
First we run over seventy different scripts, each of which is
designed to test a particular feature of ImageGlue. Every script
produces a set of output images which can be compared against
reference copies.
Secondly we stress test using standard browsers running on a
number of different machines running against a client server. The
method we use (auto-refresh) places a high load on the web server
while allowing us to keep track of what a client visiting the pages
might see.
Thirdly we stress test using the Microsoft Web Application
Stress Tool. This allows us to place a vast load on the web server
testing a variety of different aspects of ImageGlue and see how the
system performs. We leave this test running for 24 hours monitoring
memory and processor use.
Only if all these tests have been passed we release the
candidate as a beta. We install it on our live web server and place
it on our web site as a beta download. Because of the advanced
error handling methods we use, any errors that occur will
automatically be saved in our web server's Application Event
Log.
If after a defined period of time no errors have been reported
by beta testers or recorded on our web server then we release the
beta. If the candidate fails at any point it's back to the
start.
|