Pushing The Boundaries Of Testing And Continuous Integratio

A small team, working in an agile group, discusses their experience on how they pushed continuous integration and automation of the performance, scalability and robustness builds of the systems they are developing. Unit testing is often not enough to have confidence that the delivered software complies to the desired quality. More often than not, it is necessary to add multiple layers of testing. Needing to complete the user stories of scalability and performance measurement and improvement, the team built confidence through automated builds that tested robustness, performance and scalability.

The session tells the story of the evolution of such builds, the incremental approach taken to automated build and testing of functionals and non-functionals and the benefits (and drawbacks) gained by automating such processes.

The first part of the talk exposes how a highly concurrent VoIP application server is continuously built and tested for performance, robustness and scalabiltiy.

The second part of the talk shows how an ordering system built and deployed on a compute and storage virtualised environment is built, deployed, integrated and end to end tested for correctness and robustness from bare metal.

The last part of the session shows some of the technologies used to set up parts of the build system being developed. Portions of code and tools configuration are demonstrated and discussed.

Presenters
Fabrizio Cannizzo, Raghav Ramesh, Robbie Clutton