CustomerCentrix

There can be unique performance issues introduced when running your application across multiple company networks or in different vendor clouds. Some architects decide to address dispersed user populations by putting a copy of the app in their geography. For instance, LoadStorm runs in Virginia, California, Singapore, and Ireland in order to provide testing that has user traffic originating on different continents.

Any complex data center or network environment can blow up your performance testing models if you don't account for them in test planning and execution. You can get the proper steps built into your scenarios such that the relative volume of user types (anonymous, buyers, admins, etc.) are represented. That said, you probably want to test the scenario volume coming from a corresponding geo.

Application lifecycle performance testing and monitoring strategies on SearchSoftwareQuality by Mike Kelly is an interesting read that has some good info about load and performance testing.

Selected quotes:

"Application performance is often a series of tradeoffs that occur throughout the application lifecycle."

"If we allow for emergent design, we may not recognize the need for a focus on low-level performance metrics early in the project"

"This is why application performance testing and monitoring can be so important for some projects. As teams work to test pre-production, and monitor post-production, they are often looking to tune their application to an ever-changing operating environment with an evolving user population. Tuning application performance isn't unlike sound-mixing – where you're asking people with some specialized skills to "listen" to your application and move a bunch of knobs, sliders, and dials to obtain optimal performance."

We are enjoying much success with our load testing tools.

Why? Good question. We are convinced it is because we are solving a problem for web application developers and web site designers all around the world. Load testing is expensive. Traditionally, commercial load testing tools have cost at least $10,000 - some of the big ones can cost over $1 million. Even with open source software, there is much cost in time to install, configure, and script the tool. Then comes the real problem...where do we get the extra server horsepower to generate the virtual user volume?

I had a good conversation with Roger, our CTO, about the functionality of LoadStorm. He agrees with me that our system will be a good set of general purpose software testing tools.

For example, LoadStorm supports regression testing because it will allow a test plan to be executed repeatedly. The same functionality works for agile testing, performance testing, and endurance testing.

Since we offer a free Breeze account, our clients can essentially use LoadStorm for small volume regression testing...for free. I'm not sure I will invest any money advertising our software testing tools that way, but we will not restrict anyone from using it in this form.

It is an exciting time around here at CustomerCentrix. Roger, Nigel, Christian, Charlie and the rest of the team are ready to release our new load testing tool to beta.

This load testing product is an on-demand web application that utilizes a cloud computing infrastructure. It will allow web developers to easily create test plans with several types of virtual users.

Our goal is to make load testing easy and inexpensive. We are offering a free account to anyone. That removes anyone's objection to trying it because of cost. We believe we can bring significant value to the smaller development shops and to independent developers.