Rich and Bob decided to attend AWS re:Invent and demonstrate the fruits of a bunch of work Rich has done to create a more pluggable architecture.  Namely: Load Testing for Continuous Integration and Continuous Delivery with Jenkins Plug-In Simple Scalability with JMeter   If you look at our architecture, Rich added plug-ability to our our core web service via an API that Jenkins could communicate with and control, and the load agent so that it couldRead More →

k6 limitations

K6 is a popular load testing tool but it does have limitations at each of the different subscription levels. Let’s take a look at some of the K6 limitations that are in place and what it will cost if you need higher limits. For the $99/month subscription, you can load test 100 virtual users. That’s not that much. And the test can only run 15 minutes. That’s not much of a load test. And they’ll saveRead More →

What is Free Load Testing? example with JMeter

We created RedLine13 and call it (Almost) Free Load Testing. So, what is it? Other load testing companies talk about free load testing. But is it? First, let’s talk about (Almost) Free Load Testing and why we call it that. Two Cost Components of RedLine13 There are two cost components of RedLine13 load testing: RedLine13 costs and AWS costs. If you choose the free RedLine13 subscription, then your RedLine13 cost is nothing. Free! The free subscriptionRead More →

Large Scale Load Testing and EC2 Limits

If you are doing large scale load testing, you may run up against EC2 limits or other “service quotas” on your AWS account.  In this case, you will need a one-time Amazon approval for running your large tests. Read More →

A common question that RedLine13 users ask is how many vCPUs needed for load testing. One example of such a question might be: I want to do a load test with 500k users. I’m trying to decide how many vCPUs I would need for this, and therefore which plan to go for with Redline13. Please could you advise me on how many users you’d recommend per vCPU. AWS has an article in their documentation which speaksRead More →

Uses Cases JMeter Dashboard

In a previous post we described how to enable and access the JMeter Dashboard Report. It is a useful reporting platform for JMeter tests, providing a sophisticated level of detail alongside powerful summary metrics. In this post we will describe some specific use cases for the JMeter Dashboard Report related to running load tests on RedLine13. Determining Success or Failure of a Test One of the primary goals of load testing is to experimentally derive orRead More →

      RedLine13 Pricing Model When you use RedLine13, there is a RedLine13 subscription cost and an AWS cost. RedLine13 generates the load on your AWS servers as you can see in the diagram below. AWS costs are already ridiculously low. One advantage of this is that you have complete control. If you’re running a low number of tests, your AWS costs will be correspondingly low. Another advantage of the load running on your servers,Read More →

Most load testing tools offer a free version. There are typically many limitations that companies put on you when they offer free load testing. If you don’t like limitations, then you’ll probably want to check out RedLine13. Limitations Here is a common set of free load testing limitations that you’ll find on load testing subscriptions: Number of tests Test duration vCPUs (for load test servers) RedLine13 Free Load Testing Here is what RedLine has to sayRead More →

Continuous Load Testing

How many businesses or organizations actually do continuous load testing? There are typically two purposes for load tests: event-based and continuous load tests. The first is the one we normally think of: load tests that are run due to some external event. It could be a new marketing campaign that is going to drive additional volume. It could be a new version of software and wanting to make sure that it will handle the volume. OrRead More →