At RedLine13 we aim to offer our users a streamlined, informative, and reliable service that often times works in sync with other load testing platforms and services. From running simple URL tests to testing various API’s, we’ve got your back. As RedLine13 continues to offer some of the most competitive subscription pricing on the market (after all, we are “almost” free load testing), RedLine13 becomes a viable and appealing solution not only to be used independently, but we can (and do) play nicely with others. For example, perhaps you’re already running tests with 1,000 users but you need the ability to run Log File Replay? We’ve got that covered. Or maybe you’re just interested in supplementing your existing load tests with a custom test written in PHP or Node.js? We can help with that as well. The purpose of this post is to outline the various ways in which RedLine13 is viable either independently or as a complementary service (in this case, we look at BlazeMeter) when it comes to all-things related to load testing.
The Testing Types We Offer
RedLine13 offers a range of different load and stress tests depending on your specific needs and uses, all of which are beneficial to virtually all kinds of different websites. Currently with RedLine13, users can run Apache JMeter tests, Gatling tests, simple URL tests, and WebDriver tests through JMeter; all of which are scalable. Compared to other load testing platforms in the industry, we largely offer the most popular forms of load tests: the ones that are most frequently used and which are also the most beneficial to the user. Additionally what makes RedLine13 not only different, but a practical means of complementing other services is our custom tests and our Log File Replay. Users are able to create and run custom load tests that have been created in either PHP or Node.js, even with the ability to upload their own unique files. Additionally we offer the users the means to run Log File Replay tests as well. For example, here is a breakdown comparing RedLine13 and BlazeMeter:
| Testing Types | BlazeMeter | RedLine13 |
| Apache JMeter | ✓ | ✓ |
| Gatling.IO | ✓ | ✓ |
| Simple URL | ✓ | ✓ |
| WebDriver | ✓ | ✓(JMeter) |
| Taurus | ✓ | |
| Log File Replay | ✓ | |
| Custom Tests with PHP/Node.js | ✓ |
Integrations
Being able to integrate with others and the need for us to offer various forms of integrations is something we value quite highly. At RedLine13 we are constantly working to incorporate more and more kinds of integrations and integrated services to better suite the needs of our users. RedLine13 offers valuable types of integration tools that are beneficial when it comes to load testing. We offer continuous integration support via our Jenkins Open Source plugin which is one of the most popular (and useful) open source continuous integration tools currently available today. Additionally, other useful integrations and plugins include UBIK LoadPack and Community.
| Integrations | BlazeMeter | RedLine13 |
| Continuous Integration | Jenkins, Bamboo, Travis, Teamcity, CircleCI | Jenkins |
| APM | NewRelic, DynaTrace, AppDynamics, AWS CloudTrail | |
| Config Management | Chef, Puppet, AWS CP, BlueMix | |
| Plugins | Community | Community, UBIK LoadPack |
Our Features Will Make Your Job Easier
One of the most important goals at RedLine13 is to offer the community a host of useful features that can assist them in not only running tests and making user’s jobs easier, but to gain greater insights into the specifics of both the tests and the extrapolated data. From using the Selenium IDE Firefox add-on or creating custom SubNets and security groups with AWS, to just simply having the ability to attach your own files, RedLine13 is anything but featureless. As you can see by the table below, RedLine13 offers some different and useful features when compared with other industry leaders, meaning that RedLine13, yet again, can be another great complementary service if you already are doing load testing yourself.
| Features | BlazeMeter | RedLine13 |
| Mobile Recorder | Cloud | Via JMeter |
| Web Recorder | Chrome | FF-Selenium |
| Simulate Network Conditions | ✓ | |
| Download JMeter Output | ✓ | ✓ |
| Network Configuration | Private IP | AWS SubNets & Security Groups |
| Ability to Attach Files | ✓ | ✓ |
| Types of Attached Files | Split CSV | Split CSV, Expand .Zip/.Tar |
| Detailed and Informative Reports | ✓ | ✓ |
So how much does this all cost?
Our tagline of “Almost” free load testing is simply not just buzzwords, it’s a reality. Here at RedLine13 we strive our hardest to offer you almost free load testing and also a range of compelling subscription plans depending on your budget. RedLine13 was largely created as a response to the industry standard that deemed load testing to be an expensive and daunting endeavor. Luckily, even with our free-to-use subscription plan, RedLine13 offers more features, tools, and access compared to even the biggest names in the industry. With a RedLine13 account, we will help you setup and deploy load testing instances in your own Amazon Web Service account. The user pays for the testing on the spot instances, but even with extremely large and time consuming tests, that price is just a fraction compared to other alternatives on the market. Based on this simple fact alone, we not only offer a compelling service for first-time users or those interested in load testing, but we work great as a complimentary service as well! So no matter what your needs are, whether large or small, RedLine13 is here to assist.
You will find below a basic chart showing how much it would cost to run a range of different tests with both BlazeMeter and RedLine13. Since the cost for the AWS spot instance can fluctuate depending on multiple parameters, we’ve have taken into account what other users have paid for, for similar tests, and have come up with some base estimates. As you will soon see, even though you do pay for the AWS cost, the overall cost still works out to be just fractions of what you would pay elsewhere.
Sample Tests:
| Basic Parameters | BlazeMeter | RedLine13 |
| 1,000 Users | Monthly Cost: $149 Cost Per Test: $0 (maximum 15 tests per month) |
Monthly Cost: $50 Cost Per Test: $0.30 (unlimited tests) |
| 3,000 Users |
Monthly Cost: $649 Cost Per Test: $0 (maximum 20 tests per month) |
Monthly Cost: $50 Cost Per Test: $0.85 (unlimited tests) |
| 5,000 Users | Monthly Cost: ?? (over $649) |
Monthly Cost: $50 Cost Per Test: $1.50 |
| 50,000 Users | Monthly Cost: ?? |
Monthly Cost: $50 Cost Per Test:$6-9 |
| 100 tests of 1,000 users | Monthly Cost: ?? |
Monthly Cost: $50 Cost For 100 tests: $30 |
Next, we have outlined what our free subscription offers you compared to BlazeMeter, in addition to the various paid subscription plans as well. Again, as is the case with all of our plans, users pay to run the AWS spot instances/on-demand.
Free Subscription:
| BlazeMeter | RedLine13 | |
| Maximum Number of Users | 50 Users | Unlimited |
| Max for Selenium WebDriver | 5 Users | Unlimited |
| Load Generator | 1 Shared | Unlimited |
| Number of Tests | 10 Tests | Unlimited |
| Maximum Test Duration | 20 Minutes | 1 Day |
| Data Retention | 1 Week | 1 Month (30 days) |
| Team Members | 1 Member | 1 Member |
Now for those interested in even more options, services, and features, RedLine13 offers three different tiers of paid subscriptions which can completely integrate themselves either with your existing service or as a more affordable replacement. There’s a basic plan, a professional plan, and then finally we also offer enterprising solutions meaning that you don’t have to restrict or confine yourself when it comes to testing. The respective plans are broken down as followed:
The Basic Plan:
| BlazeMeter | RedLine13 | |
| Maximum Number of Users | 1,000 Users | Unlimited |
| Max for Selenium WebDriver | 20 Users | Unlimited |
| Load Generator | 1 Load Agent | Unlimited |
| Number of Tests | 15 per month or 200 per year | Unlimited |
| Maximum Test Duration | 1 Hour | Unlimited |
| Data Retention | 3 Months | 1 year |
| Team Members | 1 Team Member | 1 Team Member |
| Features | Test Replay, Server Management | |
| Cost | $149/Month or $1,188/Year | $50/Month or $500/Year plus AWS* |
*Additionally includes the cost of your AWS spot instances, which range in price depending on use
The Professional Plan:
| BlazeMeter | RedLine13 | |
| Maximum Number of Users | 3,000 Users | Unlimited |
| Maximum Users for Selenium WebDriver | 20 Users | Unlimited |
| Load Generator | 5 Load Agents | Unlimited |
| Number of Tests | 20 per month or 250 per Year | Unlimited |
| Maximum Test Duration | 2 Hours | Unlimited |
| Data Retention | 6 Months | 2 Years |
| Team Members | 1 Team Member | 5 Team Member |
| Features | Test Replay, Server Management, 5 AWS Accounts | |
| Cost | $649/Month or $5,988/Year | $100/Month or $1,000/Year plus AWS* |
*Additionally includes the cost of your AWS spot instances, which range in price depending on use
Enterprise Solutions:
| BlazeMeter | RedLine13 | |
| Maximum Number of Users | Unlimited | Unlimited |
| Max for Selenium WebDriver | Unlimited | Unlimited |
| Load Generator | Unlimited | Unlimited |
| Number of Tests | Unlimited | Unlimited |
| Maximum Test Duration | Unlimited | Unlimited |
| Data Retention | Unlimited | 2 Years |
| Team Members | Unlimited | 5 Team Members |
| Features | Test Replay, Server Management, 5 AWS Accounts, Support | |
| Cost | *Requires contacting salesperson for quote | $2,500/Year plus AWS* |
*Additionally includes the cost of your AWS spot instances, which range in price depending on use
Bringing It All Together
Load testing is arguably one of the more important and beneficial forms of performance testing that websites and companies can use to better enhance the overall user experience, on both ends. Currently, there is a set of different services and platforms available on the market today that allow you to achieve this. However, the “downfall” with many of the SaaS’s currently out there is their high costs, both in terms of operation and what the end user ends up paying. Due to the fact that RedLine13 users run their own AWS spot instances to keep user cost extremely low, our platform was developed in a way that allows us to support and work with other load testing platforms in a relatively easy and affordable manner. Our free-to-use plan is a great supplemental source that can be added with a host of other platforms; it even offers many features that cost extra virtually everywhere else. For example, BlazeMeter offers a respectable and useful list of integrations offered in their base membership. One can then supplement with RedLine13 to run an unlimited number of tests with an unlimited number of users, for example. So you essentially get the best of both worlds when you combine our service with others. Those that are looking for something a bit more serious can opt for our paid monthly memberships which again, when compared to current platforms, are extremely compelling both in terms of features, compatibility, and (most importantly) price. At the end of the day we aim to offer an affordable platform for testing, and one that can be used either with other existing services or independently; the choice is up to you.
1 Comment
Comments are closed.