Functional Testing vs Performance Testing

Within the paradigm of application testing, there are two broad categories of tests which are often used to complement each other. While there are dedicated tools for each, there is considerable overlap and many of these tools can be used for either purpose. In particular, tools such as JMeter, while traditionally being more associated with performance tests, can be proposed to execute functional tests. In this article, we will describe what each test seeks to proveRead More →

A Gentle Introduction to Load Testing

Suppose you are suddenly tasked with the responsibility to prove application performance through load testing. You have never done this before. Where would you begin? In this article, we will discuss how to approach the planning, selection of tools, and architecture through the typical phases of load testing. Defining Capacity Metrics First, you would have some homework to do. Based on testing goals, there are a number of key performance metrics that should be defined. ItRead More →

Using the JMeter Counter Element

The Counter element is a built-in feature of JMeter which generates sequential reference numbers within the scope of a thread group. These sequential numbers can be useful in identifying or grouping requests originating from a discrete iteration within a recurring process. In this brief article, we will review the features of the Counter element and describe how it may be utilized in a JMeter load test. Configuring the Counter Element There are several parameters that mayRead More →

Getting a “Grounded” Test to Launch

RedLine13 makes it easy to scale your load tests in the cloud, but sometimes there are a few moving parts to coordinate. While it can be disappointing when a test fails to start, in most cases there are only a few common reasons preventing such a “grounded” test from launching. In this article, we will walk through some of these common scenarios. In each of these cases we will discuss troubleshooting steps and potential solutions. NetworkRead More →

The JMeter Loop Controller

Logical flow is an essential aspect of most performance tests. In previous posts we have explored conditional flow elements such as the If Controller, and deterministic test flow using Assertions. In other cases, we may simply want to have control over running a repeating set of requests. The JMeter Loop Controller is a built-in component providing this functionality, which will iterate over a collection of elements and execute them a predetermined number of times. In thisRead More →

Extractor Success Assertion

JMeter extends the useful capability to extract response data into user variables. In a recent post, we covered how to use the Page Data Extractor to find and save data metrics returned in the body of the page for use in post-processor scripts and other test plan elements. It is a reasonable requirement to see if such extractions are successful before proceeding to this other test logic, which can be achieved manually in your scripts. However,Read More →

JMeter Test Plan Check Tool

When scaling your JMeter test, preparation is important. Often, very large tests will require significant coordination in terms of resources. The target test environment will need to be scaled up to match production conditions. Likewise, simulating a large number of users will require launching many load generator servers. As part of this preparation, you may want to check JMeter test plans for consistency before running the test. The JMeter Test Plan Check Tool provides this capability.Read More →

JMeter Page Data Extractor

Data collection is a key aspect of any load test. For most tests this data comes from request metrics such as response time, error rate, throughput, etc. However it is sometimes useful to capture data that is returned on the requested page itself. With JMeter, this is possible using the Page Data Extractor. This plugin can be used to directly plot data metrics returned from requests. Use cases include status monitoring, health checks, and other importantRead More →

JMeter AutoStop Plugin

Especially when running distributed tests, there are cases where we may wish to automatically terminate a JMeter test in progress based on certain in-test conditions. In a previous post we explored how to create a custom script that can terminate a load test upon evaluating a predetermined error condition. The JMeter AutoStop plugin allows us to take a different approach based on aggregate data. While nothing would prevent us from using either of these two approachesRead More →

QualiTlabs Case Study: Cost-Effective Performance Testing for a Healthcare Mobile App

QualiTlabs is an independent software testing services company who conducted a case study using RedLine13 and JMeter to carry out large-scale performance testing. RedLine13 integrates seamlessly with AWS, which allowed QualiTlabs to scale the tests in the cloud while ensuring cost-efficiency. This facilitated simulation of thousands of concurrent users in a flexible, secure, and scalable environment, minimizing the need for additional infrastructure. Through integration of RedLine13 with AWS and the use of JMeter, QualiTlabs was ableRead More →