From the Open Source Load Testing presentation http://www.slideshare.net/richardfriedman/open-source-load-testing Perhaps in a perfect world, every time code is submitted and reviewed, a Jenkins job kicks off a load test against your specific change.  However, in reality, this has quite a few issues: Too early.  Load testing too early in your process is noise Time.  Realistically, most projects are not scoped with time for this Scope.  Changing a readme file should not generate a load test For me, I have foundRead More →

Richard Friedman recently gave a talk at FOSSCON2015  on Open Source Load Testing. It covered Common Sense of Load Testing What we measure with Load Testing Simple Load Testing Process Joys and pain of load testing When do we load test Scaling load tests old way Scaling load tests new way How we monitor the results Review of the Open Source Load Testing Tools such as JMeter, Gatling, The Grinder, and many others. Why integrate load testing with continuousRead More →

We have had an increasing number of JMeter users since we announced support several months ago. We have been adding minor big fixes and improvements along the way as we get feedback. We recently made a couple of changes for large JMX files (20MB was the customer example) and large set of config files (215 was the customer example). We just deployed the ability to upload and expand config files (supports .tar, .gz, .tgz, .zip). When uncompressedRead More →

At times, we want to know the performance of our database queries under load.  These type of load tests would rarely be tested from locations outside your infrastructure.  Opening holes directly to a database in the open would be a poor security model. Redline13 JMeter Load Testing allows you to easily deploy JMeter load plans inside your AWS domain and hammer away with your queries.  In this load test, we started a MySQL instance creating aRead More →

It is not unusual for an application to require hitting a third party endpoint from your own server-side requests.  However, hitting that end point during a load test can lead to serious problems.   Vendor limits: Bing free has a 5,000 / month limit and unpublished per minute and daily limits.  Vendor policy: Determined to be hitting request limits in high bursts can get an account locked If you are determined your load test will access allRead More →

Your JMeter input files can now be split evenly across all your servers.   This can apply to CSV files or any other text file upload, typically provided by the JMeter CSV Data Set Config  The Split file option solves the issues of needing to deal with manually spreading data files between servers so each has a unique data set.    We automatically slice the file so each load server has about the same amount of lines.Read More →

When we first launched with Gatling the community had released 2.0.2 and only a few months later they are at 2.1.4. This community is going fast and furious building better releases. We encourage folks to move to the newest version, but if you are still on 2.0.2 we added multiple version support for Gatling. We will try to keep up with the community as they keep improving the project. Selecting your version for Gatling by using the versionRead More →

We have been working hard on continual new enhancements to RedLine Load Testing. We roll these out as we develop them – a number of them free like Jenkins, Gatling and JMeter  support, and some of them reserved for our Professional version. Here is a recap of all of the features (and pointers to the documentation) we are offering for only $30 per month and UNLIMITED use: Clone Test A one click mechanism to re-run a previousRead More →

Rich and Bob decided to attend AWS re:Invent and demonstrate the fruits of a bunch of work Rich has done to create a more pluggable architecture.  Namely: Load Testing for Continuous Integration and Continuous Delivery with Jenkins Plug-In Simple Scalability with JMeter   If you look at our architecture, Rich added plug-ability to our our core web service via an API that Jenkins could communicate with and control, and the load agent so that it couldRead More →

We now allow you to deploy JMeter tests on RedLine13. This makes it very simple to massively deploy your JMeter tests. RedLine manage and deploy your JMeter test to any number of AWS instances, sizes and regions. RedLine does the startup of those servers (Spot or On Demand) as well as deployment and running of the JMeter tests on those servers and the collection and display of the resulting performance data. You can take any .jmx fileRead More →