History

OOPSLA 2004 Workshop: Component and Middleware Performance.

Deadline September 2, 2004 - Conference October 24-28, 2004, Vancouver, canada

The goal of the workshop is to help advance the current practice of gathering performance characteristics of component systems and middleware implementations through benchmarking. Positions are solicited especially from people with previous or impending benchmarking experience. More information.

July 16th 2004: 2nd ObjectWeb Benchmarking Workshop

A workshop on benchmarking was held in Prague, Czech Republic on july 7th 2004.
The slides of the presentations given during the workshop are available.

June 15th 2004: RUBBoS Servlets v1.2 now available.

Version 1.2 of the Java Servlets implementation of RUBBoS, the bulletin board benchmark, is now available on the JMOB website. Thanks to Niraj Tolia this version fixes the folowing bugs:

Fixed connection pooling
Use of the executeUpdate() method instead of executeQuery() to execute updates
Fixed bug in ModerateComments that tried to load servlet/classname instead of rubbos/servlet/classname
Added two indices missing from the comments and old_comments table
Fixed a couple of grammatical errors in the client

Download RUBBoS Servlets version.

May 10th 2004: RUBBoS Servlets v1.1 is available!

Version 1.1 of the Java Servlets implementation of RUBBoS, the bulletin board benchmark, is now available on the JMOB website. Thanks to Niraj Tolia this version fixes a few bugs:

missing file name in Client/Makefile and Servlets/Makefile
Error message in RUBBoSProperties.java
Typo in database/rubbos.sql
BrowseStoriesByCategory url in URLGeneratorServlets.java

Download RUBBoS Servlets version.

April 14th 2004: Evaluation of JGroups performance and scalability.

An evaluation of JGroups performance and scalability in the context of clustered J2EE application servers is available. JGroups configuration used by popular software such as the Tomcat JSP server or JBoss J2EE server are evaluated with different network technologies, protocol stacks and cluster sizes. Have a look at the results.

April 1st 2004: Java Servlets implementation of RUBBoS available!

A Java Servlets implementation of RUBBoS, the bulletin board benchmark, is now available on the JMOB website. Download RUBBoS Servlets version.

April 5th 2004: ObjectWeb Benchmarking Workshop

A workshop on benchmarking will be held in Grenoble on monday april 5th 2004.
Morning: Presentations about current projects, experiences and interests.
Afternoon: Discussions: identifying relevant frameworks (load injection, monitoring, ...) and collaboration for developments.

Please, send your presentation proposals (title and abstract) or your interests (if you just plan to attend without presenting) asap.

OOPSLA 2003 Workshop on Middleware Benchmarking.

Middleware Benchmarking: Approaches, Results, Experiences

The goal of the workshop is to help advance the current practice of gathering performance characteristics of middleware implementations through benchmarking.
The participants of the workshop will identify requirements and obstacles of middleware benchmarking and form a position on issues such as designing a framework that would allow the design, running and evaluating a diverse range of benchmarks over a diverse range of middleware, designing benchmark criteria that would allow for a meaningful comparison of results collected over different platforms, designing a framework suitable for regular regression testing, or providing means to verify the benchmarking results and their applicability to specific usage situations.
Deadline September 1, 2003 - Conference October 26-30, 2003, Anaheim, California, USA. Visit the Workshop web page.

25 August 2003: RUBiS 1.4.1 released.

New version of the RUBiS benchmark that fixes the Javadoc build process in all implementation .

20 August 2003: RUBBoS available for download on JMOB.

The RUBBoS benchmark that models a bulletin board is available for download .

20 August 2003: TPC-W available for download on JMOB

A Java servlets version of the TPC-W benchmark is available for download. This version is a based on the implementation from University of Wisconsin and uses MySQL as database.

22 may 2003: CLIF released an overview of load test tools.

The report presents an overview of several projects and softwares such as OpenSTA, Grinder,
JMeter, TestMaker, LoadRunner, etc. Download the report from the CLIF web site.

20 may 2003: RUBiS 1.4 released!.

This version has been tested with Tomcat 4.1.24, JBoss 3.2 and JOnAS 3.1.
For more information see the RUBiS web site.

28 April 2003: JVM benchmarks results are available on JMOB.

17 April 2003: JMOB hosts now an open source version of the Stock-Online CSIRO benchmark

An open source version of the Stock-Online CSIRO benchmark is now hosted by JMOB. The Stock-Online benchmark has been used to evaluate in excess of six J2EE 1.2 Application Servers as part of the CSIRO Middleware Technology Evaluation (MTE) project.

December 2002

RUBiS Web site moves from Rice University to ObjectWeb.