SPEC has released SPECjbb2013, a completely redesigned Java server benchmark that includes a ground-breaking new method for measuring response time in critical situations.
SPECjbb2013 replaces SPECjbb2005. The new benchmark has been developed from the ground up to measure performance based on the latest Java application features. It is expected to be used widely by all those interested in Java server performance, including JVM vendors, hardware developers, Java application developers, researchers and members of the academic community.
New features in SPECjbb2013 include:
- A usage model based on a world-wide supermarket company with an IT infrastructure that handles a mix of point-of-sale requests, online purchases and data-mining operations.
- Both a pure throughput metric and a metric that measures critical throughput under service-level agreements (SLAs) specifying response times ranging from 10ms to 500ms.
- Support for multiple run configurations, enabling users to analyze and overcome bottlenecks at multiple layers of the system stack, including hardware, OS, JVM and application layers.
- Exercising new Java 7 features and other important performance elements, including the latest data formats (XML), communication using compression, and messaging with security.
- Support for virtualization and cloud environments.
A first for SPEC Java
“SPECjbb2013 represents a monumental development,” says David D. Keenan, chair of the SPEC Java committee. “This is the first time a SPEC Java benchmark contains metrics that encourage competition for both response time and full-capacity throughput. We think it’ll do for response-time measurement what SPECpower_ssj2008 does for energy-efficiency measurement.”
SPEC members involved in the development of SPECjbb2013 include AMD, HP, IBM, Intel, Oracle, Red Hat and SGI. The Java Subcommittee also consulted with Doug Lea, a professor at SUNY Oswego.
SPECjbb2013 is available immediately from SPEC for $1,500; discounts are available for qualified non-profit and accredited educational institutions. For more information, visit http://www.spec.org/jbb2013/.