Virtualization Technology News and Information
Whitepaper: Virtualization Scalability Comparison

** UPDATE **

Please note, while this paper has a lot of interesting information in it, make sure you note that the paper is dated March of 2006, and is comparing and writing about products that are old and no longer exist.  In fact, many of the conclusions and findings simply are no longer valid with the more modern versions of these products.  The paper is comparing UML Version for Kernel 2.6.7, Vserver version 1.29, Xen version 2.0 and VMware Workstation 3.2 and GSX Server.

As a reader pointed out to me, with all of the benchmark information going around the virtualization community right now, we don't want to get further confused with dated information.

** End of Update **

A new whitepaper out from LRI in France (LABORATOIRE DE RECHERCHE EN INFORMATIQUE) which is offering the following conclusion on their paper "Scalability Comparison of 4 Host Virtualization Tools":

The evaluation of machine virtualization tools is a difficult exercise. We first motivated the use of microbenchmark to better understand the scalability limitations and merits of virtualization tools. We have described a set of metrics (overhead, linearity and isolation), and related microbenchmarks for the CPU, memory, disk and network resources. These metrics allow testing many aspects of these systems, performance as well as usability. We have compared 4 virtualization tools using this methodology: VMware, UML, Vserver and Xen. We clearly noticed strong limitations with VMware and UML, as previously published by other authors, but we have provided a detailed evaluation, identifying overhead, linearity and performance isolation limitations for all machine resources.  Vserver and Xen clearly provide the better performance. However, there is still room for improvements in Vserver and Xen, since they do not provide performance isolation for the network between VMs (which is desirable for some users) and Xen suffers from low intervirtual machine communication performance. A significant limitation of Vserver is that it cannot run kernels for guest virtual machines different to the hosting one. But, compared to Xen, its architecture saves a lot of memory space when running many virtual machines, since only one kernel is shared by all VMs. VMware has the advantage of providing performance isolation for all resources. It also allows running unmodified guest OS at the cost of a high overhead and poor linearity with respect to scalability.

According to their current respective merits and limitations, the compared VM technologies will match efficiently different application scenarios depending on their need in guest OS configuration, performance isolation and scalability. VMware clearly fits scenarios requiring small number of VMs and performance isolation between VMs. Such scenarios are likely to occur for Grid servers ensuring QoS from service level agreement (SLA). In addition, VMware accepts dynamic instantiation of user defined runtime environment, including specialized OS. Xen will match scenarios where many users or applications are deployed, possibly on ported OSes, on the same hardware with a ”best effort” or opportunistic like QoS (the performance of every VM will depend on the workload of the others). Vserver will accommodate more VMs and provide high performance communication between the VMs. But application should be compliant with the VM hosting kernel. Vserver will match for example scenarios where the number of physical nodes running a distributed application with a fixed number of processes may evolve from time to time. UML is the only one which can be runned by an unprivileged user.

Altogether we believe that 1) the result of this study will help users to select the VM technologies corresponding to the characteristics of their application and 2) the proposed metrics and benchmarks could help the VM designers  by evaluating their technology with a third point of view (close to user needs), between real applications and low level VM mechanisms benchmarks.

Read the entire paper, here.

Published Monday, March 26, 2007 5:42 AM by David Marshall
There are no comments for this post.
To post a comment, you must be a registered user. Registration is free and easy! Sign up now!
<March 2007>