About two weeks ago I attended a session at the VMware User Group meeting here in the Netherlands about Project VRC.  After the presentation I asked myself: ‘What is the value of this project?‘.

For you who don’t know what Project VRC is:

“Project Virtual Reality Check (VRC) is a joint venture of Log•in Consultants and PQR, who have researched the optimal configuration for the different available hypervisors (hardware virtualization layers). The project arises from the growing demand for a founded advice on how to virtualise Terminal Server and Virtual Desktop (VDI) workloads. Through a number of researches, Log•in Consultants and PQR show you the scaling possibilities for Terminal Server environments as well as Virtual Desktops.” http://www.virtualrealitycheck.net/

Don’t get me wrong: What they did was a very good initiative, it showed the performance differences between different hypervisors. Although the results were not that surprising it was good to see the validation numbers of the things we already knew.

I also think that the guys who did the project where totally surprised by the attention vendors and customers gave to the project. It was an outstanding (marketing) tool to show the value of virtualization and especially XenApp on a hypervisor. Because of this attention the whole project got out of hand. Although this was not the goal of the project, vendors and customers used it as a reference guide for vitalizing XenApp. That’s the point where I started to wonder what the real value of the project VRC was.

(more…)

Project Virtual Reality Check finally posted a new document about previous results and possible clock drift when using the “Login Virtual Session Indexer (VSI)”.  Previous test setups and results didn’t take into account how different hypervisors handle passing time.

In my opinion this is a serious setback to Project VRC which is considered an institute in the virtualization world. People will start questioning the results when no new tests will be performed.

Below is a description from the Project VRC website explaining the new whitepaper they published on September 14th 2009. This is a must read for people that already did some testing as well as new tests. In short: ‘Because of Windows clock behavior in virtual machines the results were affected and some hypervisors may come out better than they really are.

This whitepaper is a review and reflection on previous Project VRC publications, the benchmark: “Login Virtual Session Indexer (VSI)” and Windows clock behavior within virtual machines.  This discussion is fueled by the fact that results from the individual Project VRC whitepapers are set side-by-side to compare hypervisors. Project VRC has been in discussion with both vendors and community, and performed additional research in this context. Before Project VRC can publish new results, it is important to address any questions, review the impact of this discussion and improve VSI where possible.

You can download it at www.projectvrc.nl

The major conclusions in this Whitepaper are:

(more…)