Reviewer: Dan Romascanu
Review result: Has Issues
This document describes describes the progress of the Open Platform
for NFV (OPNFV) project on virtual switch performance "VSPERF". That
project reuses the BMWG framework and specifications to benchmark
virtual switches implemented in general-purpose hardware. Some
differences with the benchmarking of specialized HW platforms are
identified and they may become work items for BMWG in the future. It's
a well written and clear document, but I have reservations about it
being published as an RFC, and I cannot find coverage for it in the WG
charter. I also have concerns that parts of the methodology used by
OPNFV break the BMWG principles, especially repeatability and
'black-box', and this is not clear enough articulated in the document.
As I was assigned both OPS-DIR and Gen-ART reviews for this document,
I detailed the concerns in my Gen-ART review, they seem to belong
better there.
From an OPS-DIR perspective this document has no issues. If the
concerns in section 6 are addressed and caution is taken to isolate
the SUTs and benchmarking environments from the Internet or
operational intranets, there is no operational impact. If approved it
would be a useful tool for operators to get some information about how
benchmarking of OPNFV project products are being designed.