How We Review Products

Author: John Honovich, Published on Jul 14, 2011

IP Video Market Info has a specific style of reviewing products that often conflicts with common review practices. In this report, we explain how and why we review products the way we do.

Principles of IPVM Review

Let's start with the key principles of IPVM product reviews that differentiate our process:

  • Avoid any category benefits in reviews
  • Reviews must be comparative
  • Reviews must factor in cost prominently
  • Reviews must weigh feature's real world benefits
  • Reviews must recommend applications

Equally important, since our reviews are used by thousands around the world, we cannot assume what the specific use will be.

Avoid Category Benefits

Bad reviews heap praise on a product for features and benefits that any product in its category has. For instance, complimenting an IP camera's capability for viewing via a web browser is inane. Essentially all IP cameras do this and have for years. In the same way, complimenting a VMS for searching by date and time is ridiculous for the same reason.

Each product category has a core set of features that are common across the board. The presence of any of these features should be ignored as it provides no differentiating value.

Comparative Reviews

To determine how different a product is, it is essential to compare to other products in its category. At a minimum, at least 2 other products need to be selected to provide context for the product being reviewed. Saying something is 'good' or 'bad' without providing a comparison is meaningless and misleading. It might make slick marketing but it creates poor analysis.

One basic technique to providing comparisons is to pick one rival product with more feature sets and another rival with less feature sets. A more advanced technique would compare a rival with very similar feature sets, examining the subtle differences between the products.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

Reviewing Cost

One of the most important elements in comparing products and performing reviews is assessing the cost of a product. Unfortunately, most product reviews ignore cost or, at best, mention it in the review's addendum.

Cost is a critical component. Reviews that say one product is the 'best' while ignoring the expense of the product does a dis-service to a reader.

Equally important, the review must relate the cost of the product to the value provided. A product that costs $100 less but is missing a critical feature may be a negative or at least a problem for a certain portion of the market.

Real World Benefits

All features are not beneficial and many 'features' are just marketing spin. A common technique by manufacturers is to create rigged feature comparisons where they take a list of their features and then rate everyone else accordingly.

Even among features that are worthwhile, some features are more valuable than another. Let's say 2 cameras were exactly the same, except one had WDR and D/N capability while the other had SNMP and WiFi support. The overwhelmingly majority of real world users care more about the former than the later.

The review should highlight the most important real world benefits that distinguish a product from its main competitors.

Recommended Applications

Finally, the review should recommend specific applications that given the cost, feature sets provided and competitive alternatives, that the product is most likely to be beneficial. Applications could be scenario based (e.g., low light, non-technical users) or market segment based (e.g., small box retailer, campuses). In a market as competitive and fragmented as video surveillance, a product is almost never best for everyone. The reviewer should clearly indicate both the best and worst applications.

Summary

With these guidelines in mind, a complete review should answer:

  • What products would you compare the reviewed product to?
  • What real world feature sets/benefits differentiate it from those products?
  • What is the price of the product and how does it compare to rivals?
  • Relative to its rivals, what are the best and worst applications to use this product?

Let us know if you have any questions or feedback.


Most Recent Industry Reports

Ladders For Installers Guide on Sep 25, 2018
Ladders are one of the most important pieces of worksite equipment for the surveillance technician. Too often, however, even highly experienced...
Favorite Access Control Reader Manufacturer 2018 on Sep 25, 2018
Favorite reader votes are in, and it is not close. A global access giant ran away with the votes in a one-sided contest. But for many, the...
Genetec Takes Aim At 'Untrustworthy' 'Foreign Government-Owned Vendors' on Sep 24, 2018
Genetec is taking aim at 'untrustworthy' 'foreign government-owned vendors'. This is not a new theme for Genetec as nearly 2 years ago, Genetec...
4MP Camera Shootout - Axis, Dahua, DW, Hanwha, Hikvision, Uniview, Vivotek on Sep 24, 2018
4MP usage continues to climb, especially for low cost fixed lens models. To see who was best, we bought and tested seven 4MP models from Axis,...
Alexa Guard Expands Amazon's Security Offerings, Boosts ADT's Stock on Sep 21, 2018
Amazon is expanding their security offerings yet again, this time with Alexa Guard that delivers security audio analytics and a virtual "Fake...
UTC, Owner of Lenel, Acquires S2 on Sep 20, 2018
UTC now owns two of the biggest access control providers, one of integrator's most hated access control platforms, Lenel, and one of their...
BluePoint Aims To Bring Life-Safety Mind-Set To Police Pull Stations on Sep 20, 2018
Fire alarm pull stations are commonplace but police ones are not. A self-funded startup, BluePoint Alert Solutions is aiming to make police pull...
SIA Plays Dumb On OEMs And Hikua Ban on Sep 20, 2018
OEMs widely pretend to be 'manufacturers', deceiving their customers and putting them at risk for cybersecurity attacks and, soon, violation of US...
Axis Vs. Hikvision IR PTZ Shootout on Sep 20, 2018
Hikvision has their high-end dual-sensor DarkfighterX. Axis has their high-end concealed IR Q6125-LE. Which is better? We bought both and tested...
Avigilon Announces AI-Powered H5 Camera Development on Sep 19, 2018
Avigilon will be showcasing "next-generation AI" at next week's ASIS GSX. In an atypical move, the company is not actually releasing these...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact