How We Review Products

By: John Honovich, Published on Jul 14, 2011

IP Video Market Info has a specific style of reviewing products that often conflicts with common review practices. In this report, we explain how and why we review products the way we do.

Principles of IPVM Review

Let's start with the key principles of IPVM product reviews that differentiate our process:

  • Avoid any category benefits in reviews
  • Reviews must be comparative
  • Reviews must factor in cost prominently
  • Reviews must weigh feature's real world benefits
  • Reviews must recommend applications

Equally important, since our reviews are used by thousands around the world, we cannot assume what the specific use will be.

Avoid Category Benefits

Bad reviews heap praise on a product for features and benefits that any product in its category has. For instance, complimenting an IP camera's capability for viewing via a web browser is inane. Essentially all IP cameras do this and have for years. In the same way, complimenting a VMS for searching by date and time is ridiculous for the same reason.

Each product category has a core set of features that are common across the board. The presence of any of these features should be ignored as it provides no differentiating value.

Comparative Reviews

To determine how different a product is, it is essential to compare to other products in its category. At a minimum, at least 2 other products need to be selected to provide context for the product being reviewed. Saying something is 'good' or 'bad' without providing a comparison is meaningless and misleading. It might make slick marketing but it creates poor analysis.

One basic technique to providing comparisons is to pick one rival product with more feature sets and another rival with less feature sets. A more advanced technique would compare a rival with very similar feature sets, examining the subtle differences between the products.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Reviewing Cost

One of the most important elements in comparing products and performing reviews is assessing the cost of a product. Unfortunately, most product reviews ignore cost or, at best, mention it in the review's addendum.

Cost is a critical component. Reviews that say one product is the 'best' while ignoring the expense of the product does a dis-service to a reader.

Equally important, the review must relate the cost of the product to the value provided. A product that costs $100 less but is missing a critical feature may be a negative or at least a problem for a certain portion of the market.

Real World Benefits

All features are not beneficial and many 'features' are just marketing spin. A common technique by manufacturers is to create rigged feature comparisons where they take a list of their features and then rate everyone else accordingly.

Even among features that are worthwhile, some features are more valuable than another. Let's say 2 cameras were exactly the same, except one had WDR and D/N capability while the other had SNMP and WiFi support. The overwhelmingly majority of real world users care more about the former than the later.

The review should highlight the most important real world benefits that distinguish a product from its main competitors.

Recommended Applications

Finally, the review should recommend specific applications that given the cost, feature sets provided and competitive alternatives, that the product is most likely to be beneficial. Applications could be scenario based (e.g., low light, non-technical users) or market segment based (e.g., small box retailer, campuses). In a market as competitive and fragmented as video surveillance, a product is almost never best for everyone. The reviewer should clearly indicate both the best and worst applications.

Summary

With these guidelines in mind, a complete review should answer:

  • What products would you compare the reviewed product to?
  • What real world feature sets/benefits differentiate it from those products?
  • What is the price of the product and how does it compare to rivals?
  • Relative to its rivals, what are the best and worst applications to use this product?

Related Reports

IPVM To Disrupt Trade Shows With Launch of Online Shows on Mar 17, 2020
IPVM is launching Online Shows, a series of ongoing events that allow sellers...
Pivot3 Mass Layoffs on Mar 27, 2020
Pivot3 has conducted mass layoffs, the culmination of grand hopes, a quarter...
FDA Gives Guidance on 'Coronavirus' Thermal Fever Detection Systems on Mar 30, 2020
The US FDA has given IPVM guidance on the use of thermal fever detection...
Dynamic vs Static IP Addresses Tutorial on Apr 16, 2020
While many cameras default to DHCP out of the box, that does not mean you...
Facial Recognition: Weak Sales, Anti Regulation, No Favorite, Says Security Integrators on Jul 07, 2020
While facial recognition has gained greater prominence, a new IPVM study of...
ADT: 'Fever' Cameras Are Medical Devices on Jun 15, 2020
While many manufacturers are avoiding admitting their 'fever' cameras are...
Uniview Heat-Tracker Temperature Screening Series Examined on Apr 22, 2020
Uniview is marketing #UNVagainstCOVID19 with their Heat-Tracker series,...
Disruptive Free Lead Generation Added To IPVM on May 15, 2020
IPVM has added lead generation for sellers, for free, disrupting the...
ZKTeco SpeedFace+ Are Medical Devices, Per FDA Definition, Contrary Claims Are False on Jun 12, 2020
ZKTeco SpeedFace+ series products are medical devices as defined by the US...
Fever Cameras Are Medical Devices, Per The FDA, Dahua, Feevr, Hikvision, InVid Contrary Claims Are False on May 28, 2020
Fever cameras are medical devices, despite what euphemisms various sellers...
Verkada: "IPVM Should Never Be Your Source of News" on Jul 02, 2020
Verkada was unhappy with IPVM's recent coverage declaring that reading IPVM...
Convergint Refuses To Fix Faked Fever Marketing, FTC Complaint Filed on Jun 19, 2020
Since Convergint has refused to fix their faked fever camera marketing, IPVM...
UK ICO Approves Unconsented Facial Recognition At Security Conferences on Feb 05, 2020
The UK's data protection agency has declined IPVM's GDPR complaint against...
Fever Camera Sales From Integrators Surveyed on Jun 01, 2020
Fever cameras are the hottest trend in video surveillance currently but how...
Beware Of Feevr on Apr 14, 2020
Beware of "Feevr". The company is marketing a 'Feevr' solution that...

Recent Reports

Genetec CEO Declares "We Don't Negotiate Payment With Patent Trolls" on Aug 11, 2020
Are patent trolls like terrorists? Genetec's CEO is coming out strongly...
Hanwha AI Analytics Camera Tested on Aug 11, 2020
Hanwha has released their Wisenet P AI camera, adding person and vehicle...
Alabama Schools Million Dollar Hikvision Fever Camera Deal on Aug 11, 2020
The Baldwin County, Alabama public schools purchased a $1 million, 144-camera...
Dahua Taunts Australian Government, Continues To Sell Illegal Fever Cameras on Aug 10, 2020
Dahua is effectively taunting the Australian government by continuing to sell...
HID Releases VertX Replacement Aero on Aug 10, 2020
HID is replacing two established and broadly supported types of access...
NDAA Compliant Video Surveillance Whitelist on Aug 10, 2020
This report aggregates video surveillance products that manufacturers have...
Telpo China Temperature Tablets Tested on Aug 10, 2020
The provider for overseas companies ranging from Canon Singapore to US'...
Dangerous Hikvision Fever Camera Showcased by Chilean City on Aug 07, 2020
Deploying a fever camera outdoors, in the rain, with no black body, is...
"Grand Slam" For Pelco's PE Firm, A Risk For Motorola on Aug 07, 2020
The word "Pelco" and "grand slam" have not been said together for many years....
FLIR Stock Falls, Admits 'Decelerating' Demand For Temperature Screening on Aug 07, 2020
Is the boom going to bust for temperature screening? FLIR disappointed...
VSaaS Will Hurt Integrators on Aug 06, 2020
VSaaS will hurt integrators, there is no question about that. How much...
Dogs For Coronavirus Screening Examined on Aug 06, 2020
While thermal temperature screening is the surveillance industry's most...
ADT Slides Back, Disappointing Results, Poor Commercial Performance on Aug 06, 2020
While ADT had an incredible start to the week, driven by the Google...
AHJ / Authority Having Jurisdiction Tutorial on Aug 06, 2020
One of the most powerful yet often underappreciated characters in all...
SIA Coaches Sellers on NDAA 889B Blacklist Workarounds on Aug 05, 2020
Last month SIA demanded that NDAA 899B "must be delayed". Now that they have...