Criteria for Evaluating VMS Systems

By: John Honovich, Published on May 24, 2011

For our VMS Competitive Comparison, we identified 9 key differentiators to contrast the abilities of Video Management Systems. In this update, we explain how we ranked each differentiator.

Inside the competitive comparison itself, we provide a 23 minute webcast that explains each one. This update provides a written summary of the criteria.

Levels

We assigned 6 levels for each differentiator:

  • None: System does not support
  • Weak: System supports but is of very limited use
  • Moderately Weak: System supports but has major constraints
  • Moderate: Basic functionality or support but not outstanding compared to competitors
  • Moderately Strong: High degree of functionality but lacking compared to a few competitors
  • Strong: On the highest level of functionality compared to competitors

Metrics for Each Differentiator

We used the following metrics to judge each differentiator:

Pricing

The strongest rating was provided to those systems with the lowest up-front license costs (including base, per channel and add-on license charges). Secondary consideration was given to maintenance charges. No consideration was provided to value or features per price. While this is important, rating value is relative to the features and functionalities one needs. We recommend users compare price to features needed to determine the value for one's own application.

Simplicity

The strongest rating was provided to systems that (a) made commonly used functionalities easy to access (like selecting cameras to view video, adding a camera, exporting a video, etc.), (b) had one or minimal number of client applications and (c) that had 'intelligent' defaults or wizards that simplified setup or technical knowledge required to start running a system.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

3rd Party IP Camera Support

The strongest rating was provided to systems that supported the most total number of 3rd party manufacturers. Supporting of 'standards' was not a factor as industry support is too limited (We will likely change the weight on standards later in 2010 as support increases). Supporting of larger camera manufacturers was not a practical matter as all VMS systems that supported many 3rd party cameras supported the largest manufacturers (e.g., Axis).

3rd Party System Support

The strongest rating was provided to systems that supported the most number of access control, PSIM systems, PoS systems and video keyboards/matrixes. Additional weight was added for VMS systems that supported large providers (e.g., supporting Lenel is more valuable than almost all other access control systems).

Alarm/Event Management

Rating was based on systems that had integrated alarm management inside of their VMS client software. Additional strength was provided to systems that allowed prioritizing alerts, forward alerts, acknowledging alerts and reviewing response procedures for alerts.

Analytics

Strongest rating was provided to systems that supported the broadest number of 3rd party video analytic systems. Weight was detracted from systems that we believed supported more 'motion detection+' rather than 'intelligent video'.

Enterprise Management

Strongest rating was provided to systems that provided centralized account management, configuration and live monitoring across multiple servers. Specifically, strong systems eliminate the need to update passwords manually for multiple servers and allow batch updates to configurations of multiple cameras.

Redundancy

The strongest rating was provided to systems that supported redundancy for their (A) management/enterprise server and (B) recording of specific video channels. No weight was provided to supporting RAID/redundant storage as all VMS systems can support that through COTS hardware.

Video Distribution

The strongest rating was provided for systems that allowed video to be shared or pushed from one client workstation to another over a network. We did not provide any weight to supporting multiple monitors from a single PC (this is very common for systems).

Accuracy of Levels

We believe that most 'ratings' are accurate within 2 levels. For example, we may rate something 'weak' but another informed user might the performance 'moderately weak'.
 
While we have tested these features, we can certainly be slightly off on some details (though we are confident that we are not significantly off - e.g., rating something a strong when really it should be moderately weak, etc.). Secondly, exact ratings from one level to the next is subject to some level of interpretation (e.g., is a system really 'moderately strong' or 'strong').

Discussion

Please use the comments to ask questions or provide suggestions on the criteria selected. 

Please do not comment on specific manufacturer's performance on this thread. I will transfer such comments to the comparison thread as that is the appropriate forum for such discussion.

The Comparison

Read the VMS Competitive Comparison now.

Comments : Members only. Login. or Join.

Related Reports

USA's Feevr Thermal Temperature System Examined on Mar 31, 2020
This US company has burst on to the scene, brashly naming itself 'feevr' and...
Use Access Control Logs To Constrain Coronavirus on Apr 09, 2020
Access control users have included capabilities that are not commonly used...
Uniview Heat-Tracker Temperature Screening Series Examined on Apr 22, 2020
Uniview is marketing #UNVagainstCOVID19 with their Heat-Tracker series,...
Camio Presents Coronavirus Social Distancing Analytics on Apr 20, 2020
Camio presented its social distancing analytics for responding to coronavirus...
Dynamic vs Static IP Addresses Tutorial on Apr 16, 2020
While many cameras default to DHCP out of the box, that does not mean you...
Every VMS Will Become a VSaaS on Feb 21, 2020
VMS is ending. Soon every VMS will be a VSaaS. Competitive dynamics will be...
Delayed Egress Access Control Tutorial on Feb 04, 2020
Delayed Egress marks one of the few times locking people into a building is...
Milestone Presents XProtect On AWS on May 04, 2020
Milestone presented its XProtect on AWS offering at the April 2020 IPVM New...
Anyvision Layoffs on Mar 19, 2020
Anyvision has conducted a layoff, citing the impact of coronavirus, joining a...
Vintra Presents FulcrumAI on Jul 02, 2020
Vintra presented its FulcrumAI object recognition and mask detection offering...
Anyvision Presents AI Facial Recognition and Mask Detection on Jun 08, 2020
AnyVision presented its AI facial recognition and mask detection at the May...
ZKTeco Presents SpeedFace Recognition + Body Temperature Detection on Apr 21, 2020
ZKTeco presented its SF1008+ reader with body temperature and face mask...
Pivot3 Mass Layoffs on Mar 27, 2020
Pivot3 has conducted mass layoffs, the culmination of grand hopes, a quarter...
JCI Slashes ISC West Booth 88.8% on Mar 05, 2020
The mega-booth at the main entrance of the ISC West show floor is now...
SenseB4 Presents Cloud Network Device Monitoring on Jun 09, 2020
SenseB4 presented its cybersecurity and network health monitoring products at...

Recent Reports

Indian Government Restricts PRC Manufacturers From Public Projects on Aug 04, 2020
In a move that mirrors the U.S. government’s ban on Dahua and Hikvision...
Directory of 199 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Face Masks Increase Face Recognition Errors Says NIST on Aug 04, 2020
COVID-19 has led to widespread facemask use, which as IPVM testing has shown...
Dahua Loses Australian Medical Device Approval on Aug 04, 2020
Dahua has cancelled its medical device registration after "discussions" with...
Google Invests in ADT, ADT Stock Soars on Aug 03, 2020
Google has announced a $450 million investment in the Florida-based security...
US Startup Fever Inspect Examined on Aug 03, 2020
Undoubtedly late to fever cameras, this US company, Fever Inspect, led by a...
Motorola Solutions Acquires Pelco on Aug 03, 2020
Motorola Solutions has acquired Pelco, pledging to bring blue back and make...
False: Verkada: "If You Want To Remote View Your Cameras You Need To Punch Holes In Your Firewall" on Jul 31, 2020
Verkada falsely declared to “3,000+ customers”, “300 school districts”, and...
US GSA Explains NDAA 889 Part B Blacklisting on Jul 31, 2020
With the 'Blacklist Clause' going into effect August 13 that bans the US...
Access Control Online Show July 2020 - On-Demand Recording of 45+ Manufacturers Presentations on Jul 30, 2020
The show featured 48 Access Control presentations, all now recorded and...
Face Detection Shootout - Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jul 30, 2020
Face detection analytics are available from a number of manufactures...
Sunell is The First China Manufacturer to Market NDAA Compliance on Jul 30, 2020
Most China manufacturers are going to be impacted by the NDAA 'Blacklist...
Ink Labs Relabels China YCX Fever Camera And Steals Dahua's Marketing on Jul 30, 2020
A US company marketed a 'thermal temperature scanner' as its own, selling...
Genetec and Dahua-Backed Intelbras Split Examined on Jul 29, 2020
China is the cause of the breakup between Canada's and Brazil's largest video...
This YouTuber is Now Selling ThermoHealth Temperature Screening on Jul 29, 2020
An enterprising 20-year old is mass marketing medical devices on Facebook and...