Criteria for Evaluating VMS Systems

By: John Honovich, Published on May 24, 2011

For our VMS Competitive Comparison, we identified 9 key differentiators to contrast the abilities of Video Management Systems. In this update, we explain how we ranked each differentiator.

Inside the competitive comparison itself, we provide a 23 minute webcast that explains each one. This update provides a written summary of the criteria.

Levels

We assigned 6 levels for each differentiator:

  • None: System does not support
  • Weak: System supports but is of very limited use
  • Moderately Weak: System supports but has major constraints
  • Moderate: Basic functionality or support but not outstanding compared to competitors
  • Moderately Strong: High degree of functionality but lacking compared to a few competitors
  • Strong: On the highest level of functionality compared to competitors

Metrics for Each Differentiator

We used the following metrics to judge each differentiator:

Pricing

The strongest rating was provided to those systems with the lowest up-front license costs (including base, per channel and add-on license charges). Secondary consideration was given to maintenance charges. No consideration was provided to value or features per price. While this is important, rating value is relative to the features and functionalities one needs. We recommend users compare price to features needed to determine the value for one's own application.

Simplicity

The strongest rating was provided to systems that (a) made commonly used functionalities easy to access (like selecting cameras to view video, adding a camera, exporting a video, etc.), (b) had one or minimal number of client applications and (c) that had 'intelligent' defaults or wizards that simplified setup or technical knowledge required to start running a system.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

3rd Party IP Camera Support

The strongest rating was provided to systems that supported the most total number of 3rd party manufacturers. Supporting of 'standards' was not a factor as industry support is too limited (We will likely change the weight on standards later in 2010 as support increases). Supporting of larger camera manufacturers was not a practical matter as all VMS systems that supported many 3rd party cameras supported the largest manufacturers (e.g., Axis).

3rd Party System Support

The strongest rating was provided to systems that supported the most number of access control, PSIM systems, PoS systems and video keyboards/matrixes. Additional weight was added for VMS systems that supported large providers (e.g., supporting Lenel is more valuable than almost all other access control systems).

Alarm/Event Management

Rating was based on systems that had integrated alarm management inside of their VMS client software. Additional strength was provided to systems that allowed prioritizing alerts, forward alerts, acknowledging alerts and reviewing response procedures for alerts.

Analytics

Strongest rating was provided to systems that supported the broadest number of 3rd party video analytic systems. Weight was detracted from systems that we believed supported more 'motion detection+' rather than 'intelligent video'.

Enterprise Management

Strongest rating was provided to systems that provided centralized account management, configuration and live monitoring across multiple servers. Specifically, strong systems eliminate the need to update passwords manually for multiple servers and allow batch updates to configurations of multiple cameras.

Redundancy

The strongest rating was provided to systems that supported redundancy for their (A) management/enterprise server and (B) recording of specific video channels. No weight was provided to supporting RAID/redundant storage as all VMS systems can support that through COTS hardware.

Video Distribution

The strongest rating was provided for systems that allowed video to be shared or pushed from one client workstation to another over a network. We did not provide any weight to supporting multiple monitors from a single PC (this is very common for systems).

Accuracy of Levels

We believe that most 'ratings' are accurate within 2 levels. For example, we may rate something 'weak' but another informed user might the performance 'moderately weak'.
 
While we have tested these features, we can certainly be slightly off on some details (though we are confident that we are not significantly off - e.g., rating something a strong when really it should be moderately weak, etc.). Secondly, exact ratings from one level to the next is subject to some level of interpretation (e.g., is a system really 'moderately strong' or 'strong').

Discussion

Please use the comments to ask questions or provide suggestions on the criteria selected. 

Please do not comment on specific manufacturer's performance on this thread. I will transfer such comments to the comparison thread as that is the appropriate forum for such discussion.

The Comparison

Read the VMS Competitive Comparison now.

Comments : PRO Members only. Login. or Join.

Related Reports on VMS

Axis Perimeter Defender Improves, Yet Worse Than Dahua and Wyze on Sep 19, 2019
While Axis Perimeter Defender analytics improved from our 2018 testing, the market has improved much faster, with much less expensive offerings...
Directory of 68 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Panasonic 4K Camera Tested (WV-S2570L) on Sep 13, 2019
Panasonic has released their latest generation 4K dome, the WV-S2570L, claiming "Extreme image quality allows evidence to be captured even under...
Genetec Stratocast VSaaS Tested on Sep 05, 2019
The VSaaS market is rapidly expanding in 2019, with Verkada, Meraki, Eagle Eye, Avigilon and numerous startups growing their market share. When we...
Scylla AI Video Analytics Company Profile on Aug 29, 2019
Scylla, an AI analytics startup, says they are targeting 1 Billion dollar valuation in 5 years and it "is not rocket science" to detect weapons and...
Uniview Pro 4K Camera Tested (IPC3238ER3-DVZ) on Aug 29, 2019
In our 8MP / 4K Fixed Lens Camera Shootout, Uniview's low end 8MP was firmly in the middle of the pack. Does their higher end Pro Series 4K camera...
Warning: Windows 7 Update Crashing NVRs on Aug 26, 2019
Windows 7 updates are causing VMS servers to fail to boot. After running the update, impacted systems do not boot as normal, instead display this...
Anyvision Facial Recognition Tested on Aug 21, 2019
Anyvision is aiming for $1 billion in revenue by 2022, backed by $74 million in funding. But does their performance live up to the hype they have...
Dahua 4K Camera Shootout on Aug 20, 2019
Dahua's new Pro Series 4K N85CL5Z claims to "deliver superior images in all lighting and environmental conditions", but how does this compare to...

Most Recent Industry Reports

ONVIF Suspends Huawei on Sep 20, 2019
Huawei has been 'suspended', and effectively expelled, from ONVIF so long as US sanctions remain on the mega Chinese manufacturer. Inside this...
Open Access Controller Guide (Axis, HID, Isonas, Mercury) on Sep 19, 2019
In the access control market, there are many software platforms, but only a few companies that make non-proprietary door controllers. Recently,...
Axis Perimeter Defender Improves, Yet Worse Than Dahua and Wyze on Sep 19, 2019
While Axis Perimeter Defender analytics improved from our 2018 testing, the market has improved much faster, with much less expensive offerings...
Directory of 68 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Uniview Prime Series 4K Camera Tested on Sep 18, 2019
Is the new Uniview 'Prime' better than the more expensive existing Uniview 'Pro'? In August, IPVM tested Uniview 4K 'Pro' but members advocated...
US Army Base To Buy Banned Honeywell Surveillance on Sep 17, 2019
The U.S. Army's Fort Gordon, home to their Cyber Center of Excellence, has issued a solicitation to purchase Honeywell products that are US...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Schmode is Back, Aims To Turn Boulder AI Into Giant on Sep 16, 2019
One of the most influential and controversial executives in the past decade is back. Bryan Schmode ascended and drove the hypergrowth of Avigilon...
Manufacturers Unhappy With Weak ASIS GSX 2019 And 2020 Shift on Sep 16, 2019
Manufacturers were generally unhappy with ASIS GSX, both for weak 2019 booth traffic and a scheduling shift for the 2020 show, according to a new...