Criteria for Evaluating VMS Systems

By: John Honovich, Published on May 24, 2011

For our VMS Competitive Comparison, we identified 9 key differentiators to contrast the abilities of Video Management Systems. In this update, we explain how we ranked each differentiator.

Inside the competitive comparison itself, we provide a 23 minute webcast that explains each one. This update provides a written summary of the criteria.

Levels

We assigned 6 levels for each differentiator:

  • None: System does not support
  • Weak: System supports but is of very limited use
  • Moderately Weak: System supports but has major constraints
  • Moderate: Basic functionality or support but not outstanding compared to competitors
  • Moderately Strong: High degree of functionality but lacking compared to a few competitors
  • Strong: On the highest level of functionality compared to competitors

Metrics for Each Differentiator

We used the following metrics to judge each differentiator:

Pricing

The strongest rating was provided to those systems with the lowest up-front license costs (including base, per channel and add-on license charges). Secondary consideration was given to maintenance charges. No consideration was provided to value or features per price. While this is important, rating value is relative to the features and functionalities one needs. We recommend users compare price to features needed to determine the value for one's own application.

Simplicity

The strongest rating was provided to systems that (a) made commonly used functionalities easy to access (like selecting cameras to view video, adding a camera, exporting a video, etc.), (b) had one or minimal number of client applications and (c) that had 'intelligent' defaults or wizards that simplified setup or technical knowledge required to start running a system.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

3rd Party IP Camera Support

The strongest rating was provided to systems that supported the most total number of 3rd party manufacturers. Supporting of 'standards' was not a factor as industry support is too limited (We will likely change the weight on standards later in 2010 as support increases). Supporting of larger camera manufacturers was not a practical matter as all VMS systems that supported many 3rd party cameras supported the largest manufacturers (e.g., Axis).

3rd Party System Support

The strongest rating was provided to systems that supported the most number of access control, PSIM systems, PoS systems and video keyboards/matrixes. Additional weight was added for VMS systems that supported large providers (e.g., supporting Lenel is more valuable than almost all other access control systems).

Alarm/Event Management

Rating was based on systems that had integrated alarm management inside of their VMS client software. Additional strength was provided to systems that allowed prioritizing alerts, forward alerts, acknowledging alerts and reviewing response procedures for alerts.

Analytics

Strongest rating was provided to systems that supported the broadest number of 3rd party video analytic systems. Weight was detracted from systems that we believed supported more 'motion detection+' rather than 'intelligent video'.

Enterprise Management

Strongest rating was provided to systems that provided centralized account management, configuration and live monitoring across multiple servers. Specifically, strong systems eliminate the need to update passwords manually for multiple servers and allow batch updates to configurations of multiple cameras.

Redundancy

The strongest rating was provided to systems that supported redundancy for their (A) management/enterprise server and (B) recording of specific video channels. No weight was provided to supporting RAID/redundant storage as all VMS systems can support that through COTS hardware.

Video Distribution

The strongest rating was provided for systems that allowed video to be shared or pushed from one client workstation to another over a network. We did not provide any weight to supporting multiple monitors from a single PC (this is very common for systems).

Accuracy of Levels

We believe that most 'ratings' are accurate within 2 levels. For example, we may rate something 'weak' but another informed user might the performance 'moderately weak'.
 
While we have tested these features, we can certainly be slightly off on some details (though we are confident that we are not significantly off - e.g., rating something a strong when really it should be moderately weak, etc.). Secondly, exact ratings from one level to the next is subject to some level of interpretation (e.g., is a system really 'moderately strong' or 'strong').

Discussion

Please use the comments to ask questions or provide suggestions on the criteria selected. 

Please do not comment on specific manufacturer's performance on this thread. I will transfer such comments to the comparison thread as that is the appropriate forum for such discussion.

The Comparison

Read the VMS Competitive Comparison now.

Comments : PRO Members only. Login. or Join.

Related Reports on VMS

Video Surveillance 101 Course Opened on Dec 12, 2019
IPVM is adding a Video Surveillance 101 course, designed to help those new to the industry to quickly understand the most important terms,...
Hikvision DS 2nd Gen Intercom Tested on Dec 12, 2019
With its newest IP intercom, Hikvision proclaims users can 'get full control over an entrance' regardless of where it is installed, home or office...
Acquisitions - Winners and Losers on Dec 10, 2019
Most major manufacturers have been acquired over the last decade. But which have been good deals or not? In this report, we analyze the...
Bosch Budget 3000i Cameras Tested on Dec 05, 2019
Bosch has long had a hole in its lineup for, as it describes, "competitively-priced cameras". Now, Bosch has released its 3000i series cameras...
AVTech ~$70 IP Cameras Tested Vs Dahua and Hikvision on Dec 04, 2019
Taiwanese manufacturer Avtech is taking direct aim at low cost leaders Dahua and Hikvision with ~$70 starlight and white light illuminator...
Vunetrix Health Monitoring Company Profile on Nov 26, 2019
Vunetrix boasts that they make the integrators the 'HERO' by using Vunetrix's monitoring. We spoke to Vunetrix to better understand their...
Top 2020 Trend - AI Analytics on Nov 22, 2019
170+ Integrators answered: What do you think will be the top industry trend in 2020? Why? For the 4th year in a row, AI/video analytics was...
Avigilon H4 Intercom Tested on Nov 20, 2019
Avigilon is well-known for video surveillance and access, but how well does the company's intercom work? We purchased and tested Avigilon's H4...
Open vs End-to-End Systems: Integrator Statistics 2019 on Nov 11, 2019
Preference for open systems is on the decline, according to new IPVM statistics. We asked integrators: For video surveillance systems, do you...
Rhombus Cameras, VMS and Analytics Tested on Nov 06, 2019
Rhombus boasts they have created "the new standard in Enterprise, cloud-managed video security" and told IPVM in January 2019 they offer twice the...

Most Recent Industry Reports

Video Surveillance 101 Course Opened on Dec 12, 2019
IPVM is adding a Video Surveillance 101 course, designed to help those new to the industry to quickly understand the most important terms,...
Verkada Notification Outage on Dec 12, 2019
Verkada is suffering an event notification outage and analytic search failures. Inside, we examine what the issues are, what Verkada told IPVM...
Hikvision DS 2nd Gen Intercom Tested on Dec 12, 2019
With its newest IP intercom, Hikvision proclaims users can 'get full control over an entrance' regardless of where it is installed, home or office...
Honeywell 30 Series Cameras Tested Vs Dahua and Hikvision on Dec 11, 2019
Honeywell has infamously OEMed Dahua and Hikvision for years, but now they have introduced an NDAA-compliant line, the 30 Series, claiming "lower...
"Good Market, Bad Business Models" - Residential Security on Dec 11, 2019
Industry banker John Mack, at his company's annual event, took aim squarely at the problems in the residential security...
IP Camera Browser Support: Who's Broken / Who Works on Dec 10, 2019
For many years, IP cameras depended on ActiveX control, whose security flaws have been known for more than a decade. The good news is that this is...
Acquisitions - Winners and Losers on Dec 10, 2019
Most major manufacturers have been acquired over the last decade. But which have been good deals or not? In this report, we analyze the...
IP Camera Installability Shootout 2019 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview, Vivotek on Dec 09, 2019
What are the best and worst cameras to install? Which manufacturers make it the hardest or easiest to install their cameras? We tested 35 total...
Viisights Raises $10 Million, Behavior Analytics Company Profile on Dec 09, 2019
Viisights, an Israeli AI analytics startup marketing "Behavioral Understanding Systems", announced $10 million Series A funding. We spoke to...
Disruptor Wyze Releases Undisruptive Smartlock on Dec 06, 2019
While Wyze has disrupted the consumer IP camera market with ~$20 cameras, its entrance into smart locks is entirely undisruptive. We have...