Will relative costs to the end user, including SMA's and license renewals, be included? Total affordability, over a certain number of years, should be a major benchmark item, not just product feature sets. If you were doing automobiles, Rolls Royce or Ferrari might have the highest score, but be totally inappropriate for the majority of buyers due to cost factors.
VMS Testing Plan 2013/2014
Published Jul 23, 2013 04:00 AM
** *** ********* ** * ***** new *** ******* ******* ***** ** will ******* **-***** ***** **** ** features *** ******** ***** **** ******** before. ** **** ****, ***** ******** *** ****** ****. *** ********** *** QA *** * *** *********. ***, she **** ** ****** ******* ** testing *** *********** *****.
**** **** ******** *** ******* ******** and ********* *** *** **** ****.
Previously ** ****
*** **** ***** ***** ** *** testing ** ************* **** - ****, ********* **** than * ***** *** **** ******* and * *** *********** **********.
Step * - ******* *********** / *********
**** **** ******, ** *** ******** with ******* *********** / ********* ***** we **** ** ******** *** ***** and ***** **** ****. *** ********, we **** ******* *********-*********************, ***** ** **** * *****, examining *** *** ***** ******* ** how **** ********* ***** ********.
*** ******* ** **** ** ** deliver *********** ********. ** *** ******** has **** ******* ******** *** ********** how ***** **** ** * ******* by ******* *****. *** ********, ****** talk ***** ********* *** **** **** it ****** ******* **? **** ***** it ****** ** *****? **** ******* exist? **** ******* ******** ** ** develop * ********** ** ********** ***** specifics.
** ********** ***** * ***** ******* feature *********** / *********. ****** ******** 2013: ******* ****:
- **** **********
- ****** / *************
- ****** ********* / ********
- ****** *************
- *********
- ************
- ****
- **************
- ***** **********
- ****** ********** ***********
- ****** **********
- *** **** *******
VMSes ******
**********, ** **** ** **** ** to ** *****. *******, *** *** feature / ***********, ** *** ******** to * ** **** ** **********. (The **** ***** ** ****, *** longer **** ****** *****, *** ***** ones **** ** ********). ** ******* 6 ** ****** ** **** ******** while ****** *** ***** ********** ** execute.
***** *** * ** ******** * priority ****** ***** ** ***** *** member ********:
- ******* *** ********* (*** '*** *****')
- ******** *** ***** (*** "** *** Comers')
**** **** *** **** **** *** the '****'. ******, **** ******* *** surprisingly *******. *******, ** **** ***** companies **** **** ***** ****** (******* it ** ** *** ** ** beat ****).
****** ****, ** **** ****** * others ** (** *** ** **** done ******* ***** *** ************ *** we ***** **** *** ***** ******** and * *** ****** **** ****).
Step * - ********** *** *****
***** ** ******** *** (******* ***** of) ******* ***** - ****** **** time ** ********, ** **** ****** to ********** *** *****, ***** *** report **** ***** ** **** * single ************. ** **** *** *** feature ***** ** * ******** *** comparison (*.*., ** **** ** **** Luxriot, ** *** ***, "*******'* ********* is ******/***** **** *********** ******* **** have/lack ******** ******** *, * *** Z ********** ****** ** *** ********* comparison, ***.).
***** *** ******* ****** ** ***** worth ******* *** ** **** **** to ** **, *** **** ******* * ** ** *** *** feature *****.
Step * - ***** **** ****
****** *** ****, ** **** ** release ** *** *** **** *** Competitive ********** **** ****** **** ******* by ******* *** ***** ***** **, letting ********** *** ***** **** ***** the ******** ********** *** *** **** VMSes ******* ****** **** ***** ********* / ***** ****.
Going *******
*********, **** ** **** *** *********. After **** *, ** **** ******** to ******, **** **** ******** ******* as **** ** *** *** *******. This, ******, ****** **** ** ******** of *** ******* ******** *** *** next ****. *** ** **** **** questions ** ******** *** ****.
Comments (13)
Ted Curtin
Jul 23, 2013SW
Sarit Williams
Jul 23, 2013Hi Ted,
Yes, we absolutely will cover total costs and compare to overall features/value delivered. The focus to start is understanding and documenting how the VMSes work, since this takes the most time. Once we do that, we can start comparing to the costs to better understand the relative value.
Ross Vander Klok
Jul 24, 2013Welcome Sarit, I am looking forward to the reports! I am curious as to the level of “training” that these reviews will contain in the future? I don’t mean full how to type set up guides for each VMS or anything that in depth. Just some basics and maybe some tips/tricks discovered through using the VMS.
SW
Sarit Williams
Jul 24, 2013Thank you Ross! I will certainly continue to include training tips/tricks discovered in each VMS (like in the multistream and exporting reports). Additionally, we will be preparing new VMS 101 training to help train members on fundamentals and main differentiators; I hope to see you there.
RG
R Gleason
Jul 25, 2013What happens as feature sets change and evolve? Most certainly all vendors will have changes and upgrades in time for ISC. And where does Avigilon stand with IPVM continuing research on their products? Does IPVM foresee issues with obtaining new cameras or software updates from them considering the recent and ongoing problems with them?
Ethan Ace
Jul 25, 2013I'll leave the first couple questions to Sarit, but as far as Avigilon: we have sources for Avigilon product and support has actually been answering questions for us. We also have sent questions and copies of posts their way, as we do with all manufacturers when doing tests or updates, but they have chosen not to respond.
So in short, we don't see it as a problem, and we welcome their feedback on technical issues, as always, if they choose to give it.
TO
Thomas O'Connor
Jul 25, 2013Would be interesting to also redo the integrator surveys again that you performed a couple years back.
JH
John Honovich
Jul 25, 2013Hi Thomas, We are going to redo them. However, it has not even been 2 years yet (e.g., favorite VMSes) so we are waiting to give some time for things to actually change. This fall would looks like an appropriate time.
Christopher Freeman
Aug 01, 2013Great Job ,
Can you include support issues relevant to the vms?
Can we send in suggestions on some weve used in past?
look forward to this report .
SW
Sarit Williams
Aug 01, 2013Christopher,
Thanks so much. Please feel free to email any info to sarit@ipvm.com; any information you have would be greatly appreciated. I can tell you that as I'm setting up these environments and clients and going through this process as an end user would I have lots to write about (errors during install, crashes, activations, etc) and those subjects are certainly on the list.
JE
Jim Elder
Aug 03, 2013This is great and I look forward to the analysis. Would it be possible to see table listing all features in a side-by-side comparison? Each feature set would also need to be explained as well. I understand that such a schedule may be difficult, but it would be pretty easy to follow.
KD
Krishnaiah Dayyala
Aug 03, 2013Sarit, John,
This is exactly what we think is required for BMS benchmarking. As some time back I raised this in this forum seeking the stress testing approaches as well as quantitatively measuring the features/performance.
I am looking forward the step1 and also will be happy to contribute in the process.
Thanks, Krish
SW
Sarit Williams
Aug 03, 2013Thank you Krish and Jim for the suggestions- duly noted! We will continue to jot down suggestions and recommendations as we expand our baseline tests.