Testing Vitamin D Video Analytics Software

Author: Scott Oie, Published on Mar 05, 2010

With significant tech blog coverage, Vitamin D has generated widespread interest in using their video analytics. Two of the most commonly cited points is their technology, called HTM, that is based on a "new theory of human intelligence" and their "freemium" business model that allows for free or inexpensive on-line access to their video analytics.

In this test, we examined Vitamin D Version 1.0, running on a Windows 7 laptop analyzing video from 3 cameras: a Logitech webcam, an IQinVision basic series camera and an Axis HD camera. We choose a range of cameras to better understand how Vitamin D performs on different inputs. The Vitamin D software Starter Edition can be freely downloaded so you can test for yourself.

Our key findings include:

  • Easy to set up and worked with a wide range of cameras
  • Significant false positives and negatives in certain environmental conditions
  • Provides video management (record and search) capabilities (though quite basic)
  • Performance can vary greatly based on capabilities and characteristics of camera used
 
We think the most interesting aspect of Vitamin D is making analytics easier and less expensive for broader use. By contrast, the most over-hyped element is the breakthrough technology claim. While we think the market positioning is innovative, in our tests, the analytics themselves proved to be neither exceptionally accurate nor efficient to process relative to current industry offerings.
 
This is, of course, a 1.0 release so we will track and re-test as the product matures.
 
Readers may contrast this to our test results of VideoIQ, who provides video analytics more oriented for the business/professional market.

Product Overview

Vitamin D is software designed to run on Windows or MAC PCs and connect to webcams or regular IP cameras (see the specification sheet for background). Vitamin D works with a modest range of network cameras including Axis, ACTi, Panasonic, IQinVision (see camera interoperability specification).

Vitamin D has two major functions: (1) analyzing video and (2) providing video management of that video.

For analyzing video, the system scans for objects and people on cameras by default and without configuration/optimization (though advanced users can change the minimum pixel size or set more complex rules to fine tune detection and alerts). Analyzing video happens as a background process (not a service) and runs regardless of the Vitamin D client.

The Vitamin D client allows users to (1) watch live video, (2) search for specific events and (3) configure the system. Most importantly, searching for specific events is done via a collection of events. Each event is listed in a row with the type of event (e.g., person) and a small thumbnail of the image for that event). Users can scan through the rows and play back video from each event.

The Vitamin D client is a local client only and does not allow for easy web based or thick client viewing from a remote computer.

The system also allows events to be emailed or dispatched to users. As we examine in the performance/usability section below, common conditions can cause extreme numbers of false alerts. We recommend users set up more advanced rules and only send notices based on those rules (to eliminate  messages triggered by common false alerts)

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

By default, the system records 48 hours of continuous video. After 48 hours, video is discarded unless the video is part of a specific event captured by the system. This cannot be changed.

The maximum recording duration is set by the amount of hard drive space one allocates for storage. By default, this is 25 GB but it can be changed in the Vitamin D client.

Vitamin D offers 3 product packages that differ in maximum resolution and number of channels supported. 

Pricing

Vitamin D can be acquired and purchased on-line:

  • The entry level offering is free but only supports 1 camera and 320 x 240 resolution.
  • The mid level offering is $49, supports up to 2 cameras and 640 x 480 resolution.
  • The high end offering is $199, supports unlimited number of cameras and 640 x 480 resolution. Unlimited support is the licensing agreement for a given server. However, Vitamin D is fairly processor intensive and is unlikely to run more than 4 -8 cameras even on a new 2009/2010 machine. 

CPU Utilization

Our tests concurred with Vitamin D's system hardware specification recommending 2 cameras per CPU core on a dedicated machine (1.5 cameras per CPU core on a machine multi-tasking with personal applications): In our tests, we used a PC with an Intel Core 2 Duo CPU and connected two IP cameras and one consumer webcam.

With three cameras connected simultaneously at 320x240 resolution on a dedicated machine and with the Vitamin D client not running, the CPU usage was measured at the range of 55% - 60%.

Changing the resolution of the three cameras to 640x480 resolution, CPU usage risen to the range of 75% - 80%.

In all tests, we did not run any other non-essential applications (web browsers exited, video players shut down, etc.). With the client application running, CPU utilization increased an additional 5-10%.

Setup and Configuration

In the screencast below, we examine key points in setup and configuration including:

  • Associating cameras/webcams to system via a wizard is beneficial for non technical users.
  • Integrated IP finder function included in camera setup wizard but not accessible in normal interface.
  • Rule editor interface options logically organized but setting up detection regions may be confusing for non technical users.

System Usability Challenges

After placing Vitamin D's analytics under extensive environmental test conditions, we found the following conditions provide the best performance for the system.

Recommended best conditions to apply analytics:

  • Indoor scene
  • Still condition (no vegetation or curtains that may move from a gust of wind)
  • Small to moderate field of view
  • Controlled daytime lighting
We validate these recommendations by discussing the various enviromental and technical challenges that impact the effectiveness of the Vitamin D system.
 
Factors that impacted Vitamin D's analytic performance:
  • Analytics affected depending on the output camera noise of different cameras.
  • Experienced poor low light performance unless subject/object produced its own light source (holding a flashlight, car headlight turned on). [You could require lights to be on at night but this may not be practical or wanted, etc.]
  • High amount of false alerts from shaking trees, moving curtains, stray lights, and light camera shake.
  • Subject not detected if scene has a field of view width beyond 40 feet.

Contrast to 'Smart Cameras'

In the professional surveillance market, 'smart' cameras or analytics running on-board cameras is the 'hot way to go' (though more analytics are still deployed server based). Since VitaminD is a server based solution, it's worth considering the trade-offs.

On the plus side, VitaminD can work with many cameras, including cameras that already deployed or low cost cameras that can be bought from electronic/computer retailers. On the negative side, VitaminD's performance can be heavily impacted by the camera chosen. Users may not realize this and will blame the system regardless of who's fault this is. We saw this practically with the complete darkness of the webcam at night (missing almost everything) and the noise from the IQ camera (constantly false alerting).

VitaminD can reuse existing PCs one already has. However, because VitaminD is so computing intensive, 4-6 cameras can max out a $500 computer. While the software may be very inexpensive, the hardware costs can become non-trivial for more than a few cameras.

Because various combinations of cameras and VitaminD can cause different problems, troubleshooting and support can be more difficult. [VitaminD does not disclose its phone number on the website] You may get email or forum based support but it may be hard for them to determine specific causes from different cameras.

On the other hand, smart cameras at a consumer or SMB price point are rare or non-existent. While ioimage, ObjectVideo (through OEMs), VideoIQ, etc. offer smart cameras, they all are $1,000 or more. The only 'lower-cost' smart camera we recall is the recently released Archerfish Solo which is about $400 but requires a monthly subscription fee.

Recommendations on Use for Residential or SMB Applications

We think use for residential and SMB is promising but there are important constraints for these users to keep in mind:

  • While the analytics are easy to setup, it's easy to place them in environments where they may not perform well or with cameras that may not be sufficient for the lighting conditions.
  • While Moore's Law makes computing power cheaper every year, right now, VitaminD takes a heavy load on commonly available PCs. If you need more than 4 - 6 cameras, this system is probably not practical.
  • The VitaminD VMS, outside of intelligent searching is very rudimentary. If you need remote live viewing, PTZ controls, extended continuous recording or other common VMS functionalities, you are unlikely to be happy with VitaminD (at least version 1.0).

Related Reports on Video Analytics

Avigilon Announces AI-Powered H5 Camera Development on Sep 19, 2018
Avigilon will be showcasing "next-generation AI" at next week's ASIS GSX. In an atypical move, the company is not actually releasing these...
VMS Export Shootout - Avigilon, Dahua, Exacq, Genetec, Hikvision, Milestone on Sep 13, 2018
When crimes, accidents or problems occur, exporting video from one's video surveillance system is critical to proving incidents. But who does it...
US DARPA Investing $2 Billion In AI on Sep 11, 2018
The US Defense Advanced Research Projects Agency (DARPA) is granting more than $2 Billion to companies developing new AI technologies. The money...
Luxriot VMS Profile on Aug 23, 2018
Luxriot is more popular than Hikvision and Milestone products according to ASMAG which was probably even surprising to Luxriot. The company has...
Video Analytics Integration Guide on Aug 16, 2018
Video analytics is hot again (at least conceptually) but integrating video analytics with VMSes can be challenging. This is especially significant...
ISS VMS / Video Analytics Company Profile on Aug 16, 2018
Who is ISS? In the past few months, they had one of the craziest ISC West promo items in years. Then, they hired industry veteran and ex-Dahua...
IP Camera Analytics Shootout - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview on Jul 30, 2018
Video analytics are hot again. But whose analytics really work? IPVM bought and tested Avigilon, Axis, Bosch, Dahua, Hanwha and Hikvision cameras,...
Eagle Eye Networks Cloud VMS Tested on Jul 26, 2018
Eagle Eye has become one of the most significant players in the industry in the past few years: Eagle Eye's Owner Acquired Brivo Eagle Eye...
Avigilon "Self-Learning" Analytics And VMD Tested on Jul 23, 2018
Avigilon is a popular choice for video analytics, offering "self-learning" analytics built into their cameras as well as appliances. We tested...
Directory of Video Surveillance Startups on Jul 18, 2018
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known entity...

Most Recent Industry Reports

BluePoint Aims To Bring Life-Safety Mind-Set To Police Pull Stations on Sep 20, 2018
Fire alarm pull stations are commonplace but police ones are not. A self-funded startup, BluePoint Alert Solutions is aiming to make police pull...
SIA Plays Dumb On OEMs And Hikua Ban on Sep 20, 2018
OEMs widely pretend to be 'manufacturers', deceiving their customers and putting them at risk for cybersecurity attacks and, soon, violation of US...
Axis Vs. Hikvision IR PTZ Shootout on Sep 20, 2018
Hikvision has their high-end dual-sensor DarkfighterX. Axis has their high-end concealed IR Q6125-LE. Which is better? We bought both and tested...
Avigilon Announces AI-Powered H5 Camera Development on Sep 19, 2018
Avigilon will be showcasing "next-generation AI" at next week's ASIS GSX. In an atypical move, the company is not actually releasing these...
Favorite Request-to-Exit (RTE) Manufacturers 2018 on Sep 19, 2018
Request To Exit devices like motion sensors and lock releasing push-buttons are a part of almost every access install, but who makes the equipment...
25% China Tariffs Finalized For 2019, 10% Start Now, Includes Select Video Surveillance on Sep 18, 2018
A surprise move: In July, when the most recent tariff round was first announced, the tariffs were only scheduled for 10%. However, now, the US...
Central Stations Face Off Against NFPA On Fire Monitoring on Sep 18, 2018
Central stations are facing off against the NFPA over what they call anti-competitive language in NFPA 72, the standard that covers fire alarms....
Hikvision USA Starts Layoffs on Sep 18, 2018
Hikvision USA has started layoffs, just weeks after the US government ban was passed into law. Inside this note, we examine: The important...
Chinese Government Praises Hikvision For Following Xi Jinping on Sep 17, 2018
The Chinese government council responsible for managing China's state-owned companies praised Hikvision’s obedience to China’s authoritarian leader...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact