How to Optimize NVR / DVR StorageAuthor: John Honovich, Published on Jun 04, 2008
Megapixel cameras have brought renewed interest in measures to maximize NVR/DVR storage duration and use. Cost is a big factor as the potential storage needed could increase by 10x or more than historical standards. Understanding what options and measures are available is becoming increasingly important to selecting NVRs/DVRs and designing IP video systems. This report surveys common measures used to maximize strorage duration and use.
Recently, interest has risen in new product categories that specialize in optimizing storage use.
Frost and Sullivan has recently reviewed "Video Lifecycle Management Solutions" and identified TimeSight Systems as a "young leader" in this space. The release does a good job of identifying the problem and highlighting one potential solution.
As almost all video systems have numerous measures to optimize storage use, I recommend that integrators and end users focus on utilizing existing measures in leading systems. Video system developers have been building tools for years to address storage optimization. Most will be best served by selecting a video management system based on features optimized for your specific security needs. Significant and comparable storage optimization can generally be accomplished on most mainstream NVR / DVR systems.
How Do I Optimize Storage?
This report reviews 8 commonly available storage optimization functions available on mainstream NVR /DVR systems. Though not every system has all of these features, all systems offer a number of them, providing strong storage optimization.
Here is the list:
- Basic Motion Analytics
- Advanced Video Analytics
- Motion Exclusion Zones
- Data Aging
- Recording Schedule
- CODEC Selection
- Dual Streaming
- Storage Clusters
Advanced Video Analytics
Now that video analytics are getting accurate at detecting people, faces and vehicles, this intelligence can be used to control recording. I believe this will become one of the most powerful new areas of storage optimization in the next 3 years. Long term storage can be optimized by selectively recording objects most likely to be of long term interest - people, faces and vehicles. Traditionally, long term storage optimization techniques reduce the quality or the frame rate of all video uniformly. With video analytics, storage optimization techniques can become smarter, increasing the probability of possessing quality long term evidence while minimizing total storage consumed.
For instance, in addition to recording video, 3VR records all faces seen on cameras. Faces of all the people (100,000+) conducting transactions at a bank branch can be stored at 4CIF quality with less than 20GB of storage. This is 1/100th the amount of storage needed for video and the most important evidence for retail bank's security needs. Of course, today this is just faces but the same process can and will certainly eventually be used to store all the people seen, all the cars moving through an area, etc.
Video analytic companies specializing in perimeter violation are reducing storage needs for those cameras by 90% or more. By placing intelligence in the camera, the camera can only stream or the management system can only record specific objects of interest. For cameras whose main purpose is real time alerting, this is a great storage win. Of course, many cameras are needed for investigation purposes and need storage. As such, this is simply another tool in our collection.
Basic Motion Analytics
Most video surveillance deployments use basic motion analytics to control recording. Because most facilities have significant periods of low activity (e.g., nights, weekends) and areas of low activity (e.g., hallways, stairwells), motion analytics can reduce storage consumption by 50% to 80%. Most systems set their basic motion analytics to be fairly conservative so that they rarely miss real incidents. As such, basic motion analytics is trusted and used by many military bases, banks and Fortune 100 companies and most real world deployments. Of course, some facilities do not want to take any risk and require continuous recording.
A nice balance that is sometimes achieved is a combination of continuous and motion based recording with a baseline level of continuous recording (e.g., 3 frames per second) and motion based recording set higher (say to 15 fps). This ensures that video is always recorded but storage use is optimized for when activity of interest is most likely to occur (that is, when motion is detected).
Motion Exclusion Zones
Using basic motion analytics to control recording is enhanced through using motion exclusion zones. It is common for cameras to cover areas that are not of interest to users. Examples include highways behind the building, a tree out front, windows, ceiling lights, etc. Taking a few minutes to set up motion exclusion zones can reduce the storage utilization by up to 50% on certain cameras. After the first week of a new install, a review should be conducted to tune these settings.
Many systems reduce the number of frames in stored video as the video is older. The basic premise is the older the video, the lower the probability that the video is relevant. Rather than simply delete the video, the size of the video is reduced so that some evidence is available just in case but the storage costs are minimized.
For instance, March Networks has a feature called "Intelligent Video Retention." Avigilon has an advanced data aging solution that specializes in optimizing storage for multi-megapixel cameras. In higher end video systems, this type of feature is frequently available. It's quite useful because it can easily double storage duration.
Recording on a Schedule
Many organizations have greater security risks at different times of the day. Schedules are a common feature to adjust recording parameters to match those different level of risks. For instance, an organization may want continuous recording during business hours but is ok with only having motion based recording after hours. Making this adjustment can reduce video storage use by up to 40%.
Choosing a video CODEC that provides the most efficient storage utilization has been a key component of video system designs for years. While technical issues exists, the trend of moving from less efficient to more efficient CODECs is clear (e.g., from MJPEG to MPEG-4 to H.264). The key practical issue currently is the use of H.264 for megapixel cameras due to the high system requirements H.264 demands. With multiple megapixel manufacturers releasing H.264 megapixel cameras, in the next few years H.264 megapixel cameras looks certain to be a reality (at least for lower resolution MP cameras). Migrating from MJPEG to H.264 can reduce storage use by 50% or more.
To maximize CODECs different strengths and weaknesses, multiple video streams can be used. For instance, H.264 may be the best choice for storage optimization but MJPEG has advantages of live monitoring (e.g., lower delay, lower processing power to view). Most cameras support dual streaming. Video surveillance systems can take advantage of this to reduce storage costs while ensuring optimal live video monitoring.
Historically, storage was separated into small pools for each unit and options for upgrading storage were limited to a few TBs (at most). Today, with storage clusters for video surveillance maturing, centralized pools of storage can create ~ 30% efficiencies in storage use and make extending storage simple and fairly inexpensive. If you are interested in learning more, read my extensive analysis of storage clusters.
While by no means comprehensive, this survey should help engineers and users to identify and use commonly available measures to optimize storage duration. Understand what your systems offer and make use of those features. By doing so, you will be able to optimize the storage of most any DVR or NVR and accommodate increasing storage demands.
Top 5 Problems in Video Surveillance Storage on Dec 20, 2008
Storage is one of the most confusing and debated aspects of video surveillance solutions. Continu...
Video Analytic's Greatest Value - Storage Reduction on Sep 07, 2008
While video analytic promotion focuses on stopping and solving crime, the greatest value for vide...
Other Reports on Storage
Video Surveillance Storage Redundancy Statistics on Oct 27, 2015
100+ integrators answered "What percentage of your projects do you use redundancy or RAID for vid...
Importance of Storage Costs - Statistics on Mar 30, 2015
10 years ago, 500GB for an entire DVR was considered good. Today, there are 6TB hard drives. Mor...
First Surveillance SD Cards Released (SanDisk) on Mar 12, 2015
The black eye for on-board recording has gotten pretty bad. Culminating with Axis admitting a se...
Invest in a Video Surveillance Storage Startup on Nov 06, 2014
Did you miss out on making millions investing in Intransa or Pivot3? Well, here is a limited opp...
H.264 High vs Main vs Baseline Tested on Jun 27, 2014
In surveillance, H.264 is often considered a single 'thing' but there are many different sets of ...
Edge Storage Usage Statistics on Jun 05, 2014
Most IP camera models now support on-board storage. Even more promising, on-board storage has the...
WD Purple and Seagate Surveillance Hard Drives on Feb 25, 2014
Western Digital wants our help marketing their new hard drives to "fly by night type folks", expl...
Guaranteed Video Storage Calculation? Iomnis on Aug 20, 2013
Calculating video storage can be daunting, presenting a dilemma for integrators: underestimate st...
3 Top Surveillance Improvements You Can Do on Nov 06, 2012
Here are 3 very valuable surveillance improvements you can do simply with existing equipment. Whi...
Veracity Coldstore Overview on Jun 20, 2012
What if you could reduce your costs for buying storage, powering that storage while eliminating R...
Most Recent Industry Reports
Blink Totally Wireless Camera Tested on Feb 12, 2016
Wireless cameras almost always still need a wire for power. Given that, many argue to just used w...
Average Frame Rate Video Surveillance 2016 on Feb 11, 2016
What is the average frame rated used in video surveillance systems? Historically, 30fps has been...
Goodbye Dropcam, the $50 Home Security Camera Era Is Here on Feb 10, 2016
Remember those days not too long ago where a $200 home security camera with a $100 per year for s...
Hikvision H.264+ Tested on Feb 10, 2016
Is 'regular' H.264 soon to be a thing of the past? Last year, Axis started the 'smart' H.264 tre...
Camera Coverage Areas on Feb 10, 2016
How wide and far on an area can a camera cover? A fundamental metric in analyzing this is pixel...
US Capital Paying for Homes and Business to Get Security Cameras on Feb 09, 2016
Since 9/11, US cities have spent hundreds of millions collectively on city-wide video surveillanc...
Brivo Access Control Company Profile on Feb 09, 2016
This is our 9th in a series of access control company profiles. In this entry, we cover Brivo. P...
Axis Is In Denial About HD Analog on Feb 08, 2016
For more than a decade, Axis' #1 argument against analog has been no HD. This, of course, is no...
Surveillance Commissioning / Install Checklist on Feb 08, 2016
This 60+ point checklist helps end users, integrators and consultants verify that installation is...
Favorite Camera Manufacturers 2016 on Feb 08, 2016
The market has changed significantly since 2014, where our previous Favorite Camera Manufacturer ...