Examining Video Surveillance Storage Clusters

By: John Honovich, Published on Aug 06, 2008

In the next few years, we will see a significant transition away from storing video inside DVR/NVR servers. This 'on-board' storage will be replaced by clustered storage that communicates with servers over an IP network. The economics are becoming very attractive for such a move, especially in larger scale deployments.

This review examines the background, advantages and constraints of storage clusters as a replacement for traditional DVR/NVR storage.

Storage clusters are appliances that are separate from your DVR/NVR and communicate with them across your IP network. Storage clusters are modular and more storage can be added over time, starting from as low as a few TBs to more than 1000 TBs.

Here is a summary of the key advantages and constraints:

Advantages

  1. Price differential between internal storage and storage clusters have dropped dramatically
  2. Storage Clusters can reduce storage needs by ~ 30% over internal storage
  3. Storage Clusters are actually cheaper for large camera counts and storage durations
  4. Storage Clusters are cheaper and better for megapixel cameras
  5. Storage Clusters offer RAID 'standard'

Constraints

  1. Storage Clusters are not cost-effective for smaller camera counts
  2. Storage Clusters cannot centralize storage across most distributed facilities
  3. Where historically the price differential per unit of storage was huge, today, the differential is small or, in many cases, not at all. This is critical in spurring broader adoption.

    Almost all observers recognized that storage clusters were superior to on-board storage but the historical pricing for storage clusters was 300% to 600% more for the clusters. As such, it was incredibly difficult to justify the significant increase in expense and very few video surveillance systems used this solution.

    In the past few years, the increasing maturity of these solutions and the utilization of standards based IP networks has shrunk the price differential. The price of the supporting infrastructure to build storage clusters has dropped, enabling the price of storage clusters to fall faster than the price of internal DVR/NVR storage.

    Per TB, the price of storage clusters is very competitive with internal DVR/NVR storage. Storage clusters cost about $2,000 per TB. For most mainstream DVRs, the MSRP to add 1 TB of storage is $2500 to $3800. Storage clusters actually can be cheaper than internal storage. I was fairly shocked about this difference but I confirmed with multiple price lists from multiple dealers.

    Get Notified of Video Surveillance Breaking News
    Get Notified of Video Surveillance Breaking News

    Note: The minimum size storage cluster available today is 4TB which is a big factor in small camera count deployment. This affects total cost for this scenario and will be examined in the constraints section.

    Advantage 2: Reduce Storage Needs

    When you deploy multiple DVRs, even in the same building and with the same configurations, you often obtain different storage durations. Let's say you target 90 days of storage, some will get 75, others 105, a few 55 and one or two 125 days. This is because storage utilization is a factor of amount of motion or traffic in a camera's view. (PTZs are famous for chewing up storage because of this).

    Because storage duration falls in a range, you generally need to deploy more storage than the average system needs or reducing recording settings on systems that do not record as long as you need. In the former, the direct impact is higher installation costs. In the later, the direct impact is higher service costs and the indirect impact can be issues with evidence usability.

    With storage clusters, DVRs/NVRs record to a central pool of storage. Let's say you have 10 DVRs and the average DVR consumes 800 GBs of storage to record 90 days. However, because some of the DVRs will need more storage to reach 90 days, you use 1000GB storage in each DVR instead, resulting in a 25% premium. In a storage cluster, because storage is pooled, units that need more storage and balanced off with units that need less. Therefore, you would simply use 8TB of storage and eliminate the 25% padding and premium.

    Even in a modest scenario like this you can save a few thousand dollars simply by this pooling effect.

    Advantage 3: Cheaper for Large Camera Counts / Extended Storage

    Once you get into large camera counts or extended storage, it pushes the limits of what internal storage can provide. As such, the economics of storage clusters are preferable.

    Using interal storage will require using the largest hard drives possible (so you can fit in chassis). Larger hard drives are much more expensive (per unit of storage) than smaller hard drives. With a storage cluster, you could use the most cost-effective hard drives sizes and reduce costs.

    Using directed attached storage requires an external appliance. Such an appliance will cost a few thousand, even without the drives. At that point, and for roughly the same price, you might as well use a storage cluster that provides far superior scalability.

    Advantage 4: Better for Megapixel Cameras

    The storage demands of megapixel cameras are severe. You can easily use multiple TBs per megapixel camera because of the increased resolution and the need for MJPEG compression.

    Most DVR/NVR appliances are not designed to handle this demand for storage coming from multiple megapixel cameras. You can use direct attached storage but again, for roughly the same price, the added benefits of a storage cluster generally make it the appropriate choice.

    Advantage 5: Offers RAID 'standard'

    While DVRs have offered RAID for years, the additional cost has been quite high. As such, most users elect not to use RAID. A check of leading appliances indicates going from 1TB non-RAID to RAID increases cost by $1500 to $3000 MSRP. Some systems like 3VR are now offering RAID standard but it's certainly more of an exception than the norm. All in all, though, these premiums are hard to justify.

    By contrast, storage clusters offer RAID 'standard'. The incremental cost of using RAID is very low. Plus, these systems are all designed to provide many flavors of RAID right out of the box.

    RAID offers two primary benefits for video surveillance systems: (1) save the box from dying and (2) save video from being lost.

    Saving the box from dying is the more important of the two. Video surveillance systems that die require emergency service calls and increase the risk that a security incident occurs where no recording nor live monitoring is available.

    Saving video from being lost is usually a nice to have for video surveillance. It is generally not critical because the probability of a incident being lost is usually low. This is based on my experience in government, military and Fortune 2000 companies. Video storage is generally more like insurance than it is like your children. If you lose your insurance for a few days, it's a risk but you are usually fine. Video surveillance storage is pretty much the same.

    Certainly, a lot of reasons exist for moving to storage clusters. Nevertheless, the value for smaller, distributed sites (a major segment of video surveillance - banks, smaller retailers, QSRs) is not as strong.

    Constraint #1: Not Effective for Smaller Camera Counts

    Storage clusters have a startup cost that is notably higher than the internal storage DVRs/NVRs use. Just like any PC, internal storage is available by default and the only incremental cost is usually adding in the drives themselves. With a storage cluster, you usually have a separate appliance with electronics and computing infrastructure. As such, before you deploy any drives with a storage cluster, you first have to pay for this additional appliance.

    With a storage cluster, the minimum available size seems to be 4TB at about $8,000 MSRP. If you use significantly less than 4TB, the cost for a storage cluster will be significantly higher than simply adding in drives to your DVR/NVR. Moreover, the benefits of pooling decrease because you are likely using less DVR/NVR units and do not need to worry about padding to achieve storage durations.

    This is not trivial because large corporations have millions of facilities around the world that fit these characteristics. Until and if storage clusters can become more competitive at lower storage entry levels, the value for customers will be quite questionable.

    Constraint #2: Not Capable of Centralization Across Distributed Facilities

    Even though storage clusters have significant economic benefit for large amount of storage use, this is generally not feasible for aggregating storage from facilities across the country. To the credit of the vendors in this space, they have not made this claim. However, you do hear this from time to time by some in the industry.

    Take a fast food restaurant with 1000 locations. In each location they probably have about 250 GB of storage (more if they are rolling out new systems). In total, that's 250 TB of storage (at least), which is quite significant. Hypothetically, they could save a few hundred thousand dollars if they could eliminate hard drives in the restaurants and just have one central storage cluster.

    The problem is that you need significant amounts of bandwidth to accomplish this that simply is not available to most sites. For 8 or 16 cameras, you might need 5 - 20 Mb/s in upstream bandwidth. This is a huge amount for most stores where DSL/cable modem is the norm. In other words, the cost of bandwidth is far higher than the cost of storage. As such, this is not very realistic.

    Conclusion

    Driven by price competitiveness and a number of significant advantage, storage clusters will quickly become a major force in sites with modest to large numbers of cameras. Nevertheless, the sizable segment of the market with small camera counts per site will not see significant advantages in this. All integrators and security managers should carefully track and learn more about security clusters so they can take utilize their significant advantages.

3 reports cite this report:

How Much Storage is Needed for Video Surveillance? on Aug 15, 2009
How much storage is needed for video surveillance is an important question for planning new system deployments and for determining total...
How Costly are Hard Drive Failures? on Apr 29, 2009
Storage tends to be one of the more costly and problematic parts of video surveillance systems. Most video surveillance systems, even today, do not...
Top 3 Emerging Technologies in Video Surveillance 2008 on Sep 02, 2008
Emerging technologies can significantly improve security operations. At ASIS, I encourage you to learn more about 3 particular technologies and to...

Related Reports

Video Surveillance History on May 06, 2020
The video surveillance market has changed significantly since 2000, going from VCRs to an emerging AI cloud era. The goal of this history is...
NetApp Video Surveillance Profile on Mar 09, 2020
NetApp is increasing its efforts in video surveillance and told IPVM surveillance storage is the fastest-growing segment of its $6+ billion...
Video Surveillance 101 Course - Last Chance on Feb 20, 2020
This is the last chance to join IPVM's first Video Surveillance 101 course, designed to help those new to the industry to quickly understand the...
Video Surveillance Architecture 101 on Feb 18, 2020
Video surveillance can be designed and deployed in a number of ways. This 101 examines the most common options and architectures used in...
Proactive CCTV "Only Affordable Video Archiving Solution" Profile on Aug 12, 2019
Proactive CCTV is claiming to offer "the only affordable video archiving solution on the market", reducing the storage typically required for H.265...
Razberi Technologies Company Profile on Aug 06, 2019
Razberi says they have doubled their revenue in the first half of 2019, citing their proprietary camera hardening and cybersecurity capabilities...
Ionodes Company Profile on Jul 31, 2019
What happened to Ionodes? With seasoned leadership from Jean-Paul Saindon founder of SmartSight and Dr. Michael Gilge, founder of VCS, back in...
Smart CODEC Usage Statistics 2019 on Jun 03, 2019
Smart codecs are now nearly a standard feature in IP cameras, but our statistics show integrator adoption has not increased at the same rate. In...
H.265 Usage Statistics on Apr 19, 2019
H.265 has been available in IP cameras for more than 5 years and, in the past few years, the number of manufacturers supporting this codec has...
Favorite Video Storage / Server Manufacturers 2019 on Mar 25, 2019
189 integrators answered this question: "What is your favorite storage device / server manufacturer for recording video? Why?" In general...

Most Recent Industry Reports

Wyze Raises $10 Million And Seeks Services Expansion on May 27, 2020
Wyze has raised $10 million, the company's first disclosed raise since the $20 million announced at the beginning of 2019. Inside this note,...
Startup Videoloft Presents Cloud Storage on May 27, 2020
Videoloft presented offsite cloud storage at the May 2020 IPVM Startups show. A 30-minute video from Videoloft including IPVM...
Directory of 250+ Fever Camera News Reports Globally on May 27, 2020
This global directory tracks 250+ articles about thermal cameras used to detect fevers in response to the coronavirus pandemic. Articles are...
Integrators Rising Against Coronavirus on May 27, 2020
IPVM integrator statistics make it clear - Coronavirus's impact on business is lessening and many are anticipating even better news in weeks...
Netposa Stock Surges 46% After US Human Rights Abuse Sanctions on May 27, 2020
Last Friday, the US government announced it would sanction PRC video management provider NetPosa for being "complicit in human rights violations...
LILIN Presents NDAA-Compliant P2 Cameras on May 26, 2020
Merit LILIN presented its NDAA-compliant P2 camera series at the April 2020 IPVM New Products show. Inside this report: A 30-minute video...
ZKTeco Body Temperature and Mask Detection Reader Tested on May 26, 2020
While dedicated fever cameras emerged first, now tablet/kiosk fever detectors are ramping up. China's ZKTeco has been aggressively promoting such...
IDIS Presents 12MP IR Panoramic Fisheye on May 26, 2020
IDIS presented its 12MP IR panoramic fisheye camera at the April 2020 IPVM New Products show. Inside this report: A 30-minute video from...
FDA Defines Correct Operation of "Fever Cameras" on May 26, 2020
The US FDA has now defined the correct operation of "Thermal Imaging Systems", colloquially known as "fever cameras". Many in video...
OnSSI Founders Return, Start Corsight on May 25, 2020
The OnSSI founders are back, less than 2 years after selling OnSSI to Qognify, they have returned to Corsight, a spin-out of an Israeli AI...