Camera Edge Storage / Recording Tutorial 2015
Author: John Honovich, Published on Jun 29, 2015Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.
Related Reports
Casino Security Consultant Carl Lindgren Interview
on Mar 26, 2019
For more than 20 years, Carl Lindgren worked as a casino surveillance pro, while being active (and sometimes outspoken) on various online video...
Favorite Video Storage / Server Manufacturers 2019
on Mar 25, 2019
189 integrators answered this question:
"What is your favorite storage device / server manufacturer for recording video? Why?"
In general...
IBM / Genetec Surveillance System Investigated Over Philippines Human Rights Abuses
on Mar 22, 2019
A lengthy investigation into an IBM video surveillance project in the Philippines, raising concerns IBM helped local police conduct a bloody...
Eagle Eye Favorability Results 2019
on Mar 21, 2019
Eagle Eye has been the biggest spender in the cloud VMS market including (via their owner) acquiring Brivo for $50 million and CameraManager from...
Large Hospital Security End User Interview
on Mar 21, 2019
This large single-state healthcare system consists of many hospitals, and hundreds of health parks, private practices, urgent care facilities, and...
Silicon Valley Cybersecurity Insurance Startup Coalition Profile
on Mar 20, 2019
Many industry people believe cybersecurity insurance is not worth it, as the voting and debate in our Cybersecurity Insurance For Security...
Covert IP Camera Shootout - Axis, Hanwha, Hikvision, March, Vivotek
on Mar 20, 2019
Covert cameras were one of the last holdout areas for analog cameras. However, in the past few years, IP / HD covert cameras have become...
Genetec Security Center 5.8 Tested
on Mar 19, 2019
Genetec has released Version 5.8. This comes after a wait of more than a year that caused frustrations for many Genetec partners.
Our previous...
Large US University End-User Video Surveillance Interview
on Mar 18, 2019
Schools have become targets in modern days of active shooters and terrorist fears. The need for video and access security is high. Universities...
Hikvision Favorability Results 2019
on Mar 18, 2019
Hikvision favorability results declined significantly in IPVM's 2019 study of 200+ integrators. While in 2017 Hikvision's favorability was...
Most Recent Industry Reports
Casino Security Consultant Carl Lindgren Interview
on Mar 26, 2019
For more than 20 years, Carl Lindgren worked as a casino surveillance pro, while being active (and sometimes outspoken) on various online video...
Lenel Favorability Results 2019
on Mar 26, 2019
The positive news for Lenel is that integrators do not dislike them as much as they used to.
The negative news for Lenel is that integrators...
9 UK MPs Call Out Hikvision Over Human Rights Violations
on Mar 26, 2019
A group of nine MPs in the UK has released a letter calling out Hikvision for its surveillance deals in Xinjiang and Tibet, alleging Hikvision...
Access Control Course Spring 2019
on Mar 26, 2019
The member's price is normally $299, but register early for a $50 discount, for a price of $249. The price covers classes, personal help and...
UTC Interlogix Series 6 Tested
on Mar 25, 2019
UTC Interlogix has long been deceptively OEMing Hikvision as our 2017 results show. Now, Interlogix is back with their newest IP camera series,...
Outdoor Camera Installation Guide
on Mar 25, 2019
Outdoor camera installation can be fraught with problems. Creating a sturdy and weather tight mount is key for camera performance and longevity,...
Favorite Video Storage / Server Manufacturers 2019
on Mar 25, 2019
189 integrators answered this question:
"What is your favorite storage device / server manufacturer for recording video? Why?"
In general...
IBM / Genetec Surveillance System Investigated Over Philippines Human Rights Abuses
on Mar 22, 2019
A lengthy investigation into an IBM video surveillance project in the Philippines, raising concerns IBM helped local police conduct a bloody...
Eagle Eye Favorability Results 2019
on Mar 21, 2019
Eagle Eye has been the biggest spender in the cloud VMS market including (via their owner) acquiring Brivo for $50 million and CameraManager from...
Large Hospital Security End User Interview
on Mar 21, 2019
This large single-state healthcare system consists of many hospitals, and hundreds of health parks, private practices, urgent care facilities, and...
The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.
Comments (14)
Dale White
John,
Thanks for this. Maybe the manufacturers on here will move toward improving the offerings in this area. I have advocated for edge storage for a long time. Many other technologies moved intelligence and data to the edge years ago e.g access control. At one time, all access control decisions were made by a central processor which limited response time etc., but that was 30 years ago.
To me, I guess it's just logical to keep your data locally and only access it when needed. I wonder if use has improved since your 2012 article?
We spend a lot of money shipping huge amounts of video data around to massive storage arrays, clouds, etc. Our studys have shown that <2% of video is ever actually used. So at a site with 24TB of storage you're just hogging the network infrastructure for no reason.
That's like having a 15 ton dump truck deliver a shovel full of dirt. We have a ways to go in this area but the time could be short with the right company and resources.
Given the average system size, reliable, supervised edge storage would simplify a lot overly complex installations. Not sure why it hasn't been a priority before now.
Can't wait!
Create New Topic
Undisclosed #1
Some good points, a few things I'd mention as well:
The two big limitations of edge-storage are overall card size (in GB) and difficulty in accessing the video (both of these are mentioned, I'm just confirming/rehashing). Edge storage is great for cases where you only have a small number of cameras and will need to access/retrieve recorded video very rarely.
I disagree with this statement though: This is not possible in analog or HD SDI cameras that need to transmit their video to stand-alone recorders.
Edge storage is really just storing the video in a way that keeps the traffic off the network. Cameras directly connected to an NVR/DVR would really be edge storage by most practical definitions.
Something else not mentioned in the article is the use of edge storage for network load management. I see/hear people ask about this a lot, and it doesn't work like that. Generally speaking, if you don't have the bandwidth to record video live, you won't be able to "buffer" it in the camera and move/trickle it to some centralized recorder later.
In terms of SD cards, I'd strongly suggest budgeting for a 3 year replacement cycle. You can use the data sheets from most of the popular cards and some basic math to calculate an expected life span, but in my experience there is more to it than just the total number of write cycles.
The good news is that bad SD cards will tend to show their flaws pretty early, and you can catch some of this before installing them in the field. Essentially:
1) Determine how much data you will use per day (within a few GB or so, it doesn't have to be perfect). Let's assume you're storing 30GB/day.
2) Multiple your daily storage by 90(days) for a total, 2700GB in this case.
3) Take your SD card size and divide the number above by your card size (eg: 2700GB/128GB card = 21.09)
4) Create a set of 3 random files, each that is a little bit smaller than your card size (you're going to copy this file to the card and you want to make sure you don't get an error from the file being too big for the card after your OS puts some crap on the card first).
5) Mount the SD card, copy thr first file, when that completes delete it and copy the 2nd, then the third. Do this process however many times simulates 90 days (eg: 21 times in this case).
6) Use a utility like this one to check the card for errors. If there are a high number of errors discard or return the card.
Or, to state the above another way, I've seen a lot of cards fail in the first 60-90 days, if they last that long they'll probably last a couple of years. You can simulate a bunch of write-cycles with some script-fu on linux or Windows and catch faulty cards before they're 100 miles away and 20 feet in the air.
Create New Topic
Undisclosed #2
If I'm understanding you correctly, this seems odd. I don't doubt that there is a good deal of variance in reliability of cards even of the same type and capacity, but it is well known that these cards lifespan is limited by the total number of cell rewrites, at least for the working ones.
Needlessly simulating 90 days of writes would be expected to reduce the lifespan of the card by 90 days on the ones passing the test. Do alot of them fail in just 2 or 3 days? Maybe that would be enough to eliminate the worst cards.
Why disagree? I suppose that SDI cameras could record uncompressed video to the SD card, but I would imagine that would fill up in a matter of minutes. As for any analog camera, I don't see how its possible at all.
Create New Topic
Undisclosed #1
It would *sort of* reduce the lifespan, but not as directly as you think.
The cards have a spec that lists the number of overwrite/bit flip cycles before major degradation, and loss/corruption of data, occurs. The majority of the cards will fit to this spec (actually, exceed it) and everything is OK, but some will not.
I'm not saying this is an exact science, it's just some recommendations based on observations. 2 or 3 days worth of testing would only equate to 1 or 2 complete flips of the card data, almost no name-brand card should fail that quickly.
This is really no different than the burn-in tests typically done with components. Due to the nature of the SD cards being installed in the cameras it's generally not easy to just walk up and replace the card. Also, because of the way they fail, and the fact that many cameras still don't do much to check card integrity and report errors (last time I looked, over a year ago), you can end up in a case where your card is either completely dead, or at a very reduced capacity. If you are not regularly accessing stored video to verify the integrity of the card you will end up in a case where when you need the video it's not going to be there.
If the card can survive a simulated 90 day stress test there is a higher chance that it will go on to be reliable. I also feel that if you're using SD cards exclusively you need to setup a maintenance window that gives you a good margin of error. If a 90-day reduction in lifespan (and again, it's not direct) is going to be a major factor, then you should be using larger cards or not relying on edge storage for your solution.
Create New Topic
Alexander Gutierrez
My experience with Sunell OEMs when using Edge recording (on Micro SD Slot): For a strange reason the Clock resets, so the recording is affected, either the camera does not record or the recorded file has a false Time/Date info. This need to be checked when testing these kind of solutions. Sunell provides a NTP tool but this is useless when you want to apply to real life situations because you are only installing a camera with no local VMS / NVR.
Create New Topic