Subscriber Discussion

Off Site Redundancy Recording Recommendations Requested

UI
Undisclosed Integrator #1
Sep 08, 2017

Hi Everyone, 

 I'm looking to see how you've successfully implemented off site redundant storage of video.

 I have a client who is looking to actively mirror two years worth of video storage as a disaster recovery measure. 

 

 My limited knowledge of this niche application would look at the following options:

 - Low res sub stream of all cameras to off-site archive recording server. (Huge LAN & WAN bandwidth rec.)

 - Mirror storage on site array to redundant archive storage arrays. (Less LAN bandwidth rec but still huge WAN bandwidth rec.)

 - Transport weekly or monthly mirrored Tape archives from site to secure client storage. Least ISP & server cost but possibly more client involvement. (Or RMR as a service?)

 I don't know. Trying to come up with the best options but all don't seem to hot. Someone here has done better!! Any ideas?

 Thanks in advance to the Hive mind of the IPVMers! 

 - Anonymous Integrator (as the project is in the presale stage. I hope yall understand.)

MM
Michael Miller
Sep 08, 2017

What VMS are you planning on using?   Genetec has a cloud archiving solution that would fit your needs. 

(1)
UI
Undisclosed Integrator #1
Sep 08, 2017

Ah, great question!

-Milestone. 

 

 Genetec eh? Yeah, we are a Milestone house. 

(1)
Avatar
Scott Bradford
Sep 08, 2017
IPVMU Certified

Could you use the video grooming feature in Milestone to drop the FPS to something more manageable and then ship that off to NAS offsite?

UI
Undisclosed Integrator #1
Sep 08, 2017

Hi Scott,

 Yeah, that was sort of the option 2 approach above. I'm going to touch base with Milestone design team to see what option they will recommend and post here when done. 

 This can't be the first time this was thought up, maybe just never done due to the cost of bandwidth on the WAN side of this idea. 

 Thanks for the feedback.

UE
Undisclosed End User #2
Sep 08, 2017

Check out Quantum, they have a great tape storage solution that is much cheaper for long term archiving.

http://www.quantum.com/solutions/video-surveillance/index.aspx

(1)
Avatar
Josh Hendricks
Sep 10, 2017
Milestone Systems

This is where my mind was going too. There are multiple tape storage integrations with Milestone, and if bandwidth is a concern for full data duplication over the Internet, this is a proven solution.

UI
Undisclosed Integrator #1
Sep 11, 2017

Nice. I always like hearing of manufacturers that I didn't know of before! Will look into them!

 

(1)
Avatar
Carlo Kuijer
Sep 08, 2017

Can i ask what the number of camera's is ?

regardless of the brand you pick, there are issues with option of a backup from a local site to a remote site, when backing up the data, you then will utilize the max bandwidth of your infrastructure.  then you aren't talking about steams but simple data transfer PTP (Peer te peer) the limit will be the throughput at that stage. Depending on the total volume you will need to transfer you could balance out the throughput. Small side note: some manufacturers do not allow realtime backup's.

Dual recording can be a solution, but this is also depending on the number of camera's, When using H265+ you can limit you bandwidth and when recoding you second recording service in a lower resolution as well you soberly can manage, all depending on bandwidth, number, compression codec, settings etc.

Also a option can be the "P-Frame" or "mobile mode" (low bandwidth mode and is depending on the manufacturer), here you only send the part of the video that changing. Also called Advanced / PLUS/ Turbo or what ever name we all come up with) 

But all is depending on the products and quantities you have on-site

UI
Undisclosed Integrator #1
Sep 11, 2017

Hi Carlo, 

 Approximate number of cameras = 80

 Application = 1 FPS continutous & 15 FPS on motion. 

 I could also substream to an offsite storage device with VBR + cap or CBR to keep the bandwidth in check. & yes, using a Smart Codec would help allot but hard to anticipate results. (Pre calculate.) 

 Good point on the backup concept VS stream! I need to see compatibility with Milestone & this concept. 

 Thanks,

Avatar
Carlo Kuijer
Sep 11, 2017

Then when you investigate this it would be helpful when knowing the following specifications:

1. You have 80 Camera @ what resolution?, or whats the bandwidth you are consuming per camera source?

2. You available bandwidth between the locations, for you offsite storage. Also the specifications, QoS levels and other interconnect specifications.

3. Your recording profile, 1 FPS (TL) and 15IPS (EVENT) do you use dynamic resolutions, Like TL lower resolution and Event - Full resolution. (This is only a valid question if you want to backup instead of dual recording/streaming btw)

To my understanding Milestone Enterprise can support Dual stream, but don't know if you can assigns the stream to different recording services. We do but you are not using a IDIS solution ;)

An Bypass can be a out of the box solution, this is only possible if your camera brand/type supports this. Instead of looking for a solution at your VMS/NVR site, you can also aproceh this from the camera site, A regulair camera can support multiple streams where a service can connect to, when you create a dedicated clan for the installation from any other traffic you can add a secondary recording service (VMS or NVR type) thats pointing to the same camera's as your default onsite recording service.  but beware, this method will impact you internal load when using a unicast solution, normally this won't be a issue unless your infra is not up to spec..

Any given camera manufacturer can support alt least up to ten connections per camera, when using multicast this number of connections can be unlimited (yes there is a limit but due to network load/bandwidth)

By setting up a secondary profile based on your demands and possibilities your properly can handle a deal recording solution on your own without a huge investment.

(1)
(1)
UI
Undisclosed Integrator #1
Sep 11, 2017

Hi Carlo, 

 Thank you for the advice. It's much appreciated! This does help direct my focus in finding the right solution. 

 Thanks again!

Avatar
Carlo Kuijer
Sep 11, 2017

Just to make it even more dynamic, Does your customer needs a full redundantly or can you assign different camera's per situation.

I included a simple drawing to explain myself. ....

(1)
NB
Nicolas Bellego
Sep 10, 2017

Hello

With Milestone you can put Archive database to a Synology Nas using iSCSI.

And then you can use an other NAS for replication or a cloud app like Cloudstation and store the files on the cloud.

That's theory. The size of the files and the bandwith consumption that will generate should be taken into consideration...

UM
Undisclosed Manufacturer #3
Sep 11, 2017

From the discussions so far this appears to be an Archiving solution requirement as opposed to a Real Time Redundancy solution.  That said it does make things a little simpler, but as discussed by Carlo, will likely add delays dependent upon Network availability and the fact many Archive solutions are based upon transfer of given data block sizes and not Streaming.

When looking for archiving, check for Scheduling capability, this often allows better management of Network Access to allow archiving to occur at "Off Peak" business use times.  It really is a trade off between WAN costs/availability and the closeness to a real time transfer.

Having an Archive solution where the VMS is aware of all "Archived" data is also imperative, simply copying data to alternate storage sets will often leave data potentially orphaned off the primary VMS database or difficult to access, so chose a solution where the VMS/NVR manufacturer handles this and dont be swayed by the input of cavalier IT managers - We are in a dynamic data business not simply document read/writes.

Remote data backup aside, if the data is of such importance we must also consider Primary site high availabilty of the NVR by using 1:1 or 1:n failover for NVR and any requisite archive management servers (ideally chose an NVR with built in archiving that does not rely upon an archive manager).

And of course always remember that Archiving data from an NVR will utilise outbound data throughput and disk read throughputs, so you may find that you need to scale your NVR/Camera designs to meet these requirements.

And finally, ask your customer what is really important, it may be only a fraction of the cameras need to be archived which ultimatly can bring a solution closer to being achievable. 

 

(1)
(1)
UI
Undisclosed Integrator #1
Sep 11, 2017

Good points! 

 Yeah, I need to drill the client for more detail on this as it could easily balloon into large amounts of $. 

 Thanks,

(1)
UI
Undisclosed Integrator #4
Sep 11, 2017

We have done a couple of these over WAN and it is complicated but doable but you need to consider the following few points:

- Is your client looking for redundant recording( recording the same camera at two different locations in case one of the recorders fails) or back up( record on one recorder and make a copy of the video stored on it)? Redundant recording protects you from losing any video while back up protects only the video already recorded and you will not capture any video while the recorder is not operational.

- There is complicated networking involved to do it securely(cyber security) and you need to have IT/network engineers on staff or partner with an IT company to help you out.

- It does require a lot of bandwidth but with the latest compression technologies( ZipStream, WiseStream, etc) it had gone down significantly.

- Cost for the second location - is it the client's facility or you need to utilize a data center? In any case, you need to factor any bandwidth and hosting costs.

Hope this is pointing you in the right direction.     

(1)
UI
Undisclosed Integrator #1
Sep 11, 2017

This does help to narrow it down further for me. 

 Thank you!

New discussion

Ask questions and get answers to your physical security questions from IPVM team members and fellow subscribers.

Newest discussions