What VMS / Video Analytics For Recorded Video?

Member asks:

Any recommendation on a product that does video analysis, playback. Motion detection? Basically I need a VMS but for pre-recorded footage. Something that I can point the video files, and it will analyse for motion and do synchronization playback.

He notes that he a few of his customers using NVRs have had crimes occur at their facilities, nothing the problem:

Issue is i dont like the Hikvision NVR or the dahua. it slow and i have to be onsite to do everything from the actually NVR. Web GUI is even worse.

Anything that comes to mind that can do such a thing. Basically, lets say i export all the footage from the NVR as a MP4, then i can import it into a software that can do everything like a VMS.

Briefcam is an obvious solution for ex post facto analysis this but it's quite expensive. Alternatively, in the future, the member could deploy Avigilon VMS and cameras but that's significant as well.

Any other options that anyone can suggest for analyzing recorded video at lower cost?

Agree
Disagree
Informative
Unhelpful
Funny

Briefcam would be what I recommend.  You would export clips out of the NVR then import them into Briefcam for processing.   This would be the most cost effective way to deploy Briefcam for this application.  Interested to see what other options there are.

Agree: 4
Disagree
Informative
Unhelpful
Funny

Check out IronYun. http://ironyun.com/

Claim to have Google-like search engine with 70 per-configured search parameters such as backpacks, knives, bicycles, etc,  finding them in seconds from large recorded image files. Haven't actually used it but saw a demo.

Agree
Disagree
Informative: 1
Unhelpful
Funny

See: $38+ Million Funding Powers VMS Challenger IronYun. You could use it but it's the same problem. It's overkill for analyzing exported video as it is a whole 'enterprise' itself.

Agree
Disagree
Informative
Unhelpful
Funny

Hi John,

our VTrack platform can process offline videos as well, by standard. No problems at all to provide free demo license and direct support, for checking if it can be of any help.

At disposal, cheers.

Simone

Agree
Disagree
Informative: 1
Unhelpful
Funny

Simone, thanks. In this case, it is really for that member who has those NVRs on site. Ideally, he is looking for some app he can just install, import the video and analyze.

Agree
Disagree
Informative
Unhelpful
Funny

Pretty amazing that some/most of the top-of-the-line VMSes can’t use a recorded stream (instead of a live one) as input to any offered analytics.

Agree: 2
Disagree
Informative
Unhelpful
Funny

A stream would be real time and would be very slow. Not very useful IMO.  I think what your trying to say is an analytic/deep learning solution which would process recorded video on a VMS solution in its native format.   Briefcam is the only solution that I know if that can do this with multiple VMS platforms.   

Agree
Disagree: 1
Informative
Unhelpful
Funny

A stream would be real time...

No, I don’t agree.  

Analytics recieve frames as their input.  These recorded frames have associated timestamps. The rate at which the analytics can process those frames is not limited by the system clock.  

Even if it was only real-time processing, it would still serve a purpose: Namely to facilitate the fine tuning of sensitivity/region and other parameters for optimum performance. 

For example when an event fails to trigger an analytic at 3:00AM and you want to adjust the analytic just enough to capture it.  And you don’t feel like coming in at 3:00AM and having somebody drive a car with their headlights off in front of the camera while you play with the knobs.

 

Agree: 1
Disagree: 1
Informative
Unhelpful
Funny

You have to get the recorded video from the VMS/NVR to the analytics unit for processing correct? 

A) export video from the VMS then import into the analytics system for processing

B) like your saying cue up a recorded clip then play it for the analytics to process

C) Analytics system is intergrated with the VMS video storage so you can select any camera or cameras in the system and a time frame then have that video sent to the analytics system to process.  

I am failling to see the advantage of B over C

Agree
Disagree
Informative
Unhelpful
Funny

I am failling to see the advantage of B over C

I never said I liked B over C.  

I said I like B over

D) no capability to run analytics on recorded video

Which seems to be the case for many mainline VMSes.

 

Agree
Disagree
Informative
Unhelpful
Funny

Would this be a use case for "Video Analytics As-a-Service"?

Anyone out there try any of them in a similar capacity to be able to comment on the practical aspects?

Agree
Disagree
Informative
Unhelpful
Funny

Does the NVR/VMS have an HTTP/CGI command to enumerate the recorded video files?

Or does it have only HTTP/CGI to playback the recordings as an RTSP stream?

Camio currently has a batch import (https://camio.com/em) that was intended for scripted, batch import of NVR/VMS video files in bulk after fishing boats come ashore. But we're now launching "lazy indexing" that instead fetches the video from the NVR/VMS only upon search. For example, the query [garage 2am PDT to 6am PDT] knows that the video events are missing for that 4 hour time period and requests that all motion events recorded by the NVR in that period be indexed on-demand. The nice thing is that you pay only for the indexed portion you import. You can send your NVR/VMS details to support@camio.com and we'll follow up with info.

 

Agree
Disagree
Informative
Unhelpful
Funny

Please email support@camio.com if you would use this video importer:

go.camio.com/importer-prd

If 20 people confirm that it's useful at roughly 4 cents/hour imported, then we'll polish up this open source project for general release.

After discussing offline with Michael (originator of this thread), this importer seems to fill an important gap in available tools. So please feel free to comment in-place in the PRD so we can converge quickly on what's important/useful. I'm pasting the overview below.

Who's it for

System Integrators who collect video evidence for forensic investigations across NVRs of multiple clients.

Why it's needed

Continuous VMS/Analytics can be expensive. The per-stream licensing and hardware costs sometimes exceed the value for cameras intended only for post-incident review. Yet the time and effort to collect and share video evidence from multiple NVRs at remote locations is also expensive. So the importer makes it simple and inexpensive to share video evidence with pay-per-use billing that's a better value provisioning continuous analytics.

What it is

The importer is an Open Source project to automate the ingestion of video files so that they can be indexed for easy playback and labeling by any number of advanced classifiers running either locally or in the cloud. Camio provides the default Hooks for the importer to analyze, index and store the video in the cloud. Camio also provides usage-based billing at prices starting at $0.04 cents per hour of video imported.


Example: Joe opens his laptop with a folder containing 12 hours of video files from 20 cameras, starts the importer, and let's it run in the background for 10 minutes. He can see its progress as % complete, and if he interrupts the import at any time, it resumes from where it left off. On the local network, the importer rips through 12hrs*20=240 hours of video by asking the segmenter to label the video segments that might possibly warrant human attention (i.e. times when humans, cars or other significant objects were moving). Joe sees the message "100% complete" on his laptop when the analysis has finished, but he also receives an email notification upon completion with an invoice for $0.04*240=$9.60 and a link to the imported video for review and sharing in any HTML5 browser like:
https://camio.com/app/#search;q=5pm+PDT+to+6%3A30pm+PDT+July+2nd+v%3Ag1u0365k9yps

Agree
Disagree
Informative: 2
Unhelpful
Funny

The per-stream licensing and hardware costs sometimes exceed the value for cameras intended only for post-incident review.

So the annual cost per camera, in the example you gave would be ~$175?

 

Agree
Disagree
Informative: 1
Unhelpful
Funny

There's no annual cost beyond the sum of the cost of each imported camera hour. 

What's the average number of incident evidence collections you do each year per client?

If you were to import everything the camera ever recorded 24x7x365 then it's better to connect it as a regular stream subscription that can learn and adapt to the scene.

Agree
Disagree
Informative
Unhelpful
Funny

If you were to import everything the camera ever recorded 24x7x365...

24x7x365 = 1 dog year ;)

Agree
Disagree
Informative
Unhelpful
Funny

This would be an awesome offering. I am wondering though if this would be an offering targeted towards end-users versus Security Integrators - unless there is some sort of a white label offering in play here.

 

Typically I want my customers trained in searching/exporting video and let them do their own investigations.

Agree
Disagree
Informative
Unhelpful
Funny

Maybe the first step is to enable the importer to be run by end users. Then the second step is to enable end users to install/configure the importer?

It's no problem beyond the additional work required to make the setup end-user friendly (unless your end users are tech savvy IT types).

 

Agree: 1
Disagree
Informative
Unhelpful
Funny

I like that process but I would want the integrator to install/configure the importer and train the customer.

Then customer can run the tool at their own leisure. The question would then be how to allow the integrator to generate revenue from this? Proceeds from end users use? White label the online version of the product and have the integrator charge X$/hr or MB and then pay you monthly/quarterly/etc?

Agree
Disagree
Informative
Unhelpful
Funny

Yes, the integrator can receive revenue share payments each time the end user pays for an import.

The importer works with any 3rd party service. But if connected to a service powered by Camio (like Ella), then payments are deposited via ACH connection to the integrator's Stripe account. The Ella Dealer Portal supports custom plans and payouts.

Agree
Disagree
Informative
Unhelpful
Funny

While it may not be what it's meant for, AgentVi was in effect able to do this with their Vi Search product - SavVi Video Search

Year ago I thought AgentVi should have marketed this way, enticing integrators to have their ViSearch product on hand as an emergency review tool after the fact. 

IIRC even years ago it could review video at x200 speed...

Agree
Disagree
Informative: 1
Unhelpful
Funny

Post processing of recorded video will one day become the norm.  My friend once said that computers would be the one consuming the most video data, even more than human eyes with netflix one day.  one example is this , post processing on demand, not only for resolution but many more once the meta data has been analyzed .

Agree
Disagree
Informative: 2
Unhelpful
Funny

Computer analysis consumption is a 1:1 ratio right now even if you are pairing up some Tesla v100's. In order to help analytics we should find something else other than a pixel to mine video streams, perhaps I could invent a different way to create video using a optics that a machine can read faster than what our eyes can see, to start off I think this needs to happen in 3-D space and not a single lens, single stream POV. Perhaps Tensorflow is just the beginning. Extracting metadata is what all the kids are learning this day. I would hope to see our computing power quantum scale in the palm of my hand one day. More TF notes here for all the nerds: https://arxiv.org/pdf/1610.01178.pdf

Agree
Disagree
Informative
Unhelpful
Funny

Just a follow up on Briefcam: They confirmed that they don't have a product / option for a small camera count or low-cost investigation use case.

They do have an 'Investigator' offering but it is for Law Enforcement only and requires a 3-year subscription. With the 'regular' Briefcam, it includes 100 cameras in the base license.

Agree
Disagree
Informative: 2
Unhelpful
Funny

If all you want is motion and not full analytics, any of the Nx Witness variants will do this.

Agree: 1
Disagree
Informative
Unhelpful
Funny

Jon -

The Nx Witness variants require a second stream to do the Smart Motion Search so it wouldn't work for recorded video.

Agree
Disagree
Informative
Unhelpful
Funny

 

 

Agree: 1
Disagree
Informative: 2
Unhelpful
Funny

Nope

 

I'm aware that we can force it on the primary (definitely not recommended unless camera doesn't support dual streams). We are unable to use Smart Motion Search in a standard AVI/MP4 format.

I don't know all the answers so let me know if there's something I'm missing!

Agree
Disagree
Informative
Unhelpful
Funny

There was a break-in on a site our organisation rents, it was awkward accessing the landlord's CCTV and as I only had a limited time period to access the physical recorder I exported all potentially relevant footage for review later. Unfortunately, the event log hasn't exported for whatever reason and I'm stuck staring at a lot of footage for 3 seconds of motion. Is there any way of getting motion detection from the recorded video? Many Thanks.

Agree
Disagree
Informative
Unhelpful
Funny

Vintra has a cloud version that is targeted at a variant of that use case (more so for police investigators).

If you email them (sales@vintra.com) you might be able to get a demo account for 30 days that you can upload your footage to. Processing time is around 20X, or 20 hours of video would be indexed and available for searching in about an hour.

Agree: 1
Disagree
Informative: 2
Unhelpful
Funny

Get a DVR and a camera, point the camera at the screen playing the export.

Only half-joking.

Agree
Disagree
Informative
Unhelpful
Funny