What VMS / Video Analytics For Recorded Video?

JH
John Honovich
Jul 01, 2018
IPVM

Member asks:

Any recommendation on a product that does video analysis, playback. Motion detection? Basically I need a VMS but for pre-recorded footage. Something that I can point the video files, and it will analyse for motion and do synchronization playback.

He notes that he a few of his customers using NVRs have had crimes occur at their facilities, nothing the problem:

Issue is i dont like the Hikvision NVR or the dahua. it slow and i have to be onsite to do everything from the actually NVR. Web GUI is even worse.

Anything that comes to mind that can do such a thing. Basically, lets say i export all the footage from the NVR as a MP4, then i can import it into a software that can do everything like a VMS.

Briefcam is an obvious solution for ex post facto analysis this but it's quite expensive. Alternatively, in the future, the member could deploy Avigilon VMS and cameras but that's significant as well.

Any other options that anyone can suggest for analyzing recorded video at lower cost?

MM
Michael Miller
Jul 01, 2018

Briefcam would be what I recommend.  You would export clips out of the NVR then import them into Briefcam for processing.   This would be the most cost effective way to deploy Briefcam for this application.  Interested to see what other options there are.

(4)
UM
Undisclosed Manufacturer #1
Jul 01, 2018

Check out IronYun. http://ironyun.com/

Claim to have Google-like search engine with 70 per-configured search parameters such as backpacks, knives, bicycles, etc,  finding them in seconds from large recorded image files. Haven't actually used it but saw a demo.

(1)
JH
John Honovich
Jul 01, 2018
IPVM

See: $38+ Million Funding Powers VMS Challenger IronYun. You could use it but it's the same problem. It's overkill for analyzing exported video as it is a whole 'enterprise' itself.

Avatar
Simone de Titta
Jul 01, 2018

Hi John,

our VTrack platform can process offline videos as well, by standard. No problems at all to provide free demo license and direct support, for checking if it can be of any help.

At disposal, cheers.

Simone

(1)
JH
John Honovich
Jul 01, 2018
IPVM

Simone, thanks. In this case, it is really for that member who has those NVRs on site. Ideally, he is looking for some app he can just install, import the video and analyze.

U
Undisclosed #2
Jul 01, 2018
IPVMU Certified

Pretty amazing that some/most of the top-of-the-line VMSes can’t use a recorded stream (instead of a live one) as input to any offered analytics.

(2)
MM
Michael Miller
Jul 02, 2018

A stream would be real time and would be very slow. Not very useful IMO.  I think what your trying to say is an analytic/deep learning solution which would process recorded video on a VMS solution in its native format.   Briefcam is the only solution that I know if that can do this with multiple VMS platforms.   

(1)
U
Undisclosed #2
Jul 02, 2018
IPVMU Certified

A stream would be real time...

No, I don’t agree.  

Analytics recieve frames as their input.  These recorded frames have associated timestamps. The rate at which the analytics can process those frames is not limited by the system clock.  

Even if it was only real-time processing, it would still serve a purpose: Namely to facilitate the fine tuning of sensitivity/region and other parameters for optimum performance. 

For example when an event fails to trigger an analytic at 3:00AM and you want to adjust the analytic just enough to capture it.  And you don’t feel like coming in at 3:00AM and having somebody drive a car with their headlights off in front of the camera while you play with the knobs.

 

(1)
(1)
MM
Michael Miller
Jul 02, 2018

You have to get the recorded video from the VMS/NVR to the analytics unit for processing correct? 

A) export video from the VMS then import into the analytics system for processing

B) like your saying cue up a recorded clip then play it for the analytics to process

C) Analytics system is intergrated with the VMS video storage so you can select any camera or cameras in the system and a time frame then have that video sent to the analytics system to process.  

I am failling to see the advantage of B over C

U
Undisclosed #2
Jul 03, 2018
IPVMU Certified

I am failling to see the advantage of B over C

I never said I liked B over C.  

I said I like B over

D) no capability to run analytics on recorded video

Which seems to be the case for many mainline VMSes.

 

Avatar
Mike Dotson
Jul 02, 2018
Formerly of Seneca • IPVMU Certified

Would this be a use case for "Video Analytics As-a-Service"?

Anyone out there try any of them in a similar capacity to be able to comment on the practical aspects?

Avatar
Carter Maslan
Jul 02, 2018
Camio

Does the NVR/VMS have an HTTP/CGI command to enumerate the recorded video files?

Or does it have only HTTP/CGI to playback the recordings as an RTSP stream?

Camio currently has a batch import (https://camio.com/em) that was intended for scripted, batch import of NVR/VMS video files in bulk after fishing boats come ashore. But we're now launching "lazy indexing" that instead fetches the video from the NVR/VMS only upon search. For example, the query [garage 2am PDT to 6am PDT] knows that the video events are missing for that 4 hour time period and requests that all motion events recorded by the NVR in that period be indexed on-demand. The nice thing is that you pay only for the indexed portion you import. You can send your NVR/VMS details to support@camio.com and we'll follow up with info.

 

Avatar
Carter Maslan
Jul 04, 2018
Camio

Please email support@camio.com if you would use this video importer:

go.camio.com/importer-prd

If 20 people confirm that it's useful at roughly 4 cents/hour imported, then we'll polish up this open source project for general release.

After discussing offline with Michael (originator of this thread), this importer seems to fill an important gap in available tools. So please feel free to comment in-place in the PRD so we can converge quickly on what's important/useful. I'm pasting the overview below.

Who's it for

System Integrators who collect video evidence for forensic investigations across NVRs of multiple clients.

Why it's needed

Continuous VMS/Analytics can be expensive. The per-stream licensing and hardware costs sometimes exceed the value for cameras intended only for post-incident review. Yet the time and effort to collect and share video evidence from multiple NVRs at remote locations is also expensive. So the importer makes it simple and inexpensive to share video evidence with pay-per-use billing that's a better value provisioning continuous analytics.

What it is

The importer is an Open Source project to automate the ingestion of video files so that they can be indexed for easy playback and labeling by any number of advanced classifiers running either locally or in the cloud. Camio provides the default Hooks for the importer to analyze, index and store the video in the cloud. Camio also provides usage-based billing at prices starting at $0.04 cents per hour of video imported.


Example: Joe opens his laptop with a folder containing 12 hours of video files from 20 cameras, starts the importer, and let's it run in the background for 10 minutes. He can see its progress as % complete, and if he interrupts the import at any time, it resumes from where it left off. On the local network, the importer rips through 12hrs*20=240 hours of video by asking the segmenter to label the video segments that might possibly warrant human attention (i.e. times when humans, cars or other significant objects were moving). Joe sees the message "100% complete" on his laptop when the analysis has finished, but he also receives an email notification upon completion with an invoice for $0.04*240=$9.60 and a link to the imported video for review and sharing in any HTML5 browser like:
https://camio.com/app/#search;q=5pm+PDT+to+6%3A30pm+PDT+July+2nd+v%3Ag1u0365k9yps

(2)
U
Undisclosed #2
Jul 05, 2018
IPVMU Certified

The per-stream licensing and hardware costs sometimes exceed the value for cameras intended only for post-incident review.

So the annual cost per camera, in the example you gave would be ~$175?

 

(1)
Avatar
Carter Maslan
Jul 05, 2018
Camio

There's no annual cost beyond the sum of the cost of each imported camera hour. 

What's the average number of incident evidence collections you do each year per client?

If you were to import everything the camera ever recorded 24x7x365 then it's better to connect it as a regular stream subscription that can learn and adapt to the scene.

U
Undisclosed #2
Jul 06, 2018
IPVMU Certified

If you were to import everything the camera ever recorded 24x7x365...

24x7x365 = 1 dog year ;)

UM
Undisclosed Manufacturer #4
Jul 05, 2018

This would be an awesome offering. I am wondering though if this would be an offering targeted towards end-users versus Security Integrators - unless there is some sort of a white label offering in play here.

 

Typically I want my customers trained in searching/exporting video and let them do their own investigations.

Avatar
Carter Maslan
Jul 05, 2018
Camio

Maybe the first step is to enable the importer to be run by end users. Then the second step is to enable end users to install/configure the importer?

It's no problem beyond the additional work required to make the setup end-user friendly (unless your end users are tech savvy IT types).

 

(1)
UM
Undisclosed Manufacturer #4
Jul 05, 2018

I like that process but I would want the integrator to install/configure the importer and train the customer.

Then customer can run the tool at their own leisure. The question would then be how to allow the integrator to generate revenue from this? Proceeds from end users use? White label the online version of the product and have the integrator charge X$/hr or MB and then pay you monthly/quarterly/etc?

Avatar
Carter Maslan
Jul 05, 2018
Camio

Yes, the integrator can receive revenue share payments each time the end user pays for an import.

The importer works with any 3rd party service. But if connected to a service powered by Camio (like Ella), then payments are deposited via ACH connection to the integrator's Stripe account. The Ella Dealer Portal supports custom plans and payouts.

UM
Undisclosed Manufacturer #3
Jul 05, 2018

While it may not be what it's meant for, AgentVi was in effect able to do this with their Vi Search product - SavVi Video Search

Year ago I thought AgentVi should have marketed this way, enticing integrators to have their ViSearch product on hand as an emergency review tool after the fact. 

IIRC even years ago it could review video at x200 speed...

(1)
Avatar
Vincent Tong
Jul 05, 2018

Post processing of recorded video will one day become the norm.  My friend once said that computers would be the one consuming the most video data, even more than human eyes with netflix one day.  one example is this , post processing on demand, not only for resolution but many more once the meta data has been analyzed .

(2)
U
Undisclosed #5
Jul 05, 2018

Computer analysis consumption is a 1:1 ratio right now even if you are pairing up some Tesla v100's. In order to help analytics we should find something else other than a pixel to mine video streams, perhaps I could invent a different way to create video using a optics that a machine can read faster than what our eyes can see, to start off I think this needs to happen in 3-D space and not a single lens, single stream POV. Perhaps Tensorflow is just the beginning. Extracting metadata is what all the kids are learning this day. I would hope to see our computing power quantum scale in the palm of my hand one day. More TF notes here for all the nerds: https://arxiv.org/pdf/1610.01178.pdf

JH
John Honovich
Jul 11, 2018
IPVM

Just a follow up on Briefcam: They confirmed that they don't have a product / option for a small camera count or low-cost investigation use case.

They do have an 'Investigator' offering but it is for Law Enforcement only and requires a 3-year subscription. With the 'regular' Briefcam, it includes 100 cameras in the base license.

(2)
Avatar
Jon Dillabaugh
Jul 11, 2018
Pro Focus LLC

If all you want is motion and not full analytics, any of the Nx Witness variants will do this.

(1)
UM
Undisclosed Manufacturer #4
Jul 11, 2018

Jon -

The Nx Witness variants require a second stream to do the Smart Motion Search so it wouldn't work for recorded video.

Avatar
Jon Dillabaugh
Jul 11, 2018
Pro Focus LLC

 

 

(1)
(2)
UM
Undisclosed Manufacturer #4
Jul 12, 2018

Nope

 

I'm aware that we can force it on the primary (definitely not recommended unless camera doesn't support dual streams). We are unable to use Smart Motion Search in a standard AVI/MP4 format.

I don't know all the answers so let me know if there's something I'm missing!

UE
Undisclosed End User #6
Oct 20, 2021

There was a break-in on a site our organisation rents, it was awkward accessing the landlord's CCTV and as I only had a limited time period to access the physical recorder I exported all potentially relevant footage for review later. Unfortunately, the event log hasn't exported for whatever reason and I'm stuck staring at a lot of footage for 3 seconds of motion. Is there any way of getting motion detection from the recorded video? Many Thanks.

Avatar
Brian Karas
Oct 20, 2021
Pelican Zero

Vintra has a cloud version that is targeted at a variant of that use case (more so for police investigators).

If you email them (sales@vintra.com) you might be able to get a demo account for 30 days that you can upload your footage to. Processing time is around 20X, or 20 hours of video would be indexed and available for searching in about an hour.

(1)
(2)
U
Undisclosed #2
Oct 21, 2021
IPVMU Certified

Get a DVR and a camera, point the camera at the screen playing the export.

Only half-joking.

New discussion

Ask questions and get answers to your physical security questions from IPVM team members and fellow subscribers.

Newest discussions