Avigilon Appearance Search Aims to Transform Video Surveillance

By: John Honovich, Published on Jun 20, 2016

After a 'revolutionary' edge storage release this Spring, Avigilon is now aiming to 'transform video surveillance' with its upcoming appearance search.

We spoke with Avigilon about the offering, and examine it in detail inside, comparing to competitors and looking at how Avigilon will position this.

***** *'*************' **** ******* *********** ******, ******** ***** ****** ** '********* video ************'**** *** ******** ********** search.

** ***** **** ******** about *** ********, *** examine ** ** ****** inside, ********* ** *********** and ******* ** *** Avigilon **** ******** ****.

[***************]

What ** ****

******** **** ***** ***** to ****** ***-****** ****** and ********, ********* ********** matches ****** **** *** cameras ** **** ******* probability *******. *** *******, if *** **** ** know ***** *** ********* or *** ** ********** went, **** * **** with ****, ****** *** object *** ******** **** show ******* *******, **** the **** ** ******** investigation ****.

**** ** ********* **** so *** ****** **** a ****** ****** ** vehicle *** *** ** alert *** ****** / new ******* ** **** time (**** ***** ****** work **** ****** ****** if *****).

Marketing *****

***** ** ********'* ********* video.

*************, *** ******* ** misleading, ** ***** *** declares:

** ** * **** simple *** ** ****** an ********** ** * vehicle ** *** **** of *****, *** ***** of *****, ***** **** to ***** ** ** like *** ***** ***** on * ******* *** say **** ** *** instances ** **** ****** all ** ******* *********** across *** ****.

*** ****** ** **** in ****:

  • *** ****** **** *** show '*** ********* ** that', ******* *** ******** individual ** *******, ** will **** *** ***** objects ***** *****, *****, etc. ******** ****, ***** many ***** **** ** different *********** ** ********. The ****** ***** ***** work *** ** **** not **** **** '****' is, ** *** **** return ****** **** **** like '****'.
  • ***** ** **** ******* size *********** (******** *** acknowledged **** *** *** yet ********* **** ** is) ** *** *** individual ** ******* **** 'any **** ** *****' will ****.
  • ** **** ***** ****** 'all ** *******' ** all *** ******* *** analytic ******* ******** ****. This ****** ** ***** or **** ******-**** ** other *******.

Cameras (******** ******* ****) *** *** *** (****) *******

**** ******** ********'* ******** enabled ******* (*.*., *** H3A *** *** ** but *** *** ***-********* H3 ** *** ***** dome) *** ** ******** version ** ********'* *** (ACC6). *********, ** ***** party ******* *** *********.

Pricing *** ************

******* *** *** **** determined, ************ ** ***** will ** * ******* fee ** ****** **** feature *** ******.

************ ** ******** ** ~6 ******, ****** ** 2016, *** *** ******* is ***** ** ***********.

VideoIQ ********** ****** ******

**** ** ***** / extended **** *** ********** search ******* ** ******* (who ******** ****** ** 2013). ******** **** ******* **** in ******* *** ***** ***** shows *** ** ****** like ****:

***** *** * ***** improvements ******:

  • **** ****, ******* *** a ******* ****** ******, now *** ************* **** be ******* ********* ** Avigilon ***** *** ******* including ********** ** *** various ********** *******.
  • **********, **** ******** *******'* VMS, ***** *** ******* and *** ******* **** as * ***. ********'* VMS, ******* *** **** respected, **** **** ********** search ******** ********** ****.

******** **** **** *** underlying *********** / ******** has ******** **** *** VideoIQ ******* *** *** not ***** ********* ** this.

Matching / ********* *** *** ****'*

*** ******, ******** **** the ******** *** ***** on *****, *******, ***** and **** ** *** person. *******, ** **** not ****** ** *** facial ***********. **, ******* speaking, ** * ****** is ******* * ***** shirt *** *** *****, it ***** **** *** a *********** ** ***** / **** ******* ** that. ** ***** *** 'know' **** *** ****** wearing ***** ******* *** 'Bob' ** '***', ***.

*** ********, ******** **** the ******** *** ******* based ** *****, *******, shape *** **** ** the ***. *******, ** does *** ****** ** type ** ******* (*.*., sedan ** **** ** minivan) ** ***** / make.

Performance / ******** ********

********, ** **** ***** analytic, **** ** *** #1 *******. ******** *** certainly ****** *******, ****** for **** *** **** them ****** ***** ***, but *** ******** ** is ******* ** ** seen.

*************, ***** *********** ** such ********* *******:

  • ***** ** ******** ** target: * ******* ******** head ** ** *** camera **** *** ***** as **** ** **** very **** ******* ******** in *******.
  • ********* / **** ** day: ***** ***** ** crucial ** **** ********, if *** ** ******* in *** ** ********** lightning, ******* *** ********* look ********* ** ********* times ** *** *** or **** ****** ** camera.
  • *** ****** *** ***** of *** ****** **: The **** ****** *** color ** *** ****** is ******** ** *** video, *** ***** *** system **** *******. *** example, ** *** ****, they **** * ****** wearing * *** ***** standing *** ******* * mostly **** **********.

**** **** **** **** better **** * ****** wearing * **** ****** color **** ***** ******* a ****** **********.

  • **** ** ******: ** is *** ******** ** reliably **** ** *** person ******** *** ** 5'11" *** * ******* is **** *'*, ***. This ** ********** ** people ***** ********* ********* from *******, ******* ****** different ******, ***.
  • ***** *******: *** **** detailed *** ****** ********, the ****** ** ** to ********** ***** ** against ***** *******.
  • *****: *** **** ******* one ******** ******, *** more ****** *** ******* will ******. ** ** one ***** ** **** a ****** ** *** same ******, ******* ** find **** ****** *** cameras, **** ******* ***** people ***** ** **** can **** ** *** analytics ***** *******.

******** **** **** **** will ******* ********** *** recommendations ** **** ******* in *** ******.

Competitors ********

***** ** **** ****** out ***** **** ****.

**** ** ***** **** common *** ****** (*.*., Exacq, *******, *********) *** anything **** ****. [******: The ******* ******, *** *******'* ******* Search, ***** **** *** same ***** ******* (****** a ******, **** ******* matches) *** ** ** camera ********, ****** ********, but ****** ******** *** more ****** ********** ***** to ** ****.] *** other ******* ** * built-in ******* **** **** is *** *** *** built ** ****** *********** search *** ****** ** color (****** *** **** specific ********** ******).

** *** ****** ****, while **** ***** ***** in *********, **** ********, region, ****** ********, **** of *** ****** ***** brands ***** ******** **** this. ******* *** ******* is ***** *** ****** both***** *************** / ******* ********* *** ********.

Best *********** ********

***** **** ***** **** limited ******** ******, *** best *********** ******** *** be ** ******* / promote********. ******** *** **** a ***** ****** *** a **** ****, ************ in ******** ***** ******** of **** ***** *******, having ***** ** ********* options (**** *****, ****, direction, ***.) ** *** past *** *****. ***** this ** *** * direct ********** ** **** Avigilon ** ********, ******** does *** *** *** strengths (*.*., *** ******** that ******** **** *** do) *** ** ******** to **** **** ***** party ********.

**** ** ********'* **** recent ******* / **** demo **** * ***** ago:

Avigilon ****** - *** *** ********

*** ****** *** ******** is *******.

(*) **** ** * driver ** *** *** high-end ******** ******* ****** than ****** ***** ***** *****, **** ***** *** Avigilon, ********* ** ***** lower ***** ******.

(*) **** ** * driver ** *** ********'* own *** ***-**-*** **** its ******* ** ******** the **** / ***** of ********.

************, ** **** ********* with ********'* ********.

Strange ******?

********** ******** ** *** middle ** **** ** quite ********. *** ******** rarely ***-********* ** *** ahead.

******** **** **** **** will **** *** ******** learn ***** *** ******** and ******* *** ** (e.g., ****** **** **** buy *** **** ********* H4 ******* ** **** systems *** ***** *** appearance ******). **** ***** sense.

** *** ***** ****, given ***** ********* ******* growth *** ******* ***** price, ** **** ***** like * *** ** boost ******** *** ******** public ******* ** ****** can ** ******* ***** a *** '***' *****.

*******

*******, ******** **** ******** this ** ** ********* reason ** *** *** Avigilon, **** ******* *** VMS. ** **** *** pressure, **** ***********, ** similar ****** **** ********** VMSes ** ******* ** try ** ***** **** Avigilon ** *****.

** *** ***** ****, many ********* ******** **** failed **** *** *****. Indeed, **** ***** ******* was ***** ******** *********, not **** ********** ******. So, ** ******** *** make **** **** ********** enough *** **** *** users, **** **** ** a *** ***. *********, frustrated ***** *** ******** takes ** **** **** soon ****** **** **** a ********* ******.

*** **** *****, ** will ** **** **** until *** **** **** works ** **** *****. In *** ********, *** marketing ******.

Comments (52)

Itamar Kerbel

06/20/16 01:14pm

Strange Timing?

Probably to have something new for IFSEC....

John Honovich

IPVM | In reply to Itamar Kerbel | 06/20/16 01:50pm

It is definitely tied to IFSEC.

But the core IFSEC attendance base is weak for Avigilon. For example, the UK accounts for ~7% of Avigilon's revenue. All of EMEA and the UK combined, which is almost everyone who goes to IFSEC, is ~25% of Avigilon's revenue. By comparison, North America represents ~66% of Avigilon's revenue.

And then there's my other points - it's not scheduled for release until the end of the year, the summer means many people will quickly forget, etc.

Even huge vendors like Axis usually only schedule B level / secondary items for a show like IFSEC, leaving the biggest announcements for ISC West and ASIS / Essen.

We'll see. If Avigilon has something bigger than this in 2.5 months to announce at ASIS, than this move makes sense.

Undisclosed Integrator #9

In reply to John Honovich | 06/25/16 03:00pm

EU make be a weak market for Avigilon, but I've heard a few comments from my EU contacts, manufacturers and integrators , about Avigilon being one of their few non-EU competitors there. Makes sense to me as it seems in the EU they still seem to value quality over price over there to a certain extent.

Undisclosed Manufacturer #1

06/20/16 03:19pm

IBM demo'd a similar capability 10 years ago at ISC West and still offers the solution today with Milestone and Genetec.

http://www-03.ibm.com/software/products/en/intelligent-video-analytics

If I remember correctly IBM held a few patents covering these capabilities.

  • Indexing and Searching According to Attributes of a Person(US20100106707, 2008)
  • Calibration of Video Object Classification (US20100054540, 2008)
  • Video Object Classification(US20100054535, 2008)
  • Detection of Abandoned and Removed Objects in a Video Stream (US20090238462, 2008)
  • Real Time Processing of Video Frames for Triggering an Alert (US20090244390, 2008)
  • Object Detection System Based on a Pool of Adaptive Features (US20080232681, 2007)
  • Rule-Based Combination of a Hierarchy of Classifiers for Occlusion Detection (US20080247609, 2007)

IBM Smart Surveillance Research

John Honovich

IPVM | In reply to Undisclosed Manufacturer #1 | 06/20/16 03:26pm

We spoke with IBM not too long ago. It's still around, like you say, but it remains a very uncommonly utilized niche / expensive product. Combine that with IBM's continued cut back and layoffs and it is just not much of a factor.

Undisclosed Manufacturer #1

In reply to John Honovich | 06/20/16 03:29pm

Wouldn't be terrible if someone notified IBM and they went after Avigilon for patent infringement?

John Honovich

IPVM | In reply to Undisclosed Manufacturer #1 | 06/20/16 03:36pm

Maybe Avigilon will read your comment and go after IBM for patent infringement? ;)

Michael Miller

06/20/16 04:40pm

We'll see. If Avigilon has something bigger than this in 2.5 months to announce at ASIS, than this move makes sense.

ACC 6 should be a big deal and I am just guessing here but I would expect to see this at ASIS.

Undisclosed #6

In reply to Michael Miller | 06/21/16 09:25pm

I'm hopeful. My wish list for ASIS and ACC6:

  1. Smart codecs would be nice.
  2. More impressive analytics?
  3. Support for NAS external storage.
  4. Less expensive failover
  5. 4K PTZ
  6. Better WDR
  7. Cameras with integrated audio
  8. Integrated EoC or EoUTP extenders

At the very least 1, 3, and 5 should happen. At this point it seems like Avigilon has been slow to the plate with Smart Codecs - Axis is on their 2nd gen, Panasonic has it, and Hikvision/everyone they OEM to has it. Perhaps it interferes with the "secret sauce" of HDSM.

Michael Miller

In reply to Undisclosed #6 | 06/21/16 09:45pm

@Undisclosed 6 Integrator

I have a feeling a "smart codec" is right around the corner with the H4 camera line. Looks like all the pieces are in place with "idle scene mode" Avigilon isn't normally first out of the gate with new "stuff" but when they do release new "stuff" is works well and is reliable.

Undisclosed Integrator #2

06/20/16 05:54pm

As an user/investigator, this seems to be a nice tool to have. Often subjects may disappear from one camera, and potentially show up on one of many cameras at a later time. And often subjects may stay inside the location for a long time, where you know the time of the incident, but are more interested in where and when the person entered the location.

I do what this tool does manually today. I just memorize a couple of garment colors and the shape of the person, and then start skimming video at 4-8 times regular play speed, one camera at a time. I feel that I get good it for time value by doing this. But it does take time. If I still don't get a hit when I'm done, I decide if I have more time to spend on the case, and maybe start a more rigorous search.

With a tool like this, the "skimming stage" will be done by, as I understand, searching trough meta information saved by the camera alongside the video. My guess is that the search will be fast, like the motion area search. If I got a hit with this tool, I saved loads of time. If I got no hit, I just do what I have done up to now, pretty much without a waste of time. I would not rely on this tool as a substitute for the real work. More like a shortcut that sometimes saves me time.

It's a perk, but I would not choose it over good image, unless image quality isn't very important. Like in an overview, or somewhere I would get a bad image anyway. So being locked to Avigilon just to get this feature on all cameras, would not be a priority.

John Honovich

IPVM | In reply to Undisclosed Integrator #2 | 06/20/16 06:03pm

2, that's good feedback!

If it's fast, it's certainly worth trying. Given how slow VideoIQ's version was, I am curious how fast the final developed Avigilon product will be. Surely it will be faster but it will be interesting to see how fast.

Undisclosed Integrator #6

In reply to John Honovich | 06/21/16 09:28pm

Was the VideoIQ version processed on a server, the client, or on their various devices (Rialto/ICVR)?

Avatar

Brian Karas

IPVM | In reply to Undisclosed #6 | 06/21/16 10:12pm

VideoIQ didn't really have a "server", it was cameras/encoders communicating directly with software on a client PC.

The object matching in VideoIQ was done by the client PC. In short, the PC would download the meta-data description info from each device you wanted to search on, and perform the search/analysis locally on the client, find the matching segments of the video, and then request those video clips from each device.

The search process itself was relatively fast, but pulling many clips from many devices could be somewhat slow, depending on the number of hits on the network connectivity between the client and the device.

Avatar

Octavio Villa R.

IPVMU Certified | 06/21/16 12:29am

I believe Nice was doing something similar in the las ISCWest 2015 or 2014. Did you know / have tested it?

John Honovich

IPVM | In reply to Octavio Villa R. | 06/21/16 01:47am

Octavio, you are right, I forgot to add them in. It's been updated.

Our original coverage of NICE Suspect Search Examined (2014)

Note: NICE was spun off as Qognify (2015)

As for testing it, testing NICE historically has been a low priority because of their very limited business model / market share (primarily going after to mega projects but very few others). I did reach out to Qognify to see what, if any changes, they had made since the spin off.

Thanks again for mentioning this.

Undisclosed End User #3

06/21/16 02:49am

How do Ipsotek and Briefcam compare?

(Briefcam is more of a forensic tool, rather than live tag & trace, but it does offer support search for simiilar tagged obects)

John Honovich

IPVM | In reply to Undisclosed End User #3 | 06/21/16 01:05pm

3, good question / suggestions on Ipsotek and Briefcam.

I do think Briefcam will be helped by Avigilon's move and its probably the best overall counter that Milestone and Genetec can embrace if Avigilon makes headway marketing this.

Though Briefcam definitely specializes in advanced search, it's different from Avigilon. On the plus, it provides synopses that summarize long time periods on a camera in short clips. And it has filters to customize those synopses based on color, size, direction, etc.

However, I do not believe they are doing the type of appearance or suspect search that Avigilon or NICE is claiming. I see no claims from Briefcam that you can click on an object and show me objects that look like that across all cameras.

That said, I've reached out to Briefcam to do an update since I do think Avigilon's move will help promote the overall advanced search space.

Btw, this is Briefcam's most recent product / tech demo from a month ago:

As for Ipsotek and/or Tag and Track, I am skeptical that any of that works regularly even after doing a lot of custom setup. Small players, including Viseum, have been claiming things like that for years but with very limited progress / acceptance.

Itamar Kerbel

In reply to John Honovich | 06/21/16 01:13pm

Please correct me if I'm wrong but while Briefcam does what it does very well, it is not a real time tool.

You cannot just sit and say I want to have a clip of the last 3 hours and after a few seconds it is ready. You have to set your time frame and wait a very long time. Only after the long processing period you can do your own search.

I think what Avigilon is offering (will offer) is a little different.

Avatar

Brian Karas

IPVM | In reply to Itamar Kerbel | 06/23/16 08:15pm

According to Briefcam, a 1hour worth of video can be processed in ~5 minutes (possibly less, depending on amount of activity) on a Xeon processor.

The software will start showing results as soon as the initial portion of the clip has been processed. A 3 hours clip therefore might take 15 minutes in total to process, but a segment of processed video would be available to the operator within the first minute or so.

If you want to narrow down the search using Briefcams filters you would need to wait for the entire video to be processed to get the full results of course.

Undisclosed Manufacturer #4

06/21/16 03:42pm

Actually, both VidSys and Proximex have something similar.

VidSys has this feature called "VirtualTracker", which tracks an object (person, asset, vehcile etc.) in real time as the object moves across cameras in a networked security system. The video streams from multiple cameras are merged into a single screen view with on-screen controls.

Proximex has a tracking feature called "EZ Track", which provides very similar function as the "VirtualTracker" by VidSys.

What I am not sure about is how much video analytic is involved in both tracking features. And both of them seem to be server-based, embedded VMS functions in their PSIM platforms??

Anyone knows? thanks

John Honovich

IPVM | In reply to Undisclosed Manufacturer #4 | 06/21/16 03:47pm

According to Proximex:

The EZ Track solution is based on camera topology, which is easier to deploy, setup and maintain and does not require the use of video analytics.

In general, while there are some offerings that claim to do this, it's typically based on a manual setup of the physical relationship of cameras rather than video analytics.

John Honovich

IPVM | In reply to Undisclosed Manufacturer #4 | 06/21/16 03:49pm

Also, there is Snap Surveillance, which does use video analytics but the operator still needs to click to choose the next camera, not automagically following. From our 2015 roundup:

Snap Surveillance offers an analytic which automatically builds an association between surveillance cameras by analyzing where objects disappear from one and most commonly appear on another. Users click on a portion of the live or archived video where a tracked subject exits, which brings up the associated adjacent camera, similar to Genetec's Visual Tracking feature, though created without manual configuration. A clip may also be recorded of operator tracking, which records the main camera selected by an operator as he or she tracks a subject through the system, for easy export.

Snap MSRP is $75 per camera channel and integrated with Milestone XProtect and Genetec Security Center. This video shows an overview of Snap's offering:

Undisclosed Manufacturer #4

In reply to John Honovich | 06/21/16 08:28pm

Agreed. It seems that many VMS can track people and objects across cameras. Salient also has a tracking feature, which is similar to what you just described.

Maybe IPVM could make a comparison of these tracking functions. Here is a list to start with:

Avigilon:

NICE/Qognify:

VidSys:

Proximex:

Salient:

Snap Sur.:

Genetec:

something like that.

John Honovich

IPVM | In reply to Undisclosed Manufacturer #4 | 06/21/16 08:35pm

I removed the contents of your list. Some of it is clearly wrong or misleading and I don't want people to take it for fact.

As for comparing them, what Avigilon and NICE are claiming to do is completely different than, e.g., Snap and Genetec. Calling them both 'tracking' functions is confusing and mixes two types of function.

Avigilon and NICE are providing a fuzzy search tool that hopefully returns one or a few good matches out of a pool of images but does not claim to know the physical relationship or path between objects across cameras.

Genetec and Snap 'tracking' is an assistance function that makes it easier for operators to select what camera to go to next to physically track a suspect along a path. Neither Genetec nor Snap are claiming to track like Avigilon or Nice Appearance / Suspect search.

Undisclosed #5

06/21/16 04:00pm

Over the last couple of months I have been looking at the academic/industry research side. There is a large amount on this subject so it makes me wonder what can be claimed in Avigilon's patents that has not been done already in some way or another.

Someone mentioned IBM already. Look at the 2012 papers and before published by this IBM researcher...pretty similar objectives.

http://researcher.watson.ibm.com/researcher/view_person_pubs.php?person=us-lisabr&t=1

Lisa Brown was the chair for the 3rd Workshop on Vehicle Retrieval in Surveillance (VRS 2015)

https://avss2015.org/workshop-track-1-traffic-and-vehicle-surveillance/

Some papers related to appearance search in this conference:

Invited Talk: Object-based Retrieval in Surveillance Video using Behavior, Events and Appearance
Anthony Hoogs, Kitware Inc.

Vehicle Identification Using Distance-based Appearance Model
Huang-Chia Shih and Hao-You Wang (Innovation Center for Big Data and Digital Convergence, Taiwan)

Appearance or patter matching has been around forever in compute vision...so I am wondering if Avigilon is patent touting, just to scare away others from implementing their own appearance-based analytics.

Would like to see IBM shaking things a little. I do remember reading IBM claim that they are near real-time.

John Honovich

IPVM | 06/21/16 11:06pm

New Avigilon IFSEC marketing video showing appearance search in action with the same man in red:

Undisclosed End User #3

06/21/16 11:14pm

Depending on your requirements - should you be wary of demos that track individuals in largely uncrowded scenes?

John Honovich

IPVM | In reply to Undisclosed End User #3 | 06/21/16 11:18pm

should you be wary of demos that track individuals in largely uncrowded scenes?

Yes, unless your environment is always uncrowded. Crowds makes analytics accuracy a lot more challenging.

Avatar

Murat Altuev

AxxonSoft | 06/22/16 12:28am

Great to see that Avigilon is promoting forensic search analytics! I also believe, that it will 'transform video surveillance'. All we need is to inform customers about efficiency of this technology, create demand and prove it works! Next big thing is finally coming :)

Undisclosed Integrator #7

06/22/16 03:54pm

I just shared this with a coworker; he responded with a YouTube video shared 9 days ago by Samsung SDS America. The video is sort of showcases their "complex event" and "visual" search functionalities using computer animation. I'm wondering if anyone has any actual hands-on experience with this platform, and how it compares to this latest Avigilon offering.

Avatar

Brian Karas

IPVM | In reply to Undisclosed Integrator #7 | 06/22/16 04:04pm

Is this the video you're referring to?

Undisclosed Integrator #7

In reply to Brian Karas | 06/22/16 04:16pm

No, the video you shared is moderately more informative than the one I viewed. This is the one I viewed:

John Honovich

IPVM | In reply to Undisclosed Integrator #7 | 06/22/16 05:33pm

Feedback from Hanwha Techwin on that video / Samsung SDS:

This offering is an analytic package being promoted by Samsung Data Systems a company within Samsung holding company

So different group / company. We'll try to get in touch with someone at SDS and learn more.

Avatar

Murat Altuev

AxxonSoft | In reply to John Honovich | 06/23/16 07:53am

And, please, ask if it is truth about Moscow SafeCity project. I believe, not :)

Undisclosed End User #8

06/23/16 03:20am

This application is very common in China, and several Chinese companies own similar products. It can search the exact same target ranked by comparison similarity, in different lighting condition and pose.

Avatar

Murat Altuev

AxxonSoft | In reply to Undisclosed End User #8 | 06/23/16 08:33am

Yes, this kind of technologies are now common in SafeCity installations in China and Russia. Here is one of the usage scenario from AxxonSoft installations in one of many SafeCities around Russia:

AxxonNext 4 Search Opportunities

John Honovich

IPVM | In reply to Murat Altuev | 06/23/16 12:15pm

Murat,

That video shows (1) directional motion, (2) filter by color, (3) LPR and (4) facial recognition.

It does not show appearance or suspect search.

I am not saying its better or worse than what Avigilon and NICE are doing but we need to be clear about what's being claimed.

As for your facial recognition demo, since you are here to promote your offering, how well is in the wild / across the city facial recognition working in production?

For example, is this a real criminal you matched?

Avatar

Murat Altuev

AxxonSoft | In reply to John Honovich | 06/23/16 06:13pm

Yes, appearance search is a little bit different. We need to store more than one color of object in database together with shape information. We store only object type (car, human, group), dimensions and single color.

Regarding face search, the results of search in our promo video are real screenshots from working system in one of the SafeCities, but this guy is our staff. He was moving with his car from that shop and entered some places in different times and we found all cases with search tools, so all screenshots are real.

In this SafeCity project, cameras are integrated with door phones in every entrance of every apartment building, so pictures are quite good.

Face search works really great, because we are just sorting all previously captured faces by similarity with the one you are looking for.

Here is the video where we search with absolutely different pictures from passport and some Facebook selfy in 5 days real SafeCity camera archive and no any false results:

Axxon Next 4 Face Search Demo

Everyone can test it by himself: download AxxonNext 4, install and in demo mode (from 8am to 6pm) it works with all features enabled. There is also a possibility to import AVI files for analysis. Some police departments use system in this way when video exported from other NVR/DVR. And AxxonNext is first VMS officially Profile G compliant to get access to external storages online and this is also the way to import online without need to export to AVI.

BTW, important to say, that face search is included to the enterprise license with all other types of search (direction, loitering, color, number of objects, and so on)! It makes this technology available for every camera in the system. The only limit is performance of the server doing online analysis to generate scene description and face vectors to fill database.

Next challenge is to dramatically increase performance by using GPU acceleration on server side, because number of channels per system grows incredibly fast, while CPU performance not.

John Honovich

IPVM | In reply to Murat Altuev | 06/23/16 10:47pm

Murat, your 'no any false results' demo proves nothing.

You (1) search for 2 people only, (2) those people stare right into the camera in a very narrow field of view, (3) there's no indication over what time frame or how many other people have been recorded. Net / net: it's simple to demo something like that but it's inconclusive at best.

Here it is embedded so everyone can see if for themselves:

Btw, I do like that your VMS is profile G complaint. Have you tried connecting it to Milestone using their new Bridge so you can takeover their systems?

Avatar

Murat Altuev

AxxonSoft | In reply to John Honovich | 06/24/16 12:36pm

You can see 4 days and 4 nights on right vertical timeline and this is entrance to the appartment building with couple dozen of flats, so traffic there is quite busy.

BTW, we have also nice option to combine face capture with TimeCompressor and quickly review all faces in motion. There is not much benefit from this, because you can always see them as thumbnails, but looks impressive :)

Regarding Milestone, I can't find them listed as Profile G compliant at onvif.org, while 1263 different devices are in and only 2 clients including us. Once they do it, for sure, we can import archives from Milestone also and offer all search possibilies of AxxonNext. It is easy as exporting - just select the range and click button and 1 hour of video takes few minutes to analyse and generate all meta-data.

Undisclosed End User #3

06/23/16 10:33pm

Using Facial Recognition to tag and track suspects, would seem to be a step up from tracking say human objects wearing red. Wouldn't it?

e.g.

John Honovich

IPVM | In reply to Undisclosed End User #3 | 06/23/16 10:50pm

Using Facial Recognition to tag and track suspects, would seem to be a step up from tracking say human objects wearing red. Wouldn't it?

Sure, if it works.

Main issues with facial recognition done on surveillance cameras / systems:

  • Relatively narrow FoVs needed.
  • Relatively constrained down and side tilts required.
  • People need to be facing the camera head on, etc.

Even with all that, it has issues, especially if you are searching over large numbers of cameras, time frames and crowded areas.

Avatar

Murat Altuev

AxxonSoft | In reply to John Honovich | 06/24/16 12:56pm

Analytics is progressing together with CPU power. Main constrain is not FoV or side tilts, but CPU power. During next ASIS and ISC West we are going to present face search live in exhibition crowded environment. Hope you'll stop by to evaluate.

John Honovich

IPVM | In reply to Murat Altuev | 06/24/16 01:10pm

Main constrain is not FoV or side tilts, but CPU power.

Then why do you have your subjects in that video stare right into the camera? ;)

Related, that guy staring into your camera would be the worst criminal!

Avatar

Murat Altuev

AxxonSoft | In reply to John Honovich | 06/24/16 01:34pm

Ok, here is another example from metro: Man found in the left corner and source face is very much tilted.

John, please, believe me, it works really good. Hope you visit out booth or play by yourself as it is available without even need to ask us for the key or something.

Undisclosed Integrator #6

In reply to Murat Altuev | 06/24/16 04:39pm

Undisclosed Integrator #9

In reply to Murat Altuev | 06/25/16 03:28pm

For Murat, or any manufacturer demonstrating these "intelligent searches" or anything similar, I would suggest demonstrating more realistic situations and environments than idealized ones. As John alludes to, no one is going to be staring straight into a camera unless (1) they intend running face first into one or (2) they are asked to and decide to comply.

I have learned when I put on my salesman hat I make more of an impression to clients debunking idealized situations that are not that much real world, and at the same time I am running into more clients lately who are are able to discern it more for themselves and being more critical of such claims.

Your product may actually work great and be easy to sell to someone who cannot tell the difference, but you take a risk if it's an informed person who knows how to spot a well "staged" demo, or someone like me who comes along before the sale and debunks it, if you don't have a back up demo that looks more like real world.

Undisclosed #10

IPVMU Certified | In reply to Undisclosed Integrator #9 | 06/25/16 04:14pm

I would suggest demonstrating more realistic situations and environments than idealized ones.

To be fair, it's an idealized test of a realistic situation. As opposed to an ideal test of an ideal situation, e.g. if there was no head tilt and the angle of all the shots were similar. Which we used to see in gen 1 demos.

Moreover, do you think the four frames taken from the pinch point are unlikely to actually occur? Note that only the distant ones are facing the cameras, as would be expected as one approached the narrowing.

Its easy ask for more realistic and challenging situations until the system fails and then say ITYS, but the question is whether the capability as shown could provide necessary ROI.

I think, depending on the use case, absolutely.

Avatar

Murat Altuev

AxxonSoft | In reply to Undisclosed #10 | 06/25/16 04:25pm

ROI is the thing...but not because of quality of analytics.

Typically you can connect few hundreds cameras to one server without analytics. But with face recognition engine - few dozen. So, even if license is free, you need to buy a lot more processing power - 10 times more! And than ok, I better search manually :)

Avatar

Murat Altuev

AxxonSoft | In reply to Undisclosed Integrator #9 | 06/25/16 04:16pm

I'm very much for real demonstrations that is why:

1. This demo is from real city camera installed inside existing doorphone;

2. Everybody can download and try our software in his own environment;

3. Price for this analytics is included to the license, so no big disappoint if not happy with efficiency of exactly this type of search as all the others exists of course.

We know how difficult is to handle high expectations from customers after installation. We had a lot of stories with online detectors. Once abandonded objects was installed for metro. In real environment it shows 5-6 false alerts per hour and for us it was not very bad result, but for 1000 cameras it is 5000 alerts, so customer now complain and we are working hard couple of months trying to get better result, but still not sure if we can fulfill their expectations. Conditions in metro are really bad for this kind of analytics when people are staying and waiting without any movement. And this customer is now very angry.

But what I'm for now is forensic search analytics. This is completely different thing. This 5-6 false alerts is not a problem. You'll just skip them during your investigation in archive. This analytics really helps! We have great feedback from police departments. System helps to investigate cases! This is really efficient application of analytics. We are not saying, that we'll find criminal by one click, but we'll sort all faces captured during days by similarity and it will help operator to find him! And object tracking search also very helpfull. Why I say that the only problem is CPU resources, because once police start to use it, they want all cameras in the city to generate metadata in realtime, so we need thousands of servers!

I'm just back from IFSEC and I was impressed with one product there: new NVidia GPU offerenings. This is going to change our market. I'm promoting forensic search during many years and now I'm sure that we are on the right track.

John Honovich

IPVM | 06/27/16 10:57pm

We did a post on Briefcam.

Also, Agent VI confirmed that they have the same feature, they call it 'Search For Similar Targets'. Here is their training video that shows it:

We plan to do a test on it.

Login to read this IPVM report.

Related Reports

AndroVideo Presents Edge AI Face Recognition Cameras on Jun 26, 2020
AndroVideo presented its AI at the edge face recognition cameras at the May...
SAFR Presents AI Facial Recognition on May 18, 2020
SAFR presented its AI facial recognition at the April 2020 IPVM New Products...
Ipsotek Presents AI Analytics and Object Tracking on May 15, 2020
Ipsotek presented its AI analytics tracking people and vehicles across...
Trueface Presents AI Face Recognition, Mask and Temperature Detection on Jun 10, 2020
Trueface presented its AI facial recognition, mask and temperature detection...
Avigilon Presents Cloud Connected ACC on May 13, 2020
Avigilon presented Avigilon Cloud Services, which supports cloud-connected...
Axxon Presents VMS 4.4 and AI Behavior Analytics on May 20, 2020
AxxonSoft presented its VMS 4.4 and AI behavior analytics at the April 2020...
Genetec Presents Security Center for Airports on Apr 28, 2020
Genetec presented its Security Center for Airports at the April 2020 IPVM New...
YOLOv5 Released Amidst Controversy on Jul 27, 2020
YOLO has gained significant attention within video surveillance for its...
Vivotek Presents AI Analytics and LPR on May 19, 2020
Vivotek presented its AI Analytics and LPR at the April 2020 IPVM New...
Euklis Presents AI Analytics on May 05, 2020
Euklis presented its AI facial recognition, LPR, and object recognition...
ISS Presents Face As A Credential and UVSS on Apr 30, 2020
ISS presented its security platform, including access control integration,...
Surveillance Storage 101 on Mar 23, 2020
This guide teaches the fundamentals of video surveillance...
Video Surveillance 101 Book Released on Jul 07, 2020
IPVM's unique introduction to video surveillance series is now available as a...
Indoor Robotics Presents Tando Aerial Drones on May 20, 2020
Indoor Robotics presented Tando indoor autonomous drones at the May 2020 IPVM...
Alcatraz Presents Face Recognition Access Control on Jun 11, 2020
Alcatraz presented its AI facial recognition access reader at the May 2020...

Recent Reports

Video Analytics Online Show September 2020 Opened - Axis, Avigilon, Bosch, BriefCam, Genetec, Milestone + 30 More on Aug 12, 2020
IPVM's sixth online show will feature 35+ Video Analytics companies...
The German Company Powering Many China Temperature Tablets (Heimann) on Aug 12, 2020
Many fever tablet suppliers market German-made Heimann thermal sensors while...
Salesforce Drops Dahua and Hikvision on Aug 12, 2020
Salesforce has dropped Dahua and Hikvision as customers, forcing the two mega...
Access Control Course Fall 2020 - Register Now - Save $50 Last Chance on Aug 12, 2020
IPVM offers the most comprehensive access control course in the...
Genetec CEO Declares "We Don't Negotiate Payment With Patent Trolls" on Aug 11, 2020
Are patent trolls like terrorists? Genetec's CEO is coming out strongly...
Hanwha AI Analytics Camera Tested on Aug 11, 2020
Hanwha has released their Wisenet P AI camera, adding person and vehicle...
Alabama Schools Million Dollar Hikvision Fever Camera Deal on Aug 11, 2020
The Baldwin County, Alabama public schools purchased a $1 million, 144-camera...
Dahua Taunts Australian Government, Continues To Sell Illegal Fever Cameras on Aug 10, 2020
Dahua is effectively taunting the Australian government by continuing to sell...
HID Releases VertX Replacement Aero on Aug 10, 2020
HID is replacing two established and broadly supported types of access...
NDAA Compliant Video Surveillance Whitelist on Aug 10, 2020
This report aggregates video surveillance products that manufacturers have...
Telpo China Temperature Tablets Tested on Aug 10, 2020
The provider for overseas companies ranging from Canon Singapore to US'...
Dangerous Hikvision Fever Camera Showcased by Chilean City on Aug 07, 2020
Deploying a fever camera outdoors, in the rain, with no black body, is...
"Grand Slam" For Pelco's PE Firm, A Risk For Motorola on Aug 07, 2020
The word "Pelco" and "grand slam" have not been said together for many years....
FLIR Stock Falls, Admits 'Decelerating' Demand For Temperature Screening on Aug 07, 2020
Is the boom going to bust for temperature screening? FLIR disappointed...
VSaaS Will Hurt Integrators on Aug 06, 2020
VSaaS will hurt integrators, there is no question about that. How much...