Camio Natural Language Processing Tested

Author: Ethan Ace, Published on Sep 27, 2016

The ex-Googler led team from Camio has advanced its video monitoring offering to include natural language processing.

Camio ingests video, automatically determines what objects are, labels those objects and then allows users to search for them with words, like Google but for surveillance video.

Here is an example of the type of labeling they claim to do:

We tested Camio's performance connected to an Axis camera and a Nest cam using a Camio Box we bought.

*** **-******* *** **** ************ ******** *** ***** ********** ******** ** ************** ******** **********.

***** ******* *****, ************* ********** **** ******* ***, ****** ***** objects *** **** ****** ***** ** ****** *** **** **** words, **** ****** *** *** ************ *****.

**** ** ** ******* ** *** **** ** ******** **** claim ** **:

** ****** *****'* *********** ********* ** ** **** ****** *** a **** *** ***** ****** ***** ******.

[***************]

*******

*****'* ****** / ************** ************ *** *** ****** ******** ** have **** **** ** ***** ************. **** **** *** **** it ** *** '****' (** ********* *** ** **** ** many **** ********* *** ****, ** ******* *****, ** **** matching, ** ****** **********, ***. ***** ***** **** *** **). However, *** ****** **** **** ****** ***** *** *** ****** detailed ******** ** ******, ******, ****, ******* ***** *** ************* between **** **** ** ** ****** *** ******** **** ** enterprise *****.

*******, *****'* ********* ** **** ***** ** ***********, ***** *** average **** ***** ** ******** ** *** *** **** ******** and **** ****** ** *** *** $**.** *** ***** *** camera *** ***** ******** *********. ** ********, ** ***** *** Camio's ********** ** ****** ********** / ** ********* ************** *** an ********** ***** ************ ********.

Key ********

**** *** *** *** ******** **** **** ****:

  • *******, ****** ******** ****** **** ** *** *****, ****** **** some ********* ** *********** *** **** ******* *** ******* ** all.
  • ******** **** ******* ** **** ******, **** ********* **** ** car, ******* ***, ***** ******* *******, *****, *******, ***. ***** categories *** ********* ********, ****** **** ******* ** ***************** ******, with **** ******** ****** **** ********.
  • ***** ******** ** *** **** ******* ******* ** ***** ********, such ** **** ** "*******", *** ***** ****** **** ********** in *** *****.
  • **** ****** *******, **** ** ********** ** *****, **** *** included ** *** ****** ***** ***** *** *******. ***** **** these *** ** ******* ** **** ******** ****** *********.
  • **** ****** **** *** *********** ******, **** ** **** ******* clips ***** ******* "*****" ** "****", *** ****** ***** ********** "ceiling." ***** ******* ****** ** *** ****, *** *** *** likely ** ** ****** ** *** ** *** ***.

*** ******** ********* ** ***** (********, ******, *****, *********) *** essentially *********, ******** ***** ******** ******* *** ** ******** **** *** *** **** ******** *************** described *****.

*******

*****'* *** ****, ******** *** ******** *********, ** $**.** *** *** ***** per ******. ***** ***** ***** ****, ***** **** *** ******** analytics/labeling, **** ***** ******/******, ** $*.** *** *****.

***** **** *** ***** *** **** ***** *** **** ********* of *** *** ******* ****** *******, **** ** ******* *** search, ** *********.

Camio ******* ******** ********** ********

*****'* ********* ******* ***** ***** ******* ******** **********, ***** ******* labels ** ******* ** *** ***** *** ******** *** ******, in **** **** ****** **** ******* *********. **** ******** ** automated, ********* ********** ** *******, *** ***** *********.

*** *******, ***** **** ********* ********* * ******* ******** * given ****, ***** ******* **** ******** ******, **** ** "***** utility *******", "****", "***********", ***., *** **** ** *** ****** object, *** **** ** ********** ******* ** *** *****, **** as *****, *****, ** *******. ***** ****** *** ** ******** later, ** ****** ** ******** ******* ****.

**** ***** ******* *****'* ******** *** *** ** *** ** searched/used:

People ********

***** ********* ******* ****** ** *** ****** ******, *** *** night, ****** *** *******. ** *** ** ******** ** ***-***** objects ***** ******* ** ******.

Vehicle ***** **************

******* ** ****** *** ******* **** "********", ***** *** ****** for ******** ***** ** ***, **** ** "***** ******* *******" or "*******" ** "****** ***." **** ******** **********, **** ** "compact ***** ******* *******" ** "**** **** ***" *** **** possible.

** *** *****, ***** ******** **** ********* ******** (***** *****), though ***** **** ** *** **** ** *******, *** ********* identifies ** *** ** * *******, * ***** ** ** SUV, ***. ** ***** **** *** **** ******** **********, **** as "******* ***" ** "**** **** ***" ** "******* ***** utility *******" **** **** ******** **** *** **** ******* *****.

Object *********

** ******** ** ******** *******, ***** ****** ***** ** ****** by ***** *** ********* (***********/*********). ** ***** *** ****** *** "cars ***********" ** "****** ******* ****" (*****).

**** **** ***********/********* ***** ** *******' ******** ******** ** *** ******, *** *** ******* ****** ******** ** **** *****. ** "person *********** ****" ********* ******* ****** ** ***** * ****** approaches *** ********** **** ** *******, *** ****** ************ *********** * ****.

***** **** **** ****** ** ******* *** ***** ********* ******* in *********** **** **** ***** ** **** ********* **** *********, and ****** *** **** ** ********* **** ****.

Mislabeling ******* *******

** *** *****, ***** ******* ******* ******* ** ***** ******** only * ******* ** *****, **** ** ***** **** ********.

*** *******, *** ******* ******* * ********/***** ** *** ***** below, ***** *** ******* ** "***" ** *****. ****** ******* in *** ****/***** *** *** *** ** ** *******, *** accurate.

***** **** ********* ** ***** *** ******* ***** "******" ** a ******* ******** * ***** *****. ***** **** **** **** is ****** *** ** *** ****/***** ** *** ****** *** the *******'* *******, ****** ** **** ******* ** * *****.

Objects *** *******

** ******* *********, ****** ******* **** *** *******. *** *******, during *** *****, ***** **** ***** ***** ** *********** ****** grass, **** ** * ****** ***** *** **** ******. ***** labeled ***** **** ** "********", *** **** ** **** ******** data, *.*., * "*********" ***.

Some ****** *** *********

*******, **** ** *** ****** ******* ** ***** **** ****** not *********** ****** ** **** *****. *** ********, "****" *** one ** *** ********* ******, *** ********* ** ****** ***** clips ** ***** **** *** *******. **** **** **** ** not * ******** **** ******* ****, *** ************* ******.

** *** ****** ******, **** ***** **** ******* "*******", ****** essentially ***** **** *** ******* ******* ** **, ** *** camera ** ** *******/******** **** ** * ********** ***** ****.

Camio ***

***** ********** ******** ******* ***** ** ******* ******* ** ***** service, ********* ** ********* ***** ***** ** ********* **** *****, with ** ****** ** **** *****.

*******, **** **** ********** **** ******* **** *** "***** ***", * ***** **** ****** ****** ***** ***** *** ***** network *** ******* *** ******* ***** ** *** ***** ******* manual *****. ***** *** *** ****** ** *** *********:

  • ***:$** ******, ******* ** ** ***** ** *******
  • *** ***:$*** ******, ******* ** ** ******* ** *******

Comments (16)

Undisclosed Integrator #1

09/27/16 04:22pm

I was just saying to my coworkers at ASIS about the next generation of video analytics being machine learning and using human feedback to "teach" the analytics, much like Google's Picassa or Apple's Photos does with faces.

The next day I came across Iron Yun at the rear of the show and was blown away by the capability and how it performed at identifying human subjects stacked deeply in the FOV using web cam video live.

I would be interested to see how the two solutions compare, and more importantly, I'm keeping my eyes open on this type of analytics since machine learning in general is finding its way into many aspects of our lives, like automated assistants. The security applications are going to be interesting...

Undisclosed Manufacturer #2

09/27/16 06:07pm

That is a very interesting technology. I wonder how long until we see it integrated into a normal VMS, not as an add on like BriefCam or other analytic companies.

Thumbnail carter maslan camio

Carter Maslan

Camio | 09/27/16 07:58pm

Less than 1 year. I'm CEO of Camio and we're enabling cameras, NVRs and VMSs to embed this technology seamlessly with non-restrictive licenses, white-labeled services, and an extensible video processing pipeline. That way, manufacturers leap frog the low-level grunge-work to run Machine Learning at scale and at low cost without losing their ability to differentiate with unique video processing capabilities and service levels.

Undisclosed Manufacturer #2

In reply to Carter Maslan | 09/27/16 08:11pm

Thats fantastic. Who we talk to about this? About how much CPU per camera does it take for a 1080P 7 frames per second H.264 stream? Does this have a large database that is required to run alongside it?

Thumbnail carter maslan camio

Carter Maslan

Camio | In reply to Undisclosed Manufacturer #2 | 09/27/16 08:27pm

Great, please contact me or partners@camio.com.

For CPU benchmarking, the 1.5Ghz cortex-A53 cores with 2Gbyte DDR3 SDRAM easily handles three 1080p video streams at 20 fps.

The local firmware doesn't have any large database. Instead, it extracts features from the video event locally in a chatty "metadata-first" exchange with the cloud to learn and rank what's interesting without needing to upload video.

Thumbnail pp

Rafael Oneda

In reply to Carter Maslan | 03/27/18 12:25am

Hello Carter.

I'm interested in this solution. We are a brazilian installer and have a lot of projects in courthouses, universities and hospitals.

Is this sollution deigned to enterprise scenarios with hundreds of cameras?

How can we get a demo license?

Thumbnail carter maslan camio

Carter Maslan

Camio | In reply to Rafael Oneda | 03/27/18 05:53am

Hi Rafael - Yes, hundreds of cameras is no problem.

If a large deployment has limited uplink bandwidth available, then you can leave the video itself on premise using metadata mode; but you still need at least 30 kbps/camera * num_cameras uplink available (e.g. 120 cameras * 30kbps/camera = 3.6 Mbps up). Yes, contact us when your video streams are connected and we'll send you a code for your evaluation.

Undisclosed Integrator #3

09/27/16 09:56pm

Very interesting product. Will keep my eye on this for sure. While many of our customers fear the cloud, I do believe something like this may start to tip the bar.

I do agree, quite heavily, that this is misplaced in the home market. If this were scaleable, and at the very least capable of processing in an Enterprise data center with only the metadata being sent to the cloud the potential for uptake in large enterprises is huge. I cannot tell you how many customer sites I see with one or two guards addressing elevator alerts, fire alarm alerts, door monitoring systems, card access alerts, key management, and answering random phone calls all while being expected to watch several hundred or thousands of cameras. Analytics alone isn't quite at the point it needs to be.

I can see placing something like HP Moonshot in a datacenter and sending the data out to the cloud being more acceptable.

I will definitely keep an eye on this company in the future. Thank you to IPVM for updating this as I missed the initial review.

Thumbnail carter maslan camio

Carter Maslan

Camio | In reply to Undisclosed Integrator #3 | 09/27/16 11:49pm

Yes, you control the metadata and media that gets uploaded to the cloud at both the account and camera level. For example, you can leave all video files on the local network but upload only lo-res thumbnails for fast browsing in the cloud.

Regarding the problem of overloaded guards missing things, there are two aids:

  1. alerts triggered by persistent searches (e.g. alert for [people approaching side alley] delivered to the guard's phone)
  2. very fast browsing for human review (e.g. this browser page shows all people this morning on one screen and includes histogram of frequency over time at bottom)
    fast browse for human review

We'll look at HP Moonshot too. Thanks for the pointer.

Undisclosed Integrator #4

09/28/16 09:14am

the problem with home users is that they tend to have low cost equipments which do not produce metadata, and uploading 4-8 HD cameras to the cloud would take too much bandwidth.

John Honovich

IPVM | In reply to Undisclosed Integrator #4 | 09/28/16 10:16am

4, that's the point / role of the Camio Box that we mentioned in the report.

Thumbnail carter maslan camio

Carter Maslan

Camio | In reply to John Honovich | 09/28/16 04:27pm

These examples might help clarify how Camio works with any camera/NVR/DVR that provides its RTSP H.264 video stream.

Camio has open-sourced that rtsp repo under the Apache License to create a shared resource for everyone that needs programmatic access to well-tested RTSP urls across camera makes and models. There's a README with instructions to add your own cameras/NVRs.

Undisclosed End User #5

09/29/16 02:35am

I wonder if something like this could extend to internal loss prevention through sophisticated analysis of retail cash register transactions? Recognize your stock, serial register stream mismatches flag potential sweethearting, monitor movement of cash?

Thumbnail carter maslan camio

Carter Maslan

Camio | In reply to Undisclosed End User #5 | 09/29/16 04:29am

Unfortunately, it's very difficult to get that level of precision and tracking of individual objects (like bills) without very high res stereoscopic cameras. But Camio could help more crudely with basic triggers for suspicious *sequences* of events. For example, shoplifting might look like a sequence: 1) "people approaching front entrance" -> 2) "people at high-value display area" -> 3) "people departing front entrance" without the presence of a common intermediate event as 2a) "people at cash register". Camio hooks enable you to create these kinds of rules in custom-coded solutions.

Rodney Thayer

04/14/17 01:57pm

But is it safe in the cloud. sounds cool, vendor sounds like they have clue (see ISC West discussion article too.) What's in the cloud, how'd it get there, did getting the data there perforate the site network perimeter, is my data hanging out in the breeze not technically private and/or owned by me, etc. you know the drill...

Thumbnail carter maslan camio

Carter Maslan

Camio | In reply to Rodney Thayer | 04/14/17 03:24pm

@Rodney - Camio Box sits on the local network with your cameras/NVR and uploads only via SSL port 443. All inbound network ports can be closed, so it eliminates the port-forwarding security risks too. Both the transmission and storage of metadata and video is encrypted. The SSL connections even use Perfect Forward Secrecy so that even if the NSA somehow decrypted a single recorded SSL session, they can't use the keys for subsequent sessions.

Also, there are no account credentials stored on the cameras, NVR, or Box. Camio Box uses a special token that permits only uploading of the content. So if someone steels the Box for an offline attack of its memory or SD Card, there is nothing to be hacked and no way to gain account access.

Bottom line: all data is owned and encrypted for you only (and any authorized guests you explicitly add to your account).

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Video Analytics

Cisco Meraki New Cameras and AI Analytics on Dec 14, 2018
Meraki has released their second generation of video surveillance with 3 new cameras, AI-based video analytics, and 2 cloud-based storage...
Top 2019 Trend - AI Video Analytics on Dec 10, 2018
160+ Integrators answered: What do you think the top industry trend will be in 2019? Why? AI / video analytics was the run-away winner with...
Alarm.com "AI" Video Analytics Tested on Nov 30, 2018
Alarm.com has announced what it calls an "artificial intelligence (AI) architecture and video analytics service", touting that  Alarm.com's...
Vintra "AI-Powered" Video Analytics Startup Profile on Nov 27, 2018
Vintra is a Silicon Valley startup focused on AI-based video analytics. They had booths at IACP and ISC West demonstrating their hosted or...
Genetec Kiwi Intrusion Detector Analytics Tested on Nov 27, 2018
Genetec has built Kiwi Security's Intrusion Detection analytics into Security Center, aiming to simplify deployment compared to separate camera...
Top Manufacturers Gaining and Losing 2018 on Nov 26, 2018
This is the 5th year IPVM has tracked manufacturers gaining and losing: Top Manufacturers Gaining and Losing 2014 Top Manufacturers Gaining and...
Intel Neural Compute Stick 2 / Movidius AI Test on Nov 21, 2018
AI is a major trend in video surveillance with manufacturers paying significant attention to Intel's Movidius Myriad chips. Indeed, Avigilon has...
Arcules Cloud VMS Tested on Nov 19, 2018
Arcules is a big bet, or as they describe themselves a 'bold company', spun out and backed by Milestone and Canon.  But how good is Arcules cloud...
Beware Amazon Go Store Hype (Tested) on Nov 13, 2018
IPVM's trip to and testing of Amazon Go's San Francisco store shows a number of significant operational and economic issues that undermine the...
Genetec Privacy Protector Tested on Nov 12, 2018
Genetec has built Kiwi Security's Privacy Protector into Security Center, an analytic which anonymizes individuals in cameras' fields of view...

Most Recent Industry Reports

Imperial Capital Security Investor Conference 2018 Review - ADT, Resideo, Alarm.com, Arlo, Eagle Eye, ACRE, More on Dec 14, 2018
Imperial Capital Security Investor Conference is an event matching industry executives with financiers that frequently leads to future funding...
Cisco Meraki New Cameras and AI Analytics on Dec 14, 2018
Meraki has released their second generation of video surveillance with 3 new cameras, AI-based video analytics, and 2 cloud-based storage...
Foolish Strategy: OEMing Facial Recognition on Dec 13, 2018
Almost as 'hot' as face recognition marketing right now is OEMing facial recognition. Last year, they were a who's who of company's with...
DVR Examiner - Video Recovery from Recorder Hard Drives on Dec 13, 2018
Bypassing passwords and long download times on-site, DVR Examiner collects and organizes video evidence directly from a hard drive extracted from...
2019 Access Control Book Released on Dec 12, 2018
This is the best, most comprehensive access control book in the world, based on our unprecedented research and testing has been significantly...
Huawei Hisilicon Quietly Powering Tens of Millions of Western IoT Devices on Dec 12, 2018
Huawei Hisilicon chips are powering, at least, tens of millions of Western IoT devices, such as IP cameras and surveillance recorders, a fact that...
FLIR Launches Body Cameras Unified With VMS (TruWitness) on Dec 11, 2018
While FLIR is best known for their thermal cameras, now they have expanded into body cameras, launching TruWITNESS, a public safety focused body...
Startup Sunflower Labs' Autonomous Drone Security System on Dec 11, 2018
Startup Sunflower Labs is claiming a unique design on a home security system, combining autonomous drones and 'Sunflower' sensors. Imagine an...
The 2019 Video Surveillance Industry Guide on Dec 10, 2018
The 300 page, 2019 Video Surveillance Industry Guide, covers the key events and the future of the video surveillance market, is now available,...
Multi-Factor Access Control Authentication Guide on Dec 10, 2018
Can a stranger use your credentials? One of the oldest problems facing access control is making credentials as easy to use as keys, but restricting...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact