$59 Smart Camera Module (Pixy)

By: Ben Wood, Published on Aug 27, 2013

Beset by lawsuits, the video analytic industry has seen little innovation recently. Now, a new offering from Carnegie Mellon researchers offers a super low cost smart camera module, raising over $270,000 on Kickstarter. We talked to Richard LaGrand, founder of Charmed and CMU partner, about the technology and its possible applications. 

Background

LeGrand said Pixy was mainly developed to give engineers an affordable way to use computer vision. 

“When I was in school I remember I did some robotics and had to beg my advisor for $25,000 to get a computer vision system. That was considered the going rate for something that would give you the computation power of Pixy. What Pixy can do is pretty basic. If you want to detect a specific object like a charging station or chase after a ball, it can do that kind of thing."

The idea behind Pixy was to provide and affordable computer vision technology for hobbyists, researchers and engineers doing robotics. The project started in 2009 and is on its fifth version. It is 10 times more powerful than its first version and about a quarter of the price (currently $59 on Kickstarter, but the first backers got it for $39).

Watch their video demo below (warning: it starts slow but finishes strong):

Possible Applications

Pixy was built to interface with other devices:

“There are a lot of other ideas for things like bar code readers or QR code readers. It has a usb port so it could be used as a pointing device, but people are mostly asking if Pixy will work with specific algorithms so it's hard to tell what the application is,” he said. “One out of 10 emails asks if we can do face detection ... so we’re committed to providing that down the road (using the Viola-Jones algorithm [link no longer available]).” 

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Could it be used for security applications? Possibly. But Charm's founder did not speculate on those applications. He said the main focus was to develop the technology and make it open source to the people couple apply them to all sorts of applications.  

“If you want to engineer a low cost camera like this, and be able to get frames out of the sensor, and do it cheaply, that’s been a hard problem. I think that people are responding to the fact that we have solved this hard problem and this is something they can use to leverage technology that's already been figured out.”

How it works

Pixy can detect hues and saturation, using an algorithm to assign unique color signatures to different hues. It stores those signatures in flash memory and uses them to process future images. 

It does not detect objects, but can detect colors and report its findings based on assigned values given to those colors or color combinations. This image show it detecting various colors:

However, the labelling is misleading because it does not know that an object is a ball or a box or a car, etc. Pixy cannot detect people or objects. User defined labels are added, matching colors to objects (e.g., red = ball, blue = box).

“You just press down on the button and hold down the object in front of it and it ‘learns’ the object you’re interested in,” LeGrand said. Pixy can store signatures for seven different colors and can detect hundred of objects within those signatures simultaneously.

Capability and Limitations

Detection Range

 “There’s not really a set distance. It has more to do with how much of the field of view it occupies,” said LeGrand. “Depending on the focal length of the lens, it could be a really small object.” The version of Pixy on the Kickstarter has a 2.75 mm lens and has a 75 degree field of view. 

Pixy processes information coming in from a 640X400 frame. As long an object takes up at least 4x4 pixels, Pixy can detect its color information.

Low Light

Charmed admitted that “You need plenty of light to get a good image. The sensor is a quarter inch sensor. So it’s not tiny, but not big either, but it’s pretty sensitive. What we rely on though is that you can train it. If you went from outside to a fluorescent lit environment, it might effect Pixy’s ability to identify that object, but since it’s easy to re-teach, it helps with that issue.”

Dark Colors

The technology does best with colors that have strong color signatures so browns and black are more difficult to detect, LeGrand said. “It’s more possible with brown because there is some hue in there, but it’s best to use an object that has a decent color signature.”

Potential Surveillance Applications 

While Pixy makes a neat demo and offers quite low pricing, given its limited intelligence (only making out certain colors and in well lit conditions), it is difficult to imagine mainstream surveillance use cases. 

Tech Specs:

  • Processor: NXP  LPC4330, 204 MHz, dual core
  • Image sensor: Omnivision OV9715, 1/4", 1280x800
  • Lens field-of-view: 75 degrees horizontal, 47 degrees vertical
  • Lens type: standard M12 (several different types available)
  • Power consumption: 140 mA typical
  • Power input: USB input (5V) or unregulated input (6V to 10V)
  • RAM: 264K bytes
  • Flash: 1M bytes
  • Available data outputs: UART serial, SPI, I2C, USB, digital, analog
  • Dimensions: 2.1" x 1.75" x 1.4"

1 report cite this report:

The New Generation of Crowdfunded Security Startups on Sep 02, 2014
New entrants to the security market are few and far between. However, there is one area that is clearly driving new security startups -...
Comments (4) : Members only. Login. or Join.

Related Reports

Leica Launches LIDAR / Thermal / IP Camera on Mar 04, 2020
Swiss manufacturer Leica is launching what it calls a "real-time reality capture device" fusing LIDAR, thermal cameras, IP cameras and more. In...
Wyze Massive Data Leak on Dec 26, 2019
Wyze has exposed millions of user's data, as reported by Twelve Security, and confirmed by IPVM, who has spoken with Twelve Security and reviewed...
IPVM Opens 12,000 Sqft Testing Facility on Dec 16, 2019
IPVM is proud to announce the opening of the world's first video surveillance testing facility that will allow us to significantly expand our...
Ultinous European Analytics Startup Company Profile on Dec 04, 2019
European analytics-startup Ultinous pitches customers to "Have your own video analysis service!" We spoke to Ultinous to better understand their...
XNOR.ai Terminates Wyze on Nov 27, 2019
Wyze has shocked the industry again - this time with a major setback. Just months ago, Wyze triumphantly added AI analytics to their ~$20 cameras,...
Wyze Fires Back at JCI - Your Patents Are Invalid, Pay All Of Our Costs on Nov 18, 2019
Goliath JCI targeted startup Wyze this summer alleging the fast-growing consumer startup was violating a slew of JCI's patents. Now, Wyze has...
JCI Sues Wyze on Aug 21, 2019
The mega manufacturer / integrator JCI has sued the fast-growing $20 camera Seattle startup Wyze. Inside this note: Share the court...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
Facial Recognition Systems Fail Simple Liveness Detection Test on May 17, 2019
Facial recognition is being widely promoted as a solution to physical access control but we were able to simply spoof 3 systems because they had no...
How China's Pay By Facial Recognition Works on Apr 02, 2019
Many social media posts have variously celebrated or warned about the growing use of facial recognition for payments in China. An example of one...

Most Recent Industry Reports

Wyze Raises $10 Million And Seeks Services Expansion on May 27, 2020
Wyze has raised $10 million, the company's first disclosed raise since the $20 million announced at the beginning of 2019. Inside this note,...
Startup Videoloft Presents Cloud Storage on May 27, 2020
Videoloft presented offsite cloud storage at the May 2020 IPVM Startups show. A 30-minute video from Videoloft including IPVM...
Directory of 250+ Fever Camera News Reports Globally on May 27, 2020
This global directory tracks 250+ articles about thermal cameras used to detect fevers in response to the coronavirus pandemic. Articles are...
Integrators Rising Against Coronavirus on May 27, 2020
IPVM integrator statistics make it clear - Coronavirus's impact on business is lessening and many are anticipating even better news in weeks...
Netposa Stock Surges 46% After US Human Rights Abuse Sanctions on May 27, 2020
Last Friday, the US government announced it would sanction PRC video management provider NetPosa for being "complicit in human rights violations...
LILIN Presents NDAA-Compliant P2 Cameras on May 26, 2020
Merit LILIN presented its NDAA-compliant P2 camera series at the April 2020 IPVM New Products show. Inside this report: A 30-minute video...
ZKTeco Body Temperature and Mask Detection Reader Tested on May 26, 2020
While dedicated fever cameras emerged first, now tablet/kiosk fever detectors are ramping up. China's ZKTeco has been aggressively promoting such...
IDIS Presents 12MP IR Panoramic Fisheye on May 26, 2020
IDIS presented its 12MP IR panoramic fisheye camera at the April 2020 IPVM New Products show. Inside this report: A 30-minute video from...
FDA Defines Correct Operation of "Fever Cameras" on May 26, 2020
The US FDA has now defined the correct operation of "Thermal Imaging Systems", colloquially known as "fever cameras". Many in video...
OnSSI Founders Return, Start Corsight on May 25, 2020
The OnSSI founders are back, less than 2 years after selling OnSSI to Qognify, they have returned to Corsight, a spin-out of an Israeli AI...