Best New Product Awards Investigated

Author: John Honovich, Published on Apr 03, 2012

The ISC best new product awards use a secretive process that lacks transparency, making it impossible to understand the rationale, fairness or accuracy of the awards. Equally troubling, SIA, the organization behind this program, chose a Pixim marketing manager to chair a committee bestowing awards on multiple Pixim customers at ISC West, raising conflict of interest concerns. SIA should make major changes to improve their program's legitimacy.

No Transparency

These awards suffer from a lack of transparency. Decisions are made in secret. No one publicly ever learns why one product won over another. SIA simply releases a long list of winners with hardly any details about why or how a decision was made. Even if nothing 'sinister' occurs, this encourages sloppiness or favoritism as no one can question, debate or check decisions.

Judges Barred

Amazingly, SIA's "code of ethics" enforces severe restrictions on judges. Specifically:

  • "Support the program by refraining from any public criticism of it."
  • "Keep all conversations about a specific product or service confidential."

North Korea has nothing on these policies. How does it support the program to bar judges from publicly ever saying anything negative about it? What if there are legitimate ethical or procedural problems in the judging that SIA will not address? How will these ever be overcome?

Questionable Awards

Each year, people across the industry question these awards. This year a few stand out in particular on the video side:

  • Best Video Surveillance Wireless: A transcoder service won (Ocularis X). This does not even fit into SIA's own definition - "video security system components that operate via wireless protocols."
  • Best Analytics: A 4 channel analytic encoder won (VideoIQ Rialto). How is this new or innovative in 2012? I, of all people, recognize the lack of innovation in this segment but to give an award for such a mundane product advancement takes away the value of awards.
  • Best SD camera and Judge's Choice: Both awards went to Pixim powered cameras. We detail our concerns below.

Maybe the committee is 'right', or has insights and information the rest of us lack. Or maybe they screwed up or simply misunderstood certain products. Unfortunately, we will never know because these questionable awards are chosen in secrecy.

Pixim Background

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

The Pixim awards are especially strange.

Both award winning Pixim powered cameras cite Pixim as their core differentiator in their award submissions:

  • Interlogix claims: "The UltraView XP4 Series of analog cameras offer a one-size-fits all solution that combines industry leading wide dynamic range and extreme low light performance in one package. These box and outdoor-rated rugged domes utilize a customized Pixim Seawolf platform."
  • TKH affirms: "The Siqura BC620WDR is a network box camera that provides superior performance and wide dynamic range under all lighting conditions. This is possible through its distinctive image sensor, which uses adjustable shutter speeds for each individual pixel."

Not only did both products win awards, the TKH camera won the 'Judge's Choice' award for the second best overall product in the entire show - out of 60+ entries.

The only public rationale offered by SIA for the TKH camera's award is that the "camera provides superior performance and wide dynamic range under all lighting conditions." That is a description of the Pixim chipset, returning us to the troubling condition of a Pixim chaired committee issuing an award to a product because it uses Pixim even though dozens of products use the same Pixim solution.

Pixim Response

Pixim offered the following response: “Although a Pixim employee, Jennifer Martin works in a volunteer marketing and press-interface role that has zero impact on award results, does not view the presentations, does not vote, and has no idea of the voting outcome in advance.”

Awarding Pixim Powered Cameras

We see three technical issues in awarding Pixim powered cameras:

  • Not New: The Pixim Seawolf series was released 2 years ago (in 2010).  These awards are supposed to be for new products. Considering the Pixim Seawolf series itself at last year's awards would have been far more appropriate.
  • Widely Available: This series is now widely used in dozens of cameras, mostly second or third tier brands that cannot afford to develop their own technology. These awards are supposed to be for novel products, not technology that is available in dozens of manufacturer's existing lines.
  • Not Cutting Edge: Compared to today's leading MP WDR cameras, Pixim Seawolf is neither cutting edge nor tops in performance. We have tested a Pixim Seawolf powered camera. While the results showed improved performance against Pixim's previous generation model, overall Pixim Seawolf was nowhere near competitive to top Megapixel WDR cameras. This performance deficiency has only increased as large vendors such as Axis (Q1604) and Pelco (Surevision) have released advanced MP WDR cameras. Indeed, Axis Lightfinder, another entrant, lost to multiple Pixim cameras. This is shocking considering how significant an advance this is in low light imagining (see our Q1602 and Q1604 test results).

[Update: The Interlogix Pixim based camera (XP4) is not yet shipping, according to Interlogix customer service. The product should therefore not be eligible for an award, according to SIA's own policies.]

What To Do

The combination of no transparency and awards to multiple customers of the committee chair is problematic. A simple, but incomplete step would be to no longer have a committee chairperson who works for a manufacturer (whether it is a product or component one). The more important, yet tougher one, is for SIA to open up about how they judged products and why certain products won or lost. Not only would this improve transparency, it would help the community better understand which products to use or avoid.

1 report cite this report:

Ocularis 3.0 Reviewed on May 09, 2012
Hot on the heels of making a splash at this year's ISC West with an 'award' winning new product announcement, OnSSI surprised many this week by...

Related Reports

GDPR / ICO Complaint Filed Against IFSEC Show Facial Recognition on Jun 20, 2018
IPVM has filed a complaint against IFSEC’s parent company UBM based on our concern that the conference violates core GDPR principles on...
IFSEC Show Report Day 2 Report on Jun 20, 2018
IPVM is live from London reporting on the IFSEC show. The Chinese have taken over the UK, centered on Hikvision, flanked by Dahua, Huawei and a...
Mobotix Releases 'Move' Into 21st Century on Jun 20, 2018
For years, Mobotix stood resolutely against, well, every other manufacturer, selling it as a virtue: MOBOTIX equipment is designed with no...
Introducing Effective PPF (ePPF) - Improving Video Surveillance Designs on Jun 11, 2018
Pixel density (PPF / PPM) is the best metric the industry has to define and project video quality. It allows simple communication of estimated...
Hanwha Low-Cost 4MP Camera Tested (QNV-7010R) on Jun 11, 2018
4MP usage is increasing noticeably, as IPVM 2018 resolution statistics show. And low-cost, fixed focal cameras, are popular for budget...
Stats: Upgrading Cameras Far More Common Than Replacing Failed Cameras on May 30, 2018
The old saying "If It Ain't Broke, Don't Fix It" does not apply here. New IPVM statistics show that 60% of cameras that are replaced still work but...
Top Benefits Of Attending Trade Shows (Statistics) on May 15, 2018
150 integrators told IPVM: What are the top benefits of going to trade shows? The clear top 2 responses in order: (1) Networking (2) New...
Nortek Acquires IntelliVision on May 08, 2018
One of the largest intrusion manufacturers, Nortek, has acquired the self-proclaimed 'Leader in AI-Based Video Analytics Software',...
Last Chance - May 2018 Camera Course on May 03, 2018
This is the last chance to register as the course starts next week. This is the only independent surveillance camera course, based on in-depth...
'Best In Show' Fails on Apr 19, 2018
ISC West's "Best In Show" has failed. For more than a decade, it has become increasingly irrelevant as the selections exhibit a cartoon level...

Most Recent Industry Reports

IFSEC Show Report Day 2 Report on Jun 20, 2018
IPVM is live from London reporting on the IFSEC show. The Chinese have taken over the UK, centered on Hikvision, flanked by Dahua, Huawei and a...
Mobotix Releases 'Move' Into 21st Century on Jun 20, 2018
For years, Mobotix stood resolutely against, well, every other manufacturer, selling it as a virtue: MOBOTIX equipment is designed with no...
Cybersecurity Startup VDOO Disclosing 10 Manufacturer Vulnerabilities Starting With Axis And Foscam on Jun 20, 2018
Cybersecurity startup VDOO has uncovered significant vulnerabilities in Axis cameras along with many others not yet disclosed. In this report, we...
July 2018 IP Networking Course on Jun 19, 2018
The last chance to save $50 on registration is this Thursday, June 21st. Register now and save. This is the only networking course designed...
Axis Guardian - Cloud VMS And Alarm Monitoring - Released on Jun 19, 2018
Axis has struggled to deliver a cloud-based managed service video platform. Video service providers have utilized AVHS for over a decade, and have...
IPVM Vulnerability Scanner Released on Jun 18, 2018
IPVM is proud to announce video surveillance's first and only cybersecurity vulnerability scanner. This tool allows quickly and simply...
Hikvision Corrects False Cybersecurity Announcement on Jun 18, 2018
Hikvision has corrected a false cybersecurity announcement that claimed a British government-sponsored program endorsed the cybersecurity of...
The Dumb Ones: PSA's Bozeman On Cybersecurity on Jun 15, 2018
The smart ones are the hundred people who flew to Denver and spent $500+ on a 1.5-day conference featuring Dahua as a 'cyber responsible partner',...
Amazon Ring Launches $10 Monthly Professional Alarm Monitoring on Jun 15, 2018
Amazon's Ring has announced an alarm system with 24/7 professional alarm monitoring for $10 per month, a fraction of the $30+ per month traditional...
Axis Releases First New Access Controller In 5 Years (A1601) on Jun 15, 2018
It has been 5 years since Axis 2013 entry in the physical access control market, with the A1001 (IPVM test). Now, Axis has released its second...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact