Best New Product Awards Investigated

By: John Honovich, Published on Apr 03, 2012

The ISC best new product awards use a secretive process that lacks transparency, making it impossible to understand the rationale, fairness or accuracy of the awards. Equally troubling, SIA, the organization behind this program, chose a Pixim marketing manager to chair a committee bestowing awards on multiple Pixim customers at ISC West, raising conflict of interest concerns. SIA should make major changes to improve their program's legitimacy.

No Transparency

These awards suffer from a lack of transparency. Decisions are made in secret. No one publicly ever learns why one product won over another. SIA simply releases a long list of winners with hardly any details about why or how a decision was made. Even if nothing 'sinister' occurs, this encourages sloppiness or favoritism as no one can question, debate or check decisions.

Judges Barred

Amazingly, SIA's "code of ethics" [link no longer available] enforces severe restrictions on judges. Specifically:

  • "Support the program by refraining from any public criticism of it."
  • "Keep all conversations about a specific product or service confidential."

North Korea has nothing on these policies. How does it support the program to bar judges from publicly ever saying anything negative about it? What if there are legitimate ethical or procedural problems in the judging that SIA will not address? How will these ever be overcome?

Questionable Awards

Each year, people across the industry question these awards. This year a few stand out in particular on the video side:

  • Best Video Surveillance Wireless: A transcoder service won (Ocularis X). This does not even fit into SIA's own definition [link no longer available] - "video security system components that operate via wireless protocols."
  • Best Analytics: A 4 channel analytic encoder won (VideoIQ Rialto). How is this new or innovative in 2012? I, of all people, recognize the lack of innovation in this segment but to give an award for such a mundane product advancement takes away the value of awards.
  • Best SD camera and Judge's Choice: Both awards went to Pixim powered cameras. We detail our concerns below.

Maybe the committee is 'right', or has insights and information the rest of us lack. Or maybe they screwed up or simply misunderstood certain products. Unfortunately, we will never know because these questionable awards are chosen in secrecy.

Pixim Background

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

The Pixim awards are especially strange.

Both award winning Pixim powered cameras cite Pixim as their core differentiator in their award submissions [link no longer available]:

  • Interlogix claims: "The UltraView XP4 Series of analog cameras offer a one-size-fits all solution that combines industry leading wide dynamic range and extreme low light performance in one package. These box and outdoor-rated rugged domes utilize a customized Pixim Seawolf platform."
  • TKH affirms: "The Siqura BC620WDR is a network box camera that provides superior performance and wide dynamic range under all lighting conditions. This is possible through its distinctive image sensor, which uses adjustable shutter speeds for each individual pixel."

Not only did both products win awards, the TKH camera won the 'Judge's Choice' award for the second best overall product in the entire show - out of 60+ entries.

The only public rationale offered by SIA for the TKH camera's award is that the "camera provides superior performance and wide dynamic range under all lighting conditions." That is a description of the Pixim chipset, returning us to the troubling condition of a Pixim chaired committee issuing an award to a product because it uses Pixim even though dozens of products use the same Pixim solution.

Pixim Response

Pixim offered the following response: “Although a Pixim employee, Jennifer Martin works in a volunteer marketing and press-interface role that has zero impact on award results, does not view the presentations, does not vote, and has no idea of the voting outcome in advance.”

Awarding Pixim Powered Cameras

We see three technical issues in awarding Pixim powered cameras:

  • Not New: The Pixim Seawolf series was released 2 years ago (in 2010 [link no longer available]).  These awards are supposed to be for new products. Considering the Pixim Seawolf series itself at last year's awards would have been far more appropriate.
  • Widely Available: This series is now widely used in dozens of cameras [link no longer available], mostly second or third tier brands that cannot afford to develop their own technology. These awards are supposed to be for novel products, not technology that is available in dozens of manufacturer's existing lines.
  • Not Cutting Edge: Compared to today's leading MP WDR cameras, Pixim Seawolf is neither cutting edge nor tops in performance. We have tested a Pixim Seawolf powered camera. While the results showed improved performance against Pixim's previous generation model, overall Pixim Seawolf was nowhere near competitive to top Megapixel WDR cameras. This performance deficiency has only increased as large vendors such as Axis (Q1604) and Pelco (Surevision) have released advanced MP WDR cameras. Indeed, Axis Lightfinder, another entrant, lost to multiple Pixim cameras. This is shocking considering how significant an advance this is in low light imagining (see our Q1602 and Q1604 test results).

[Update: The Interlogix Pixim based camera (XP4) is not yet shipping, according to Interlogix customer service. The product should therefore not be eligible for an award, according to SIA's own policies [link no longer available].]

What To Do

1 report cite this report:

Ocularis 3.0 Reviewed on May 09, 2012
Hot on the heels of making a splash at this year's ISC West with an 'award' winning new product announcement, OnSSI surprised many this week by...

Related Reports

Dahua and Hikvision Products Illegally Sold To US Government GSA on May 06, 2019
Dahua and Hikvision products are being widely and illegally sold to the US government GSA. The sellers are falsely claiming these China products to...
Favorite Power Supply Manufacturer 2018 on Sep 28, 2018
While power supplies are becoming less important as PoE matures, they remain vital to access control systems, where increased power for locks,...
Inside Look Into Scam Market Research on May 17, 2019
Scam market research has exploded over the last few years becoming the most commonly cited 'statistics' for most industries, despite there clearly...
The Embarrassing Story of ISC West's Best New IP Camera on Apr 24, 2019
A sad but simple situation: Only 2 companies paid SIA the thousands of dollars required to compete for the best new 'cameras IP' The judges...
Beware Of Feevr on Apr 14, 2020
Beware of "Feevr". The company is marketing a 'Feevr' solution that fundamentally lacks accuracy for its use, as its thermal provider FLIR has said...
UK Installer CCTV Aware - Flat Pricing, No Salespeople on Apr 10, 2019
This is a different kind of company. They do flat pricing, they do not have any salespeople and 50% of their sales are sold and booked...
In China, Foreign AI Companies Banned or Disadvantaged, Says Top China AI Company on Aug 28, 2019
Non-China (PRC) companies are prejudiced and unfairly targeted inside of the PRC's booming AI market, which not only denies them revenue inside of...
Briefcam Buys Frost Award* on Jun 20, 2019
Frost 'awards' are well-known and widely disrespected. Now Briefcam is touting their win. The way it has worked for many years is that Frost...
19 Facial Recognition Providers Profiled on Apr 23, 2019
IPVM interviewed 19 facial recognition providers at ISC West to understand their claimed accuracy, success and positioning. 9 from China, where...
The Cowardly, Greedy "Leaders" of Video Surveillance - SIA on Nov 19, 2019
The video surveillance industry suffers from cowardly, greedy 'leaders' focused on maximizing easy money while undermining public trust. The...

Most Recent Industry Reports

Startup Duranc Presents AI VSaaS on Jul 06, 2020
Duranc presented its system at the May 2020 IPVM Startups show. A 30-minute video from Duranc including IPVM Q&A Background on the...
Low Voltage Nation Wants to "Help You Carve Out A Fulfilling Career" Interviewed on Jul 06, 2020
It is difficult to make your way in this industry as there is little formal schooling. However, one person, Blake Urmos, the Founder of Low Voltage...
The Next Hot Fever Detection Trend - $100 Wall-Mounted Units on Jul 06, 2020
The first wave of the booming fever detecting market was $10,000+ cameras, now interest for ~$2,000 tablets is high and the next big thing may be...
Cisco Meraki Unlocks IP Cameras With RTSP Tested on Jul 06, 2020
Meraki opened up its cameras to 3rd party NVRs/VMSes by offering RTSP streaming because of "the need to solve a business problem". We tested...
Verkada: "IPVM Should Never Be Your Source of News" on Jul 02, 2020
Verkada was unhappy with IPVM's recent coverage declaring that reading IPVM is 'not a good look' and that 'IPVM should never be your source of...
Vintra Presents FulcrumAI Face Recognition on Jul 02, 2020
Vintra presented its FulcrumAI face recognition and mask detection offering at the May 2020 IPVM Startups show. Inside this report: A...
Uniview Wrist Temperature Reader Tested on Jul 02, 2020
Uniview is promoting measuring wrist temperatures whereas most others are just offering forehead or inner canthus measurements. But how well does...
Dahua USA Admits Thermal Solutions "Qualify As Medical Devices" on Jul 02, 2020
Dahua USA has issued a press release admitting a controversial point in the industry but an obvious one to the US FDA, that the thermal temperature...
Access Control Online Show - July 2020 - With 40+ Manufacturers - Register Now on Jul 01, 2020
IPVM is excited to announce our July 2020 Access Control Show. With 40+ companies presenting across 4 days, this is a unique opportunity to hear...