240 MP DHS Panoramic Camera (ISIS)

By: Carlton Purvis, Published on May 08, 2013

The US Department of Homeland Security is developing a 240MP 8fps 'super' camera. We spoke with them in depth and prepared the following report on key technical, operational and pricing details:

One of the main problems of tracking suspects with PTZs is that once operators “zoom in on a specific point of interest, they lose visual contact with the rest of the scene,” an issue the Department of Homeland Security Science and Technology Directorate (DHS S&T) finds problematic. Indeed, this is a core issue in choosing between PTZs and panoramic cameras. While the latter maintains 'visual contact', it is with incredibly low detail (see our panoramic test results). 

With this in mind, and after talking to law enforcement, airport security directors and field agents, DHS S&T set out to develop a new camera system to provide a complete 360 degree view  with incredibly high detail. Named ISIS, (the Imaging System for Immersive Surveillance) the new system is comprised of (48) 5MP imagers and software that produce a single image of a complete scene. The system was developed at MIT Lincoln Laboratory under DHS S&T sponsorship.

For this note, we reviewed the patent for ISIS and spoke with Dr. John Fortune of of S&T’s Infrastructure and Geophysical Division [link no longer available]. 

Inception

DHS S&T has been working on the ISIS project for around five years. The idea for ISIS came from talks between DHS and local law enforcement, aviation security directors and DHS field agents. “The first question we asked is ‘What are you not seeing in a novel surveillance system?’ and one of the things that kept coming up was multi-camera coverage of a scene,” Fortune said. “We came up with a single system that would give you high-resolution detail everywhere in real time, but would also be stored in a data-friendly compressed format so that it could be archived and produced later for forensic searches.”

The images below show the first and second generation units:

Here is a view of the current generation mounted in the field (note: Mounting a 360 degree view camera on the corner of a building wastes ~90% of the FoV, an equivalent of 60MPs for this system).

 

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

The first prototype was compromised of nine 11 MP outward facing cameras arranged in a rounded housing. Initially there were issues stitching the images together because of uneven overlap of the images. DHS says this problem was fixed in the first generation system which is currently part of a pilot project at Logan International Airport. The second generation system was tested outdoors on street scenes and is more of a cylinder shape. The third generation of ISIS will have upgraded sensors and software improvements based on the results of these pilots. 

Application

Fortune says ideal deployments for ISIS would be in large spaces with lots of activity, like airports, stadiums and even Times Square.  However, ISIS was not made to replace cameras, but to “supplement them in appropriate areas,” Fortune says.  

Researchers we spoke to say ISIS can "provide centimeter class resolution (approximately 1.2 cm) everywhere within a radius of 100 meters from the sensor, for a total 240 million pixels at 8 frames per second." Additionally, they say ISIS can produce clear facial details of anyone within 100 meters. We are waiting to hear back on what level DHS uses as its threshold for facial identification

Design and Specs

ISIS is comprised of 48 lenses offset in rows at various focal lengths, according to DHS S&T. It uses a combination of shorter and longer focal length lenses to keep the resolution constant across the space the cameras are viewing: 25mm lenses, 9.6 mm lenses (scene coverage from 20 to 50 meters), and a wide angle downward -pointed 1.3 mm lens OR a 2.5 mm lens (scene coverage from 0-10 meters), according to patent information. This approach is somewhat similar to Dallmeier 's Panomera though ISIS is focusing on a wider FoV.

Key tech specs include:

  • 240MP total (48 x 5MP imagers)
  • The maximum frame rate at full resolution is specified as 8fps.
  • The codec used is JPEG2000 enabling virtal P/T/Z of the scene, decoding only subsections of the entire panoramic view.
  • Storage is estimated at ~10TB/day for 4fps.

User Interface

The screenshot below overviews the controls and display for the prototype camera:

Low Light 

DHS does not recommend this for use in low light situations. We would expect, given the high pixel count (5MP), high F stop (2.0) and relatively small size of each imager, that its low light performance would be poor.

Video Analytics

“The system has been primarily been a hardware development exercise and software has focused on supporting data processing and compression. We haven’t gotten really deep into what we can do in the video analytic space, but we do have some standard video analytic features like automated tracking, exclusions zones, and filtering out backgrounds,” Fortune said. DHS S&T is looking for a way to make its “track and follow” feature more effective in dense crowds and lines. For example, if someone is standing behind someone in a line for a period of time, that could throw the tracking off, Fortune said.

Integration

ISIS has not been integrated with any commercial systems (such as VMS or PSIM).

Housing

The housing for the prototype at Logan Airport was created using 3D printing, but is not weatherproof. ISIS was created as an indoor system, but end users have expressed interest in outdoor versions. For example, ISIS was tested outdoors by request of an undisclosed agency and in Boston in 2011. The second generation sensor successfully operated outdoors for several months, and future generation sensors will be weatherproof, says DHS.  

Availability and Price

ISIS is not commercially available today. Moreover, DHS is looking for a commercial entity to contract manufacturer the unit.

DHS S&T recently issued a request for information to the surveillance industry to get feedback on what it’s going to cost. “We have a cost in mind, but it’s going to be hard to predict the finalized cost,” Fortune said. “We’d like to be in the $50,000 to $150,000 range but that’s a big range ... It’s going to be something that is competitive with the more advanced systems out there right now that people are using to cover large areas.”

Says Fortune,"DHS S&T is developing the technology [for use in airports and critical infrastructure facilities] but the decision to purchase and install will be made by end users."

Outlook

This is an ambitious project that, if delivered in the next few years, would likely far surpass anything commercially available for its combination of super high resolution and relatively fast frame rate. That noted, DHS is obviously still fairly far from releasing a generally available production unit. While this is definitely worth tracking, only time will tell if they can deliver on this.

 

Comments (1) : Members only. Login. or Join.

Related Reports

Video Analytics 101 on Mar 16, 2020
This guide teaches the fundamentals of video surveillance...
Tiandy Super Starlight Cameras Tested on Apr 30, 2020
Tiandy is taking aim at China competitors Dahua and Hikvision, with a new...
TVT / InVid White Light Camera Tested Vs Hikvision ColorVu on Mar 18, 2020
With mega China manufacturers Dahua and Hikvision facing both bans and human...
Video Surveillance Cameras 101 on Feb 25, 2020
Cameras come in many shapes, sizes and specifications. This 101 examines the...
Hikvision Fever Screening Thermal Solutions Examined on Apr 13, 2020
Hikvision is marketing "safer, faster, smarter" with their Fever Screening...
Cheap Camera Problems at Night on Feb 19, 2020
Cheap cameras generally have problems at night, despite the common perception...
IR Surveillance Camera Guide on Feb 06, 2020
Integrated infrared (IR) cameras are everywhere in 2020, but not all IR is...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Integrated IR Camera Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Uniview, Vivotek on Jan 30, 2020
The best and worst cameras tested in this IPVM shootout showed major...
Hikvision Global News Reports Directory on Jun 18, 2020
Hikvision has received the most global news reporting of any video...
Converged vs Dedicated Networks For Surveillance Tutorial on Feb 12, 2020
Use the existing network or deploy a new one? This is a critical choice in...
Hanwha Presents AI Analytics and First 8K Camera on May 11, 2020
Hanwha presented their AI Analytics and the "Industry's First 8K" camera at...
Directory of 201 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Remote Network Access for Video Surveillance Guide on Jul 27, 2020
Remotely accessing surveillance systems is key in 2020, with more and more...
Video Surveillance History on May 06, 2020
The video surveillance market has changed significantly since 2000, going...

Recent Reports

SIA Coaches Sellers on NDAA 889B Blacklist Workarounds on Aug 05, 2020
Last month SIA demanded that NDAA 899B "must be delayed". Now that they have...
ADI Returns To Growth, Back To 'Pre-COVID Levels' on Aug 05, 2020
While ADI was hit hard in April, with revenue declining 21%, the company's...
Exposing Fever Tablet Suppliers and 40+ Relabelers on Aug 05, 2020
IPVM has found 40+ USA and EU companies relabeling fever tablets designed,...
Indian Government Restricts PRC Manufacturers From Public Projects on Aug 04, 2020
In a move that mirrors the U.S. government’s ban on Dahua and Hikvision...
Directory of 200 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Face Masks Increase Face Recognition Errors Says NIST on Aug 04, 2020
COVID-19 has led to widespread facemask use, which as IPVM testing has shown...
Dahua Loses Australian Medical Device Approval on Aug 04, 2020
Dahua has cancelled its medical device registration after "discussions" with...
Google Invests in ADT, ADT Stock Soars on Aug 03, 2020
Google has announced a $450 million investment in the Florida-based security...
US Startup Fever Inspect Examined on Aug 03, 2020
Undoubtedly late to fever cameras, this US company, Fever Inspect, led by a...
Motorola Solutions Acquires Pelco on Aug 03, 2020
Motorola Solutions has acquired Pelco, pledging to bring blue back and make...
False: Verkada: "If You Want To Remote View Your Cameras You Need To Punch Holes In Your Firewall" on Jul 31, 2020
Verkada falsely declared to “3,000+ customers”, “300 school districts”, and...
US GSA Explains NDAA 889 Part B Blacklisting on Jul 31, 2020
With the 'Blacklist Clause' going into effect August 13 that bans the US...
Access Control Online Show July 2020 - On-Demand Recording of 45+ Manufacturers Presentations on Jul 30, 2020
The show featured 48 Access Control presentations, all now recorded and...
Face Detection Shootout - Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jul 30, 2020
Face detection analytics are available from a number of manufactures...
Sunell is The First China Manufacturer to Market NDAA Compliance on Jul 30, 2020
Most China manufacturers are going to be impacted by the NDAA 'Blacklist...