The Challenge
Surveillance of large areas has historically been achieved by using an array of sensors connected to a bank of monitors, with separate or multiplexed displays for each video stream. Such arrangements present the operator with a confusing array of disparate video feeds, require a great deal of space and consume a large amount of power. In a dynamic, real-time scenario, there is also a danger of information overload for an operator attempting to consume and interpret such large volumes of imagery. Also, the inter-relationships between sensors is not always obvious so important contextual visual information can be easily over looked. Many such systems rely on the operator for 'event' detection. The presentation of large volumes of information coupled to the effects of stress and fatigue make significantly reduce operator effectiveness.
The Solution
Our image processing subsystem overcomes these issues and greatly improves the performance of surveillance assets and their operators. We offer a previously unattainable level of situational awareness to platforms such as armored vehicles, aircraft, remote unmanned platforms and security & surveillance systems.
Situational Awareness Systems Offer:
- Instantaneous access to 360º high resolution real time panoramic video imagery from up to sixteen individual cameras
- Operates with a wide range of different physical sensor positions and orientations.
- Operator-friendly and intuitive user interface with a virtual camera
- Virtual camera can be panned or zoomed instantaneously via joystick and touch screen interfaces with none of the limitations due to moving a physical camera
- Video panorama has a typical horizontal resolution of around 7000 pixels which is far above the resolution offered by fish-eye lens systems.
- Panoramic display preserves intuitive spatial relationships
- Real time monitoring of area much larger than is possible with a single sensor
- Automatic moving target detection and metadata tagging in video stream over a 360º field of view
- Single display device required for multiple input streams, saving space & power
- Images are aligned without distortion, so that, for example, straight lines in the real world appear straight on the final image display.
- Simple calibration and alignment algorithms.
- Can operate with imagers covering any available waveband.
- Can be augmented with a cued or independent high resolution steer-able sensor
- Real time image fusion between visible and infrared cameras
The solution can be divided into two functionalities 'Data Extraction' (the detection of events) and Visualization (the presentation of the multiple video images and information from the data extraction process).
Data Extraction
The system's data extraction process builds on the techniques employed by the successful range detection and tracking modules produced by Octec for over 15 years. The modes of 'detection' employed are chosen from the following elements dependent upon the precise application of the system:
- Scene change detection
- Moving target detection
- Contrast detection
In addition a 'classification' process is employed in order to determine detection contact type. The degree of classification is dependent upon operating scenario, sensors employed and system elements.
Having 'detected' and 'classified' a contact can indicate this to the operator in a number of ways depending upon system set-up and contact classification (see visualization).
Visualization
The visualization process provides an optimized solution for local situational awareness by seamlessly merging the video signals from multiple sensors into a real-time interactive panoramic image which can be displayed on a single monitor.
The operator is able to interact with the panoramic image through a range of interface options including touch screen, joystick and game controller. These devices facilitate scrolling through the panorama and zooming in and out on selected images through a technique known as 'virtual camera'. Used in this way the panorama is very intuitive to use and interpret. The panorama can also be integrated with a head-mounted display to form a "virtual control room" effect.
Visualization Display
The display output format can be adapted to provide custom layouts to meet specific applications. for individual problems and scenarios depending on customer requirements.
It has been designed to offer an intuitive user interface with a natural looking seamless and undistorted perspective when seen by the virtual camera.
Images from individual cameras may be fed to picture in picture inserts which may be enlarged to full screen and reduced in size again by simply touching the on screen image.
Visualization Display of Data Extracted "Contact"
A typical 'contact' display includes:
- A graphic symbol is inserted around the contact
- A graphic symbol is flashed to the operator indicating the direction to slew the virtual camera
- An audible alarm is generated
- The current image of the contact is shown in a picture in picture window
- The virtual camera is automatically slewed to the contact
- A recorded image of the contact is displayed in one of the supplementary windows (see image recording)
User Interface
Touch screen controls allow the user full control over the azimuth, elevation and zoom of the virtual camera. The system may also be simultaneously controlled by joystick, keyboard and mouse or game-pad style controllers.
Integration with Pan and Tilt Mounted Sensors
The visualization process provides an optimized solution for local situational awareness by seamlessly merging the video signals from multiple sensors into a real-time interactive panoramic image which can be displayed on a single monitor.
The operator is able to interact with the panoramic image through a range of interface options including touch screen, joystick and game controller. These devices facilitate scrolling through the panorama and zooming in and out on selected images through a technique known as 'virtual camera'. Used in this way the panorama is very intuitive to use and interpret. The panorama can also be integrated with a head-mounted display to form a "virtual control room" effect.
System Recording
The system is available with a recording sub-system that will store sensor images. Two types of recording are conducted:
- Data extraction triggered, high resolution images instantly recoverable from a short term loop recording
- Long term, compressed, record oriented recording
System Configurations
Our systems are available in two configurations:
- Designed for fixed security installations and offering an 'industrial' standard of environmental performance.
- Designed for military vehicle and similar applications that require full military, rugged, conduction cooled environmental performance.
Systems Integration
Our system is designed to interface with any 'video' sensor, including thermal imagers. Currently available with analogue video (CCIR/RS170) interfaces in the future the full range of digital video interfaces, including GBIT Ethernet, will be available.
