SOFTWARE FUNCTIONS
Our Video Processing software is the foundation for all
SightLine Applications video processor products. The software library provides
a powerful suite of functions critical to advanced camera systems integrators. Flexible configuration of
functions allow integrators to optimize their system for a wide variety of
Intelligence, Surveillance, and Reconnaissance (ISR), inspection, and other applications.
Software functions are
enabled to run only on the SightLine video processing hardware
VIDEO STABILIZATION
The starting point for all video processing improvements
is our frame to frame registration measurement. Registration provides the information to correct the output video frame to
remove frame to frame motion (vibration) and dramatically improve video.
¡¤
Absolutely critical for camera systems on moving vehicles
(air, ground, sea) and desired zoom < 10 deg FOV
¡¤
Accurate frame to frame change detection and correction
¡¤
Remove camera system jitter (frame to frame movement).
Excellent for high frequency (approaching 30 Hz), lower amplitude noise rejection.
ROLL CORRECTION
Registration also provides ability to correct camera
frame to frame rotation, further improving the user experience.
¡¤
Correction of platform roll motion
¡¤
Important for cameras systems on aerostats, towers, UAS,
and marine vehicles
¡¤
Critical for roll/nod gimbal configurations
¡¤
Provides 3 axis performance in a 2 axis design, saving
complexity, weight, and expense
¡¤
Integrators can feed-forward camera roll commands to
counteract known platform rotation.
SCENE AND OBJECT TRACKING
Robust hands-free tracking of scene and designated
objects. Onboard tracker provides low latency solution needed for nimble
pointing control systems. Tried and tested, our trackers have over one million
flight hours logged. They are highly configurable to meet mission requirements
and include advanced configuration options
¡¤
Scene Tracking: Powerful, intuitive mode to keep the
entire scene in the frame using scene translation telemetry. Works well as a base mode and fallback from object trackers.
¡¤
Vehicle and Stationary Modes: Solid designated tracks on
moving or static objects. Advanced image analysis and motion estimation isolate tracked object from background for
robust tracking even when view of tracked object is temporarily blocked.
¡¤
No Registration Mode: Used to track objects when there
are no background features (for example: trying to track an airplane against a blue sky).
¡¤
Track Box Size, Nudge, Track through Zoom and Rotation:
Operational and setting flexibility for improved tracker performance.
¡¤
Acquisition Assist: Automatically searches the area
around an initial track location to find the optimal track box size and position. Allows operator to just get ¡®close¡¯ and still get
great tracking results.
¡¤
Intelligent Assist: Automatically reinitialize (and
optimize track box location and size) on targets when changes in the target appearance are detected.
¡¤
Detection Track Cueing: Used to transition a detection to
a primary track (example: aerial MTI detection to vehicle object track).
¡¤
To address demand for a lower price-point option,
Tracker-Only options use the same proven tracking algorithms as the full-featured SLA, offered with limitations on other functions.
TELEMETRY DATA
Tracker functions and MTI provide low latency track
location data needed to facilitate gimbal pointing.
¡¤
Telemetry updates at 30 Hz.
¡¤
Sub-pixel accuracy feedback for accurate gimbal pointing.
¡¤
Data is provided from object tracking, scene steering,
and MTI objects for best system performance support.
¡¤
Temperature data from radiometric cameras.
¡¤
Focus telemetry for autofocus implementations.
IP NETWORK AND SYSTEM CONNECTIVITY
¡¤
10/100 Ethernet.
o
UDP, TCP, FTP, SSH, RTP, and RTSP connectivity, unicast,
multicast, broadcast
o
DHCP, LinkLocal, Static IP, and VLAN address
¡¤
Multiple serial ports (3 on 1500, 5 on 3000)
¡¤
Serial pass-through (IP to serial, serial to serial)
¡¤
ARM processors provides for customer ownership serial
ports and GPIO
¡¤
Demonstrated compatibility with IP radio links
¡¤
Demonstrated compatibility with COTS ground station
software products
VIDEO ENCODING AND KLV METADATA
Encoded video Ethernet streaming supports IP radio
options and reduces system bandwidth.
¡¤
MPEG2 TS (H.264 with KLV metadata).
¡¤
MPEG4.
¡¤
RTP M-JPEG.
¡¤
KLV metadata is generated in accordance with MISB
standards 0102.10, 0601.7, 0603.2, 0604.3, and 0903.3.
¡¤
Multiple simultaneous streams +KLV on SLA-3000
¡¤
Controllable tradeoff of video compression frame rate,
and down sampling to meet bandwidth requirements with best possible imagery and
system flexibility.
¡¤
Metadata on VBI lines for KLV over analog links.
DETECTION ALGORITHMS
Multiple detection modes provide important situational
awareness information and provide fast feedback essential for effective track
initialization on moving objects.
¡¤
Detect very small moving targets
¡¤
Simple track selection method – provided detection
telemetry allows automatic track initialization
¡¤
Three MTI modes support a range of applications
¡¤
Color-based (histogram) anomoly detection algorithm helps
find objects that are different than the scene background
¡¤
Radiometric detection finds objects within desired
thermal range
VIDEO / SNAPSHOT RECORDING
Onboard recording on 1500-OEM. Interface board SD card
for 3000.
¡¤
H.264 video to local SD card or remote FTP.
¡¤
Full resolution snapshot recording. JPEG snapshots with
EXIF data.
¡¤
Full pixel depth data .PNG snapshots with metadata (for
radiometric data access).
¡¤
Telemetry data recording.
VIDEO ENHANCEMENT
A range of functions are provided to enable enhancement
options to optimize video for the needs of each application.
¡¤
Contrast Limited Adaptive Histogram Equalization (CLAHE)
and Local Area Processing (LAP).
¡¤
De-Noising of video. Edge sharpening.
¡¤
False color schemes.
¡¤
Extended 14 bit-depth processing.
¡¤
Digital Zoom.
ON SCREEN DISPLAY (OSD)
¡¤
Protocol command OSD support to add text, shapes, and
custom reticle overlays
¡¤
Bench tool to help customers use OSD primitives to build
a custom OSD design.
¡¤
Customer logo placement.
¡¤
On 3000, ARM process support allows full OSD control to
customer to design very complicated OSD implementations
MULTI
CAMERA VIDEO PRESENTATION
Flexible display options for optimized presentation and
transmission and display of multiple video streams.
¡¤
Full screen (switched video)
¡¤
Picture in Picture (selectable PiP window location/size)
– 3000
¡¤
Split screen – 3000
¡¤
Multiple IP Streams – individual camera streams or
combination of above – 3000
¡¤
Image Blending. Multi-spectral inputs can be blended into
a single image with false color to bring out the best of each spectral image – 3000
FOCUS
TELEMETRY
Algorithm calculates a focus metric which has a clear
peak value when the scene is in the best focus.
¡¤
Focus metric is provided as telemetry data for cistomer
autofocus implementations (focus motor control loop to optimize its setting)
¡¤
For some cameras and lenses, SightLine has included a
complete autofocus congtrol loop functionality, providing direct serial lens
control for those devices
CUSTOMER DEVELOPED SCRIPTS
To best support customers ability to combine software
functions to best meet their system performance objectives, SightLine
processors support Lua based scripting functionality. Lua is a lightweight
multi- paradigm programming language designed for embedded systems and
extending software applications to meet the increasing demand for customization. Some examples that could be
implemented using these scripts:
¡¤
After detecting a person in a defined area of a thermal
image, automatically take a snapshot and append vehicle GPS and timestamp data.
¡¤
After the house falls on the witch, call the lollypop
gang
CUSTOMER DEVELOPED ARM APPLICATIONS
Both processors inclued an ARM processor which is very
lightly used by SightLine. It is available to perform customer functions within
their system architecture and allows access to serial ports, GPIO, etc.
SigthLine provides sample code for a number of applications. Uses include:
¡¤
Autopilot interface for landing aid functionality.
¡¤
Gimbal control
¡¤
Protocol translation – system protocol to SightLine and
visa versa
PRECISION LANDING
Video Processing Library – Functions & Videos
The Video Processing Library is the foundation for all SightLine Applications OEM products. The library provides a powerful suite of video functions that are key to a wide variety of Intelligence, Surveillance, and Reconnaissance (ISR) applications.?To the right is an overview video of our growing?library of features. The below table presents each function separately with a corresponding video clip. ?We will be updating all of these videos over the next few weeks.
We are constantly looking to improve and expand our video processing library of features. ?If you have a suggestion or have a specific requirement, we welcome the opportunity to support your project. ?Please feel free to contact us?via our on-line form. We are ready to work with you, so let us know?how we can help.
|
|
|
|
|
|
HD Video
Providing a range of solutions to meet demand for HD video capabilities. OEM board specific.. |
- 1080p/30 processing/encoding with SLA/SLE-3000
- 720p/30 processing/encoding with SLA/SLE-1500
- Adaptors for HD cameras, HDSDI, HDMI, CL, LVDS, etc.
|
|
Video Stabilization
The starting point for all video ISR functions, frame to frame registration provides dramatically improved video. Registration also provides ability to correct camera frame to frame rotation, further improving the user experience. |
- Remove high frequency jitter (frame to frame movement). Excellent for high frequency (approaching 30 Hz) lower amplitude noise rejection.
- For applications where correction of platform roll motion is desired (aerostats, towers, UAS).
- Where gimbal roll/nod configurations are used.
- Integrators can feed video roll commands to counteract known platform rotation.
|
Stabilization
Roll Correction |
Scene and Object Tracking
Robust hands-free tracking of scene and designated objects. Onboard tracker provides low latency solution needed for nimble pointing control systems. |
- Scene tracking provides a powerful, intuitive gimbal feedback based on the entire scene.
- Advanced image analysis and motion estimation isolate tracked object from background for robust tracks.
- Persistent tracking when view of tracked object is temporarily blocked.
- Tracker Assist and Auto Re-initialization help with robust tracking.
|
Track Through |
Telemetry Data
Tracker functions and MTI provide low latency track location data needed to facilitate gimbal pointing. |
- Telemetry updates at 30 Hz.
- Pixel space feedback for accurate gimbal pointing.
- Data from object tracking, scene steering, and MTI objects.
- Temperature data from radiometric cameras.
- Focus telemetry for autofocus implementations.
|
|
Video Encoding and KLV Metadata
Ethernet video outputs support IP radio options and reduces system bandwidth. |
- MPEG2 TS (H.264 with KLV metadata).
- MPEG4.
- RTP M-JPEG.
- KLV metadata is generated in accordance with MISB standards 0102.10, 0601.7, 0603.2, 0604.3, and 0903.3.
- Multiple simultaneous streams +KLV on SLA-3000
- Controllable tradeoff of video compression frame rate, and down sampling to meet bandwidth requirements with best possible imagery and system flexibility.
- Metadata on VBI lines for KLV over analog links.
- 2x 1080p/30 processing / encoding on SLA 3000.
- 720p/30 input with up to 720p outputs on SLA-1500.
- Adaptors for HD block cameras, HDSDI, HDMI.
|
|
SLAnding Aid
Supports landing operations by automatically finding and tracking a landing pattern. Providing pattern position, range, and angle to the vehicle landing logic. |
- Landing pattern supports landing operations over a wide variety of ranges and approach angles.
- Independent of GPS. Enables accurate landing in GPS-denied environments.
- Autopilot interfaces to simplify system integration.
|
SLAnding Aid |
Detection Algorithms
Real time detection algorithms provide important situational awareness information and aid in tracker initialization. |
- Real time onboard MTI provides fast feedback which is essential for effective track initialization on moving objects. MTI modes:
- Identification of multiple (5) trackable moving objects provides simple track selection method = SV mode.
- Identification of multiple (100) very small moving targets from an aerial camera = SA mode.
- Moving object detection from fixed, low angle camera systems = ST mode.
- Histogram difference detection mode finds unique colors within a scene. Plans in development for new blob/size detection options.
|
MTI - SV
MTI - SA
MTI - ST |
Video / Snapshot Recording
Onboard recording on SLA/SLE-1500. Interface board SD card for SLA/SLE-3000. |
- H.264 video.
- Full resolution snapshot recording. JPEG snapshots with EXIF data. >2/second.
- Full pixel depth data .PNG snapshots with metadata (for radiometric data access).
- Telemetry data recording.
|
|
Video Enhancement and Overlays
A range of functions are provided to enable enhancement options to optimize video for the needs of each application. |
- Digital Zoom.
- Contrast Limited Adaptive Histogram Equalization (CLAHE) and Local Area Processing (LAP).
- De-Noising of video. Edge sharpening.
- OSD command set to add text, shapes and custom reticle overlays.
- False color schemes.
- Extended 14 bit-depth processing.
|
Enhancement - Shadows
Enhancement - CLAHE |
Multi Camera Video Presentation
Flexible display options for optimized presentation, transmission and display of multiple video streams. |
- Picture In Picture: Full screen (switched video); Picture in Picture (operator designation of PiP location); Split screen; Quad Screen.
- Image Blending: Multi-spectral inputs can be blended into a single image with false color to bring out the best of each spectral image.
|
|
Focus Telemetry
Telemetric focus function available independent of tracking telemetry. |
- Focus telemetry for autofocus implementations.
- Full autofocus functionality for a range of EO block cameras and lens assemblies.
|
| |