:: NEXT VISION ::
About Next Vision Products Technical Support Customer Satisfaction Notice
sca
DRS
General Dynamics
G5
L3
Liteye
Newcon
E/P
Newcon
Cassidian
instro
Lasertech
Nrecon Optik
E/P
SightLine
 
 

SOFTWARE FUNCTIONS

Our Video Processing software is the foundation for all SightLine Applications video processor products. The software library provides a powerful suite of functions
critical to advanced camera systems integrators. Flexible configuration of functions allow integrators to optimize their system for a wide variety of Intelligence,
Surveillance, and Reconnaissance (ISR), inspection, and other applications.

Software functions are enabled to run only on the SightLine video processing hardware

VIDEO STABILIZATION

The starting point for all video processing improvements is our frame to frame registration measurement.
Registration provides the information to correct the output video frame to remove frame to frame motion
(vibration) and dramatically improve video.

 

¡¤         Absolutely critical for camera systems on moving vehicles (air, ground, sea) and desired zoom < 10 deg FOV

¡¤         Accurate frame to frame change detection and correction

¡¤         Remove camera system jitter (frame to frame movement). Excellent for high frequency (approaching 30 Hz), lower amplitude noise rejection.

 

 

ROLL CORRECTION

Registration also provides ability to correct camera frame to frame rotation, further improving the user experience.

 

¡¤         Correction of platform roll motion

¡¤         Important for cameras systems on aerostats, towers, UAS, and marine vehicles

¡¤         Critical for roll/nod gimbal configurations

¡¤         Provides 3 axis performance in a 2 axis design, saving complexity, weight, and expense

¡¤         Integrators can feed-forward camera roll commands to counteract known platform rotation.

 

SCENE AND OBJECT TRACKING

Robust hands-free tracking of scene and designated objects. Onboard tracker provides low latency solution needed for nimble pointing control systems. Tried and tested, our trackers have over one million flight hours logged. They are highly configurable to meet mission requirements and include advanced configuration options

 

¡¤         Scene Tracking: Powerful, intuitive mode to keep the entire scene in the frame using scene translation
telemetry. Works well as a base mode and fallback from object trackers.

¡¤         Vehicle and Stationary Modes: Solid designated tracks on moving or static objects. Advanced image
analysis and motion estimation isolate tracked object from background for robust tracking even when
view of tracked object is temporarily blocked.

¡¤         No Registration Mode: Used to track objects when there are no background features (for example: trying
to track an airplane against a blue sky).

¡¤         Track Box Size, Nudge, Track through Zoom and Rotation: Operational and setting flexibility for
improved tracker performance.

¡¤         Acquisition Assist: Automatically searches the area around an initial track location to find the optimal
track box size and position. Allows operator to just get ¡®close¡¯ and still get great tracking results.

¡¤         Intelligent Assist: Automatically reinitialize (and optimize track box location and size) on targets when
changes in the target appearance are detected.

¡¤         Detection Track Cueing: Used to transition a detection to a primary track (example: aerial MTI
detection to vehicle object track).

¡¤         To address demand for a lower price-point option, Tracker-Only options use the same proven tracking
algorithms as the full-featured SLA, offered with limitations on other functions.

 

TELEMETRY DATA

Tracker functions and MTI provide low latency track location data needed to facilitate gimbal pointing.

 

¡¤         Telemetry updates at 30 Hz.

¡¤         Sub-pixel accuracy feedback for accurate gimbal pointing.

¡¤         Data is provided from object tracking, scene steering, and MTI objects for best system performance support.

¡¤         Temperature data from radiometric cameras.

¡¤         Focus telemetry for autofocus implementations.

IP NETWORK AND SYSTEM CONNECTIVITY

¡¤         10/100 Ethernet.

o    UDP, TCP, FTP, SSH, RTP, and RTSP connectivity, unicast, multicast, broadcast

o    DHCP, LinkLocal, Static IP, and VLAN address

¡¤         Multiple serial ports (3 on 1500, 5 on 3000)

¡¤         Serial pass-through (IP to serial, serial to serial)

¡¤         ARM processors provides for customer ownership serial ports and GPIO

¡¤         Demonstrated compatibility with IP radio links

¡¤         Demonstrated compatibility with COTS ground station software products

 

VIDEO ENCODING AND KLV METADATA

Encoded video Ethernet streaming supports IP radio options and reduces system bandwidth.

 

¡¤         MPEG2 TS (H.264 with KLV metadata).

¡¤         MPEG4.

¡¤         RTP M-JPEG.

¡¤         KLV metadata is generated in accordance with MISB standards 0102.10, 0601.7, 0603.2, 0604.3, and 0903.3.

¡¤         Multiple simultaneous streams +KLV on SLA-3000

¡¤         Controllable tradeoff of video compression frame rate, and down sampling to meet bandwidth requirements with best possible imagery and system flexibility.

¡¤         Metadata on VBI lines for KLV over analog links.

 

DETECTION ALGORITHMS

Multiple detection modes provide important situational awareness information and provide fast feedback essential for effective track initialization on moving objects.

 

¡¤         Detect very small moving targets

¡¤         Simple track selection method – provided detection telemetry allows automatic track initialization

¡¤         Three MTI modes support a range of applications

¡¤         Color-based (histogram) anomoly detection algorithm helps find objects that are different than the scene background

¡¤         Radiometric detection finds objects within desired thermal range

 

VIDEO / SNAPSHOT RECORDING

Onboard recording on 1500-OEM. Interface board SD card for 3000.

 

¡¤         H.264 video to local SD card or remote FTP.

¡¤         Full resolution snapshot recording. JPEG snapshots with EXIF data.

¡¤         Full pixel depth data .PNG snapshots with metadata (for radiometric data access).

¡¤         Telemetry data recording.

 

VIDEO ENHANCEMENT

A range of functions are provided to enable enhancement options to optimize video for the needs of each application.

 

¡¤         Contrast Limited Adaptive Histogram Equalization (CLAHE) and Local Area Processing (LAP).

¡¤         De-Noising of video. Edge sharpening.

¡¤         False color schemes.

¡¤         Extended 14 bit-depth processing.

¡¤         Digital Zoom.

 

 

ON SCREEN DISPLAY (OSD)

¡¤         Protocol command OSD support to add text, shapes, and custom reticle overlays

¡¤         Bench tool to help customers use OSD primitives to build a custom OSD design.

¡¤         Customer logo placement.

¡¤         On 3000, ARM process support allows full OSD control to customer to design very complicated OSD implementations

 

MULTI CAMERA VIDEO PRESENTATION

Flexible display options for optimized presentation and transmission and display of multiple video
streams.

 

¡¤         Full screen (switched video)

¡¤         Picture in Picture (selectable PiP window location/size) – 3000

¡¤         Split screen – 3000

¡¤         Multiple IP Streams – individual camera streams or combination of above – 3000

¡¤         Image Blending. Multi-spectral inputs can be blended into a single image with false color to bring out
the best of each spectral image – 3000

 

FOCUS TELEMETRY

Algorithm calculates a focus metric which has a clear peak value when the scene is in the best focus.

 

¡¤         Focus metric is provided as telemetry data for cistomer autofocus implementations (focus motor control loop to optimize its setting)

¡¤         For some cameras and lenses, SightLine has included a complete autofocus congtrol loop functionality, providing direct serial lens control for those devices

 

CUSTOMER DEVELOPED SCRIPTS

To best support customers ability to combine software functions to best meet their system performance objectives, SightLine processors support Lua based scripting functionality. Lua is a lightweight multi- paradigm programming language designed for embedded systems and extending software applications to
meet the increasing demand for customization. Some examples that could be implemented using these scripts:

 

¡¤         After detecting a person in a defined area of a thermal image, automatically take a snapshot and append vehicle GPS and timestamp data.

¡¤         After the house falls on the witch, call the lollypop gang

 

CUSTOMER DEVELOPED ARM APPLICATIONS

Both processors inclued an ARM processor which is very lightly used by SightLine. It is available to perform customer functions within their system architecture and allows access to serial ports, GPIO, etc. SigthLine provides sample code for a number of applications. Uses include:

 

¡¤         Autopilot interface for landing aid functionality.

¡¤         Gimbal control

¡¤         Protocol translation – system protocol to SightLine and visa versa

 

PRECISION LANDING

Video Processing Library – Functions & Videos

The Video Processing Library is the foundation for all SightLine Applications OEM products. The library provides a powerful suite of video functions that are key to a wide variety of Intelligence, Surveillance, and Reconnaissance (ISR) applications.?To the right is an overview video of our growing?library of features. The below table presents each function separately with a corresponding video clip. ?We will be updating all of these videos over the next few weeks.

We are constantly looking to improve and expand our video processing library of features. ?If you have a suggestion or have a specific requirement, we welcome the opportunity to support your project. ?Please feel free to contact us?via our on-line form. We are ready to work with you, so let us know?how we can help.

HD Video

Providing a range of solutions to meet demand for HD video capabilities. OEM board specific..



  • 1080p/30 processing/encoding with SLA/SLE-3000
  • 720p/30 processing/encoding with SLA/SLE-1500
  • Adaptors for HD cameras, HDSDI, HDMI, CL, LVDS, etc.

Video Stabilization

The starting point for all video ISR functions, frame to frame registration provides dramatically improved video. Registration also provides ability to correct camera frame to frame rotation, further improving the user experience.



  • Remove high frequency jitter (frame to frame movement). Excellent for high frequency (approaching 30 Hz) lower amplitude noise rejection.
  • For applications where correction of platform roll motion is desired (aerostats, towers, UAS).
  • Where gimbal roll/nod configurations are used.
  • Integrators can feed video roll commands to counteract known platform rotation.




Stabilization


Roll Correction

Scene and Object Tracking

Robust hands-free tracking of scene and designated objects. Onboard tracker provides low latency solution needed for nimble pointing control systems.



  • Scene tracking provides a powerful, intuitive gimbal feedback based on the entire scene.
  • Advanced image analysis and motion estimation isolate tracked object from background for robust tracks.
  • Persistent tracking when view of tracked object is temporarily blocked.
  • Tracker Assist and Auto Re-initialization help with robust tracking.




Track Through

Telemetry Data

Tracker functions and MTI provide low latency track location data needed to facilitate gimbal pointing.



  • Telemetry updates at 30 Hz.
  • Pixel space feedback for accurate gimbal pointing.
  • Data from object tracking, scene steering, and MTI objects.
  • Temperature data from radiometric cameras.
  • Focus telemetry for autofocus implementations.

Video Encoding and KLV Metadata

Ethernet video outputs support IP radio options and reduces system bandwidth.



  • MPEG2 TS (H.264 with KLV metadata).
  • MPEG4.
  • RTP M-JPEG.
  • KLV metadata is generated in accordance with MISB standards 0102.10, 0601.7, 0603.2, 0604.3, and 0903.3.
  • Multiple simultaneous streams +KLV on SLA-3000
  • Controllable tradeoff of video compression frame rate, and down sampling to meet bandwidth requirements with best possible imagery and system flexibility.
  • Metadata on VBI lines for KLV over analog links.
  • 2x 1080p/30 processing / encoding on SLA 3000.
  • 720p/30 input with up to 720p outputs on SLA-1500.
  • Adaptors for HD block cameras, HDSDI, HDMI.

SLAnding Aid

Supports landing operations by automatically finding and tracking a landing pattern. Providing pattern position, range, and angle to the vehicle landing logic.



  • Landing pattern supports landing operations over a wide variety of ranges and approach angles.
  • Independent of GPS. Enables accurate landing in GPS-denied environments.
  • Autopilot interfaces to simplify system integration.




SLAnding Aid

Detection Algorithms

Real time detection algorithms provide important situational awareness information and aid in tracker initialization.



  • Real time onboard MTI provides fast feedback which is essential for effective track initialization on moving objects. MTI modes:
    • Identification of multiple (5) trackable moving objects provides simple track selection method = SV mode.
    • Identification of multiple (100) very small moving targets from an aerial camera = SA mode.
    • Moving object detection from fixed, low angle camera systems = ST mode.
  • Histogram difference detection mode finds unique colors within a scene. Plans in development for new blob/size detection options.




MTI - SV


MTI - SA


MTI - ST

Video / Snapshot Recording

Onboard recording on SLA/SLE-1500. Interface board SD card for SLA/SLE-3000.



  • H.264 video.
  • Full resolution snapshot recording. JPEG snapshots with EXIF data. >2/second.
  • Full pixel depth data .PNG snapshots with metadata (for radiometric data access).
  • Telemetry data recording.

Video Enhancement and Overlays

A range of functions are provided to enable enhancement options to optimize video for the needs of each application.



  • Digital Zoom.
  • Contrast Limited Adaptive Histogram Equalization (CLAHE) and Local Area Processing (LAP).
  • De-Noising of video. Edge sharpening.
  • OSD command set to add text, shapes and custom reticle overlays.
  • False color schemes.
  • Extended 14 bit-depth processing.



Enhancement - Shadows

Enhancement - CLAHE

Multi Camera Video Presentation

Flexible display options for optimized presentation, transmission and display of multiple video streams.



  • Picture In Picture: Full screen (switched video); Picture in Picture (operator designation of PiP location); Split screen; Quad Screen.
  • Image Blending: Multi-spectral inputs can be blended into a single image with false color to bring out the best of each spectral image.

Focus Telemetry

Telemetric focus function available independent of tracking telemetry.



  • Focus telemetry for autofocus implementations.
  • Full autofocus functionality for a range of EO block cameras and lens assemblies.

Applications & Implementation

SightLine products are used in a wide variety of applications. We actively support our customers building integrated systems used to conduct ground and aerial ISR missions, Wildlife observations, Precision Agriculture surveys, Emergency Response, and Fire Suppression efforts. All of these applications implement our products in new ways to gather data, capture video, and provide substantial value to these solutions. We have the knowledge and expertise you can leverage to develop complex system architectures.

ISR Missions

Sightline boards and software are in many platforms that conduct operations in support of border security, maritime coastal patrols, defense operations, and mission planning. Multi-camera implementations with EO/IR image blending is a very popular application, supported by our > SLA-2000
ISR Missions

Wildlife Observations

We are learning how to gather data about habitats and changing environmental conditions to better support challenges being faced by wildlife on our planet. Larger platforms have been gathering HD video integrating our > SLA-3000SLA-3000
Wildlife Observations

Precision Agriculture

Many smaller integrators are using our SLE products to collect video data that helps farmers and orchardist understand if irrigation plans are properly being deployed. These projects are pushing demand for supper lightweight encoding and snapshot functionality found in the > SLE-1500
Precision Agriculture

Emergency Response

Rapid response is normally a critical component to assessing, gathering, and disseminating data. Our products connect to existing networks to easily stream valuable video and positional metadata. We are seeing larger platforms seeking multi-camera feeds using our > SLA-2000
Emergency Response

Forest Fire Detection

Many states that routinely battle forest and wildfires understand the dangers. All have studied how to best use aerial systems for monitoring and/or gathering data on high risk areas. Use of unmanned systems gives an edge up to firefighters on the ground, while significantly reducing costs and risks inherent with manned aircraft assets. Having live broadcast quality video is essential for making critical decisions. HD-SDI input and output is supported by our > SLA-2100
Forest Fire Suppression