EO/IR Multi-Sensor Fusion Tracker Algorithm Navy SBIR FY2011.1 Sol No.: Navy SBIR FY2011.1 Topic No.: N111-026 Topic Title: EO/IR Multi-Sensor Fusion Tracker Algorithm Proposal No.: N111-026-0857 Firm: Toyon Research Corp. 6800 Cortona Drive Goleta, California 93117-3021 Contact: Andrew Brown Phone: (805) 968-6787 Web Site: www.toyon.com Abstract: Toyon Research Corporation proposes research and development to maximize exploitation of co-boresighted multi-sensor EO/IR video, based on an innovative Bayesian track-before-detect algorithm. Statistical background modeling is performed to optimize clutter suppression, and estimated moving target likelihoods are integrated over time, without thresholding, in a non-linear particle filter. Toyon's proposed algorithm includes multiple-target feature-aided data association via a novel Multiple-Frame Soft-Assignment Solver (MFSAS) developed in a Belief Propagation framework for computationally efficient estimation of probabilistic associations in large-scale tracking problems. Following successful development in Phase I and II, the resulting EO/IR multi-sensor fusion and tracking device is expected to be capable of real-time airborne processing of multiple unregistered video feeds within EO/IR turret SWaP constraints, based on a parallel processing architecture composed of a heterogeneous mix of embedded processors. Benefits: The successful completion of this research will result in the development of a multi-sensor EO/IR fusion and tracking device that will be well-suited for integration in future military systems that rely on the automated processing of aerial surveillance video. For example, the developed technology is expected to benefit the Navy Joint Strike Fighter, Air Force Gorgon Stare, Army Constant Hawk, and DARPA WAND programs. For space-based surveillance, Overhead Persistent Infrared (OPIR) systems such as SBIRS HEO and GEO for missile warning, the Precision Tracking Space System (PTSS) for re-acquisition and engagement of dim midcourse ballistic targets, and the Space Bases Space Surveillance (SBSS) system for resident space object (RSO) tracking are example applications. Other potential government applications include any situations where surveillance is required by an imaging sensor on an aerial platform, such as border surveillance, crime fighting, traffic analysis, and counter-terrorism. Potential civilian applications include campus security, market research of traffic patterns, and estate security using low-cost low-light cameras. Return