Improved Periscope Video Pre-Processing
Navy SBIR 2014.1 - Topic N141-025
NAVSEA - Mr. Dean Putnam - [email protected]
Opens: Dec 20, 2013 - Closes: Jan 22, 2014
N141-025 TITLE: Improved Periscope Video Pre-Processing
TECHNOLOGY AREAS: Sensors, Electronics, Battlespace
ACQUISITION PROGRAM: PEO IWS 5.0, Undersea Warfare Systems.
RESTRICTION ON PERFORMANCE BY FOREIGN CITIZENS (i.e., those holding non-U.S. Passports): This topic is "ITAR Restricted". The information and materials provided pursuant to or resulting from this topic are restricted under the International Traffic in Arms Regulations (ITAR), 22 CFR Parts 120 - 130, which control the export of defense-related material and services, including the export of sensitive technical data. Foreign Citizens may perform work under an award resulting from this topic only if they hold the "Permanent Resident Card", or are designated as "Protected Individuals" as defined by 8 U.S.C. 1324b(a)(3). If a proposal for this topic contains participation by a foreign citizen who is not in one of the above two categories, the proposal will be rejected.
OBJECTIVE: Develop imaging techniques for periscope video that improves the quality of the picture during the pre-processing and downstream presentation of the video creation process.
DESCRIPTION: The Navy seeks advanced imaging processing techniques for periscope video. When a periscope video is being recorded it leaves camera interlacing artifacts and records smudges which occur on the periscope lens. Videos from legacy periscopes will have etched reticle lines which are recorded. The interlacing artifacts, smudges, and reticle lines complicate the video picture and reduce the performance of existing video processing capabilities. It requires manual labor to edit the video so that a true picture is available. Providing an innovative technique to improve video processing will reduce the costs of operator workload and increase the performance of sailors.
Due to camera and scene motion in periscope videos, reticles and smudges are impacted differently than imagery in the scene. The current process involves a sailor taking the video that has been recorded and editing it manually using editing software such that the smudges and reticle lines are removed. Removing the interlacing lines is even more time consuming as the sailor attempts to blend a picture into a discernible scene that accurately depicts the true picture of what was recorded. This is a laborious, time consuming process. It only provides marginal results with many inconsistencies still remaining within the video scenes.
The Navy is seeking automated techniques to improve processing of video pictures during the pre-processing stage. This will improve the sailor�s ability to effectively use periscope video by increasing the quality of the video image before it reaches the processing stage. The solution will include techniques that replace current labor intensive processes associated with manual removal of visual artifacts. It will address automatic contact detection, classification and tracking, and video stitching. The capability will also allow for scene motion correction through improving de-interlacing [ref 1], reticule and smudge removal [ref 2], and possibly Bayer color de-mosaicing [ref 3], through the innovative integration of pre-processing steps.
PHASE I: The company will develop a concept for imaging techniques for periscope video that meet the requirements described above. The company will demonstrate the feasibility of the concept in meeting Navy needs and will establish that the concept can be feasibly developed into a useful product for the Navy. Feasibility will be established by analytical testing and modeling. The small business will provide a Phase II development plan that addresses technical risk reduction and provides performance goals and key technical milestones.
PHASE II: Based on the results of Phase I and the Phase II development plan, the small business will develop a scaled prototype for evaluation as appropriate. The prototype will be evaluated to determine its capability in meeting the performance goals defined in Phase II development plan and the Navy requirements for the imaging techniques for periscope video. System performance will be demonstrated through prototype evaluation and modeling or analytical methods over the required range of parameters including various testing cycles. Evaluation results will be used to refine the prototype into an initial design that will meet Navy requirements. The company will prepare a Phase III development plan to transition the technology to Navy use.
PHASE III: The company will be expected to support the Navy in transitioning the technology for Navy use. The company will develop imaging techniques for periscope video according to the Phase III development plan for evaluation to determine its effectiveness in an operationally relevant environment. The company will support the Navy for test and validation to certify and qualify the system for Navy use.
PRIVATE SECTOR COMMERCIAL POTENTIAL/DUAL-USE APPLICATIONS: Video algorithms would also have application in a variety of remote video capture situations including surveillance video and video capture from moving platforms in externally located cameras in support of industrial security, homeland defense, and other law enforcement settings. Any industry that incorporates video cameras in their security systems could benefit from the technologies developed under this topic.
2. Moran, S. "Video Inpainting." 2009. University of Edinburgh School of Informatics. 13 Feb 2013
3. Jean, R. "Demosaicing with The Bayer Pattern." Department of Computer Science, University of North Carolina. 13 Feb 2013. http://www.unc.edu/~rjean/demosaicing/demosaicing.pdf
KEYWORDS: Periscope video; de-interlacing; reticule lines; smudge removal; scene motion; Bayer de-mosaicing