Subpixel jitter video restoration on board of micro-UAV

Szu, Harold; Buss, James R.; Garcia, Joseph P.; Breaux, Nancy A.; Kopriva, Ivica; Karangelen, Nicholas E.; Hsu, Ming Kai; Lee, Ting; Willey, Jeff; Shield, Gary; Brown, Steve; Robbins, Robert C.; Hobday, John D.

doi:10.1117/12.563654

Cited by 3 publications

(2 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We have developed a real-time de-jittering EOIR-video processing at the sub-pixel and pixel levels without the usual cumbersome gimbals mounting for the airplane motion compensation [31]. Since the communication protocol can not afford the usual wireless LAN hand-shaking and delivery check among mosaic image contributions by neighborhood, we have applied the fault tolerance of Associative Memory (AM) recall to conceal the transceiver errors.…”

Section: Resultsmentioning

confidence: 99%

Authenticity and privacy of a team of mini-UAVs by means of nonlinear recursive shuffling

Szu

Hsu

Baier

et al. 2006

Independent Component Analyses, Wavelets, Unsupervised Smart Sensors, and Neural Networks IV

Self Cite

View full text Add to dashboard Cite

We have developed a real-time EOIR video counter-jittering sub-pixel image correction algorithm for a single miniUnmanned Air Vehicle (m-UAV) for surveillance and communication (Szu et al. SPIE Proc. V 5439, pp.183-197, April 12, 2004). In this paper, we wish to plan and execute the next challenge----a team of m-UAVs. The minimum unit for a robust chain saw communication must have the connectivity of five second-nearest-neighbor members with a sliding, arbitrary center. The team members require an authenticity check (AC) among a unit of five, in order to carry out a jittering mosaic image processing (JMIP) on-board for every m-UAV without gimbals. The JMIP does not use any NSA security protocol ("cardinal rule: no-man, no-NSA codec"). Besides team flight dynamics (Szu et al "Nanotech applied to aerospace and aeronautics: swarming," AIAA 2005-6933 Sept 26-29 2005), several new modules: AOA, AAM, DSK, AC, FPGA are designed, and the JMIP must develop their own control, command and communication system, safeguarded by the authenticity and privacy checks presented in this paper. We propose a Nonlinear Invertible (deck of card) Shuffler (NIS) algorithm, which has a Feistel structure similar to the Data Encryption Standard (DES) developed by Feistel et. al. at IBM in the 1970's; but DES is modified here by a set of chaotic dynamical shuffler Key (DSK), as re-computable lookup tables generated by every on-board Chaotic Neural Network (CNN). The initializations of CNN are periodically provided by the private version of RSA from the ground control to team members to avoid any inadvertent failure of broken chain among m-UAVs. Efficient utilization of communication bandwidth is necessary for a constantly moving and jittering m-UAV platform, e.g. the wireless LAN protocol wastes the bandwidth due to a constant need of hand-shaking procedures (as demonstrated by NRL; though sensible for PCs and 3 rd gen. mobile phones). Thus, the chaotic DSK must be embedded in a fault-tolerant Neural Network Associative Memory for the error-resilientconcealment mosaic image chip re-sent. However, the RSA public and private keys, chaos typing and initial value are given on set or sent to each m-UAV so that each platform knows only its private key. AC among 5 team members are possible using a reverse RSA protocol. A hashed image chip is coded by the sender's private key and nobody else knows in order to send to it to neighbors and the receiver can check the content by using the senders public key and compared the decrypted result with on-board image chips. We discover a fundamental problem of digital chaos approach in a finite state machine, of which a fallacy test of a discrete version is needed for a finite number of bits, as James Yorke advocated early. Thus, our proposed chaotic NIS for bits stream protection becomes desirable to further mixing the digital CNN outputs. The fault tolerance and the parallelism of Artificial Neural Network Associative Memory are necessary attributes for the neighborhood smoothness image restoration. The assoc...

show abstract

Section: Resultsmentioning

confidence: 99%

Authenticity and privacy of a team of mini-UAVs by means of nonlinear recursive shuffling

Szu

Hsu

Baier

et al. 2006

Independent Component Analyses, Wavelets, Unsupervised Smart Sensors, and Neural Networks IV

Self Cite

View full text Add to dashboard Cite

show abstract

“…in Szu et al 2004;Wang et al 2007) in contrast to line jittering (see e.g. Kang and Shen 2006;Nikolova 2009;Shen 2004).…”

Section: Dejittering Regularizationmentioning

confidence: 94%

Partial Differential Equations for Zooming, Deinterlacing and Dejittering

Lenzen

Scherzer

2010

Int J Comput Vis

View full text Add to dashboard Cite

In this paper, for imaging applications, we introduce partial differential equations (PDEs), which allow for correcting displacement errors, for dejittering, and for deinterlacing, respectively, in multi-channel data. These equations are derived via semi-groups for non-convex energy functionals. As a particular example, for gray valued data, we find the mean curvature equation and the corresponding non-convex energy functional. As a further application for correction of displacement errors we study image interpolation, in particular zooming, of digital color images. For actual image zooming, the solutions of the proposed PDEs are projected onto a space of functions satisfying interpolation constraints. A comparison of the test results with standard and state-of-the-art interpolation algorithms shows the competitiveness of this approach.

show abstract

Computational frameworks for context-aware hybrid sensor fusion

Biswas¹,

Moon

et al. 2015

International Journal of Image and Data Fusion

View full text Add to dashboard Cite

Subpixel jitter video restoration on board of micro-UAV

Cited by 3 publications

References 2 publications

Authenticity and privacy of a team of mini-UAVs by means of nonlinear recursive shuffling

Authenticity and privacy of a team of mini-UAVs by means of nonlinear recursive shuffling

Partial Differential Equations for Zooming, Deinterlacing and Dejittering

Computational frameworks for context-aware hybrid sensor fusion

Contact Info

Product

Resources

About