KEYWORDS: Field programmable gate arrays, Image processing, Digital signal processing, Logic, Algorithm development, Distortion, Clocks, Commercial off the shelf technology, Mathematics, Image sensors
Recent advances in Field-Programmable Gate Arrays (FPGAs) and innovations in firmware design have allowed more
complex image processing algorithms to be implemented entirely within the FPGA devices while substantially
improving performance and reducing development time. Firmware innovations include a unique memory buffer
architecture and the use of floating-point math. The design discussed takes advantage of these advances and innovations
to implement a geometric transformation algorithm with bilinear interpolation for applications such as distortion
correction. The firmware and hardware developed in this effort support image sizes of up to 1024x1024 pixels at 200 Hz
and pixel rates of 216 MHz with versions available that support oversized input images.
Numerous infrared scene projection technologies have been investigated since the 1970s. Notably, from the late 1980s the development of the first resistor array infrared projectors gained leverage from the strong concurrent developments within focal plane array imaging technology, linked by the common need for large integrated circuits comprising a 2-dimensional array of interconnected unit cells. In the resistor array case, it is the unit cell comprising the resistively heated emitter and its dedicated drive circuit that determines the projector response to its associated scene generator commands. In this paper we review the development of resistor array technology from a historical perspective, concentrating on the unit cell developments. We commence by describing the technological innovations that forged the way, sharing along the way stories of the successes and failures, all of which contributed to the steady if somewhat eventful growth of the critical knowledge base that underpins the strength of today's array technology. We conclude with comments on the characteristics and limitations of the technology and on the prospects for future array development.
SBIR's family of MIRAGE infrared scene projection systems is undergoing significant growth and expansion. The first two lots of production IR emitters have completed fabrication at Microelectronics Center of North Carolina/Research and Development Institute (MCNC-RDI), and the next round(s) of emitter production has begun. These latest emitter arrays support programs such as Large Format Resistive Array (LFRA), Optimized Array for Space-based Infrared Simulation (OASIS), MIRAGE 1.5, and MIRAGE II. We present the latest performance data on emitters fabricated at MCNC-RDI, plus integrated system performance on recently completed IRSP systems. Teamed with FLIR Systems/Indigo Operations, SBIR and the Tri-Services IRSP Working Group have completed development of the CMOS Read-In Integrated Circuit (RIIC) portion of the Wide Format Resistive Array (WFRA) program-to extend LFRA performance to a 768 x 1536 "wide screen" projection configuration. WFRA RIIC architecture and performance is presented. Finally, we summarize development of the LFRA Digital Emitter Engine (DEE) and OASIS cryogenic package assemblies, the next-generation Command & Control Electronics (C&CE).
The next generation of resistively heated emitter pixels will be required to attain MWIR apparent temperatures on the order of 2000K, which will require pixel temperatures on the order of 3000K. Numerical simulations have been carried out to determine the material properties required to support the desired performance. Research has been performed to identify a set of potential materials for fabricating these devices based on materials science, existing thermophysical properties, thermodynamic stability and compatibility with thin film processing.
One proven technique for nonuniformity correction (NUC) of a resistor array infrared scene projector requires careful measurement of the output-versus-input response for every emitter in a large array. In previous papers, we have discussed methods and results for accomplishing the projector NUC. Two difficulties that may limit the NUC results are residual nonuniformity in the calibration sensor, and nonlinearity in the calibration sensor's response to scene radiance. These effects introduce errors in the measurement of the projector elements' output, which lead to residual nonuniformity. In this paper we describe a recent effort to mitigate both of these problems using a procedure that combines sensor nonuniformity correction and sensor calibration, detector by detector, so that these problems do not contaminate the projector NUC. By measuring a set of blackbody flood-field images at a dozen or so different temperatures, the individual detector output-versus-input radiance responses can be measured. Similar to the projector NUC, we use a curve-fitting routine to model the response of each detector. Using this set of response curves, a post-processing algorithm is used to correct and calibrate the images measured by the sensor. We have used this approach to reduce several sensor error sources by a factor of 10 to 100. The resulting processing is used to correct and calibrate all of the sensor images used to perform the projector NUC, as one step in the projector NUC. The procedure appears to be useful for any application where sensor nonuniformity or response nonlinearities are significant.
The new generation PC-based array control electronics (PACE) system for emissive infrared projector real-time scene data processing has opened the potential for the development of more complex real-time nonuniformity correction (RNUC) algorithms than were formerly possible. In this paper, emitter array response data are analyzed in order to identify the underlying physical processes and to identify the form of the RNUC algorithm they suggest. It is shown that although the PACE system is capable of processing the algorithm, the development of a practical RNUC processor would seem to be limited by the complexities that underlie the observed variability in emitter response.
The effects of distortion in the complex optical system of an IR scene projector have motivated the development of methods for spatial calibration for scene projectors. A typical method utilizes the projection of a set of test images, with careful measurement of the location of points in the image. Given the projected and measured positions, a parametric model is used to describe the spatial “distortion” of the projection system. This distortion model can then be used for a variety of purposes, including pre-processing the images to be projected so that the distortion of the projection system is pre-compensated, and the distortion of the projection system is negated. This application and specific method have been demonstrated, and can compensate for a variety of distortion and alignment effects in the projector / sensor configuration. Personnel at the Kinetic Kill Vehicle Hardware-in-the-loop Simulator (KHILS) facility have demonstrated compensation and co-alignment of 2-color projection systems with sub-pixel precision using this technique. This paper describes an analysis of a situation in which pre-compensated images are translated (either mechanically or optically) to simulate motion of a target object or adjust alignment of the sensor and projector. The effect of physically translating images that had been pre-compensated for a different projector/sensor alignment was analyzed. We describe the results of a study of the translation and distortion effects, and characterize the expected performance of a testing procedure that requires translation of the pre-compensated images.
KEYWORDS: Nonuniformity corrections, Signal processing, Cameras, Infrared radiation, Projection systems, Thermography, Black bodies, Field effect transistors, Signal attenuation, Spatial frequencies
A new infrared projector emitter response curve-fitting procedure suitable for generating nonuniformity coefficients capable of being applied in existing real-time processing architectures is introduced. The procedure has been developed through detailed analysis of a Honeywell Multi-Spectral Scene Projector (MSSP) sparse array data set, combined with an appreciation of the underlying physical processes that lead to the generation of infrared radiance.
The development of a new generation PC-based array control electronics (PACE) system was completed during the first quarter of 2003 in the Kinetic Kill Vehicle Hardware-in-the-loop (KHILS) facility. This system replaces the bulky VME-based system that was the previous standard with more compact digital control electronics using field-programmable gate array (FPGA) technology hosted on a personal computer. The analog interface electronics (AIE) were redesigned to eliminate obsolete components and miniaturize the package for better compatibility with harsh environments. The resulting PACE system supports both Santa Barbara Infrared Inc. (SBIR) and Honeywell Technology Center's (HTC's) 512 x 512 legacy emitter array infrared projection devices as well as SBIR's upcoming 1024 x 1024 and next-generation 512 x 512 arrays. Two FPGA-based PCI boards enable this system to reconfigure the inputs, processing and outputs of the projection electronics through firmware loaded from the control PC. The increased flexibility provides potential for additional real-time functions such as distortion correction, convolution and calibration to be implemented along with nonuniformity correction (NUC) techniques by simply reconfiguring firmware. This paper describes the capabilities of the new PACE system in terms of current and future hardware-in-the-loop (HITL) requirements.
For many types of infrared scene projectors, differences in the outputs of individual elements are one source of error in projecting a desired radiance scene. This is particularly true of resistor-array based infrared projectors. Depending on the sensor and application, the desired response uniformity may prove difficult to achieve. The properties of the sensor used to measure the projector outputs critically affect the procedures that can be used for nonuniformity correction (NUC) of the projector, as well as the final accuracy achievable by the NUC. In this paper we present a description of recent efforts to perform NUC of an infrared projector under “adverse” circumstances. For example, the NUC sensor may have some undesirable properties, including: significant random noise, large residual response nonuniformity, temporal drift in bias or gain response, vibration, and bad pixels. We present a procedure for reliably determining the output versus input response of each individual emitter of a resistor array projector. This NUC procedure has been demonstrated in several projection systems at the Kinetic Kill Vehicle Hardware-In-the-Loop Simulator (KHILS) including those within the KHILS cryogenic chamber. The NUC procedure has proven to be generally robust to various sensor artifacts.
KEYWORDS: Signal processing, Projection systems, Nonuniformity corrections, Infrared radiation, Data processing, Computer simulations, Field effect transistors, Temperature metrology, Black bodies, Error analysis
An alternative class of infrared projector real-time nonuniformity correction processor is introduced, based on the concept that the fundamental role of the processor is to reverse each of the projector processing steps as the input DAC voltage word is converted into infrared signal radiance output. The design is developed by assessment of the sequence of processes occurring within the projector and is tested by simulation. It is shown that there is potential for high fidelity nonuniformity correction across the infrared dynamic range without the need for the introduction of curve-fitting breakpoints.
The Honeywell resistor arrays produce radiance outputs, which are observed to have a strong non-linear dependence on the voltage out of the digital-to-analog-converters (DACs). In order for the projection system to run in a radiometrically calibrated mode, the radiances in the image generator must be transformed with exactly the inverse of the resistor array response function before they are sent to the DACs. Representing the image values out of the image generator and the values into the DACs with quantized, digital values introduces errors in the radiance out of the resistor array. Given the functional form of the emitter array response and the number of bits used to represent the image values, these errors in the radiometric output due to the quantization effects can be calculated. This paper describes the calculations and presents results for WISP, MSSP, and the new extended range and standard range BRITE II arrays.
A challenging problem associated with performing hardware- in-the-loop tests of imaging infrared seekers is projecting images that are spatially realistic. The problem is complicated by the fact that the targets may be small and unresolved at acquisition and grow to fill the field of view before intercept. In previous work, mathematical and computer models of the process of observing a pixelized projector with a camera have been developed, metrics of the spatial realism of the projector have been proposed, and model predictions examined.
For more than a decade, there has been considerable discussion about using different IR bands for the detection of low contrast military targets. Theory predicts that a target can have little to no contrast against the background in one IR band while having a discernible signature in another IR band. A significant amount of effort has been invested towards establishing hardware that is capable of simultaneously imaging in two IR bands to take advantage of this phenomenon. Focal plane arrays (FPA) are starting to materialize with this simultaneous two-color imaging capability. The Kinetic Kill Vehicle Hardware-in-the-loop Simulator (KHILS) team of the Air Force Research Laboratory and the Guided Weapons Evaluation Facility (GWEF), both at Eglin AFB, FL, have spent the last 10 years developing the ability to project dynamic IR scenes to imaging IR seekers. Through the Wideband Infrared Scene Projector (WISP) program, the capability to project two simultaneous IR scenes to a dual color seeker has been established at KHILS. WISP utilizes resistor arrays to produce the IR energy. Resistor arrays are not ideal blackbodies. The projection of two IR colors with resistor arrays, therefore, requires two optically coupled arrays. This paper documents the first demonstration of two-color simultaneous projection at KHILS. Agema cameras were used for the measurements. The Agema's HgCdTe detector has responsivity from 4 to 14 microns. A blackbody and two IR filters (MWIR equals 4.2 t 7.4 microns, LWIR equals 7.7 to 13 microns) were used to calibrate the Agema in two bands. Each filter was placed in front of the blackbody one at a time, and the temperature of the blackbody was stepped up in incremental amounts. The output counts from the Agema were recorded at each temperature. This calibration process established the radiance to Agema output count curves for the two bands. The WISP optical system utilizes a dichroic beam combiner to optically couple the two resistor arrays. The transmission path of the beam combiner provided the LWIR (6.75 to 12 microns), while the reflective path produced the MWIR (3 to 6.5 microns). Each resistor array was individually projected into the Agema through the beam combiner at incremental output levels. Once again the Agema's output counts were recorded at each resistor array output level. These projections established the resistor array output to Agema count curves for the MWIR and LWIR resistor arrays. Using the radiance to Agema counts curves, the MWIR and LWIR resistor array output to radiance curves were established. With the calibration curves established, a two-color movie was projected and compared to the generated movie radiance values. By taking care to correctly account for the spectral qualities of the Agema camera, the calibration filters, and the diachroic beam combiner, the projections matched the theoretical calculations. In the near future, a Lockheed- Martin Multiple Quantum Well camera with true two-color IR capability will be tested.
Kinetic energy weapon (KEW) programs under the Ballistic Missile Defense Office (BMDO) need high fidelity, fast framing infrared (IR) imaging seekers. As imaging sensors have matured to support BMDO, the complexity of functions assigned to the KEW weapon systems has amplified the necessity for robust hardware-in-the-loop (HWIL) simulation facilities to reduce program risk. Tactical weapon systems are also turning to imaging focal plane array (FPA) seekers. They too require more sophisticated HWIL testing. The IR projector, an integral component of a HWIL simulation, must reproduce the real world with enough fidelity that the unit-under-tests's (UUT) software will respond to the projected scenario of images as though it were viewing the real world. The MOSFET resistor array IR scene projector shows great promise in cryogenic vacuum chamber as well as room temperature testing. Under the wideband infrared scene projector (WISP) program, an enhanced version of the resistor array is currently under development. When the WISP system is delivered, the projector will consist of a 512 by 512 baseline array with the center 128 by 128 resistors having a higher output capability. For the development stage of the program, 512 by 512 prototype baseline and 128 by 128 prototype high dynamic range (HDR) arrays have been fabricated separately. Characterization measurements to include: spectral output, dynamic range capability, apparent temperature, rise time, fall time, cross talk, and current consumption have been accomplished on the prototype baseline and HDR arrays at the Kinetic Kill Vehicle Hardware-in-the-Loop Simulator (KHILS) Facility and the Guided Weapons Evaluation Facility (GWEF). Results from the measurements show the HDR array dynamic range is an order of magnitude greater than its predecessor. Other parameters such as droop, rise time, etc., either meet or are close to meeting system specifications. The final design of the arrays is currently in progress based on these results.
The Air Force Development Test Center's (AFDTC) Guided Weapons Evaluation Facility (GWEF), is designed to test guided munitions performance using Hardware-In-the-Loop simulations. Evaluation of imaging infrared guided munitions requires the generation and projection of complex infrared (IR) `fly-in' scenes to the unit under test which is mounted to a flight motion simulator. Members of AFDTC's 46 Test Wing and Avionics Systems Command's Wright Labs have teamed to develop and integrate this capability within the GWEF and Wright Lab's Kinetic Kill Hardware-In-the-Loop Simulation (KHILS) facility. The major Hardware-In-the-Loop (HIL) components for the GWEF include an IR scene generator, an IR projector, a five axis flight motion simulator (FMS), a 6 degree of freedom missile flight simulation, and the opto- mechanical interface to mount the projector onto the 5 axis FMS. GWEF's unique HIL solution is utilizing the 512 X 512 resistor array technology developed by KHILS, and off- the-shelf state-of-the-art scene generation computer, FMS, and optics. Details on this in-house development effort include acquisition and configuration/integration issues, thermal information to radiance bandpass output validation, IR scene generation and frame latency, generated IR scene input to projected output calibration, and simulation guidance from launch to impact verification. This capability has been successfully integrated into the GWEF, meeting a March 1996 HIL test.
An addressable mosaic array of resistively heated microbridges offers much flexibility for infrared scene simulations. In the Wide Band Infrared Scene Projector program, Honeywell has demonstrated high yield arrays up to size 512 X 512 capable of room temperature operation for a 2 band infrared projection system being designed and built by Contraves Inc. for the Wright Laboratory Kinetic Kill Vehicle Hardware In-the-Loop Simulator facility at Eglin Air Force Base, FL. The arrays contain two different pixel designs, one pixel designed for kHz frame rates and high radiance achieved at a power level of 2.5 mWatts/pixel and the other pixel designed for more moderate 100 Hz frame rates at lower radiance and at maximum power levels of 0.7 mWatts/pixels. Tests on arrays and pixels have demonstrated dynamic ranges up to 850:1, radiance rise times on the order of 2 mseconds, and broadband pixel emissivities in the range of 70%. Arrays have been fabricated with less than 0.1% pixel outages and no row or column defects. These arrays are mounted in a specialized vacuum assembly containing an IR window, vacuum package, cooling block, and pump out manifold.
Ever increasing developments in imaging infrared (IR) seekers that are being designed for Ballistic Missile Defense Office (BMDO) guided interceptor programs have amplified the necessity for robust hardware-in-the-loop (HWIL) testing to reduce program risk. Several candidate HWIL IR projection technologies are under development. This paper addresses the characterization measurements of a 128 X 128 metal-oxide semiconductor field-effect transistor (MOSFET) resistor array scene projector. The measurements include spectral output performance, dynamic range, spectral apparent temperature, uniformity, rise time, fall time, droop percentage, and current consumption. With possibly the exception of hot target simulation, the resistor array has the ability to spatially, spectrally, and temporarily function as the scene projector for a HWIL facility.
Honeywell and MRC have been developing a range of thermal scene projector arrays through the Wright Laboratory Armament Directorate's cryovacuum resistive infrared scene projector (CRISP) program and the Defense Nuclear Agency's nuclear optical dynamic display system (NODDS) program. The resistive emitters are fabricated on silicon nitride structures on pitches as small as 2 mils. These structures have low thermal mass, low thermal conductance, and high fill factor. Monolithic address and pixel storage electronics provide flicker-free operation of large arrays at high frame rates. The emitters have demonstrated > 600 K blackbody temperatures, high radiance, and > 103 dynamic range at very low power when operated at 40 K temperatures to achieve low background. This paper describes the performance of a CRISP 512 X 512 array consisting of 3.5 mil pixels and a high-speed 128 X 128 NODDS array consisting of ultra-low-power emitters.
This paper reviews recent development and application of the infrared version of the liquid crystal light valve (LCLV). We describe delivered IR image projectors for advanced end-to- end laboratory testing of IR seeker and sensor systems. System performance characteristics are given. A newly developed version of the device has much higher contrast with low IR background image capability.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.