Research, development, test, and evaluation of flight deck interface technologies is being conducted by NASA to proactively identify, develop, and mature tools, methods, and technologies for improving aviation safety of new and legacy vehicles operating in the Next Generation Air Transportation System (NextGen). One specific area of research was the use of small head-worn displays (HWDs) to serve as a possible equivalent to a head-up display (HUD) for commercial aircraft. A simulation experiment was conducted to evaluate if the HWD can provide an equivalent level of performance to a HUD. Airline flight crews conducted simulated approach and landing operations during low visibility operations. The results showed that there were no statistical differences in flight crews’ performance in terms of flight technical error suggesting that the HWD may serve as an equivalent display to the HUD. Further, the HWD may have several advantages over a HUD making its adoption an attractive alternative for commercial flight deck implementation. Technical hurdles remain to be overcome for complete display equivalence including, most notably, the end-to-end latency of the HWD system. The results and conclusions taken from the results of the high fidelity simulation experiment are described and offer future research directions.
Head-Worn Displays (HWDs) are envisioned as a possible equivalent to a Head-Up Display (HUD) in commercial and general aviation. A simulation experiment was conducted to evaluate whether the HWD can provide an equivalent or better level of performance to a HUD in terms of unusual attitude recognition and recovery. A prototype HWD was tested with ambient vision capability which were varied (on/off) as an independent variable in the experiment testing for attitude awareness. The simulation experiment was conducted in two parts: 1) short unusual attitude recovery scenarios where the aircraft is placed in an unusual attitude and a single-pilot crew recovered the aircraft; and, 2) a two-pilot crew operating in a realistic flight environment with "off-nominal" events to induce unusual attitudes. The data showed few differences in unusual attitude recognition and recovery performance between the tested head-down, head-up, and head-worn display concepts. The presence and absence of ambient vision stimulation was inconclusive. The ergonomic influences of the head-worn display, necessary to implement the ambient vision experimentation, may have influenced the pilot ratings and acceptance of the concepts.
NASA Langley Research Center (LaRC) has conducted research in the area of helmet-mounted display (HMD)/head-worn display (HWD) over the past 30 years. Initially, NASA LaRC’s research focused on military applications, but recently NASA has conducted a line of research in the area of HWD for commercial and business aircraft. This work revolved around numerous simulation experiments as well as flight tests to develop technology and data for industry and regulatory guidance. This paper summarizes the results of NASA’s HMD/HWD research. Of note, the work tracks progress in wearable collimated optics, head tracking, latency reduction, and weight. The research lends credence to a small, sunglasses-type form factor of the HWD being acceptable to commercial pilots, and this goal is now becoming technologically feasible. The research further suggests that an HWD may serve as an “equivalent” head-up display (HUD) with safety, operational, and cost benefits. “HUD equivalence” appears to be the economic avenue by which HWDs can become mainstream on the commercial and business aircraft flight deck. If this happens, NASA’s research suggests that additional operational benefits using the unique capabilities of the HWD can open up new operational paradigms.
NASA Langley has conducted research in the area of helmet-mounted/head-worn displays over the past 30 years. Initially, NASA Langley's research focused on military applications, but recently has conducted a line of research in the area of head-worn displays for commercial and business aircraft. This work has revolved around numerous simulation experiments as well as flight tests to develop technology and data for industry and regulatory guidance. The paper summarizes the results of NASA's helmet-mounted/head-worn display research. Of note, the work tracks progress in wearable collimated optics, head tracking, latency reduction, and weight. The research lends credence that a small, sunglasses-type form factor of the head-worn display would be acceptable to commercial pilots, and this goal is now becoming technologically feasible. The research further suggests that a head-worn display may serve as an “equivalent" Head-Up Display (HUD) with safety, operational, and cost benefits. “HUD equivalence" appears to be the economic avenue by which head-worn displays can become main-stream on the commercial and business aircraft flight deck. If this happens, NASA's research suggests that additional operational benefits using the unique capabilities of the head-worn display can open up new operational paradigms.
Research, development, test, and evaluation of flight deck interface technologies is being conducted by NASA to proactively identify, develop, and mature tools, methods, and technologies for improving overall aircraft safety of new and legacy vehicles operating in the Next Generation Air Transportation System (NextGen). Under NASA’s Aviation Safety Program, one specific area of research is the use of small Head-Worn Displays (HWDs) as a potential equivalent display to a Head-up Display (HUD). Title 14 of the US CFR 91.175 describes a possible operational credit which can be obtained with airplane equipage of a HUD or an “equivalent”' display combined with Enhanced Vision (EV). A successful HWD implementation may provide the same safety and operational benefits as current HUD-equipped aircraft but for significantly more aircraft in which HUD installation is neither practical nor possible. A flight test was conducted to evaluate if the HWD, coupled with a head-tracker, can provide an equivalent display to a HUD. Approach and taxi testing was performed on-board NASA’s experimental King Air aircraft in various visual conditions. Preliminary quantitative results indicate the HWD tested provided equivalent HUD performance, however operational issues were uncovered. The HWD showed significant potential as all of the pilots liked the increased situation awareness attributable to the HWD’s unique capability of unlimited field-of-regard.
Synthetic Vision Systems and Enhanced Flight Vision System (SVS/EFVS) technologies have the potential to provide additional margins of safety for aircrew performance and enable operational improvements for low visibility operations in the terminal area environment. Simulation and flight tests were jointly sponsored by NASA’s Aviation Safety Program, Vehicle Systems Safety Technology project and the Federal Aviation Administration (FAA) to evaluate potential safety and operational benefits of SVS/EFVS technologies in low visibility Next Generation Air Transportation System (NextGen) operations. The flight tests were conducted by a team of Honeywell, Gulfstream Aerospace Corporation and NASA personnel with the goal of obtaining pilot-in-the-loop test data for flight validation, verification, and demonstration of selected SVS/EFVS operational and system-level performance capabilities.
Nine test flights were flown in Gulfstream’s G450 flight test aircraft outfitted with the SVS/EFVS technologies under low visibility instrument meteorological conditions. Evaluation pilots flew 108 approaches in low visibility weather conditions (600 feet to 3600 feet reported visibility) under different obscurants (mist, fog, drizzle fog, frozen fog) and sky cover (broken, overcast).
Flight test videos were evaluated at three different altitudes (decision altitude, 100 feet radar altitude, and touchdown) to determine the visual advantage afforded to the pilot using the EFVS/Forward-Looking InfraRed (FLIR) imagery compared to natural vision. Results indicate the EFVS provided a visual advantage of two to three times over that of the out-the-window (OTW) view. The EFVS allowed pilots to view the runway environment, specifically runway lights, before they would be able to OTW with natural vision.
NASA’s Fundamental Aeronautics Program, High Speed Project is performing research, development, test and evaluation of flight deck and related technologies to support future low-boom, supersonic configurations (without forward-facing windows) by use of an eXternal Vision System (XVS). The challenge of XVS is to determine a combination of sensor and display technologies which can provide an equivalent level of safety and performance to that provided by forward-facing windows in today’s aircraft. This flight test was conducted with the goal of obtaining performance data on see-and-avoid and see-to-follow traffic using a proof-of-concept XVS design in actual flight conditions. Six data collection flights were flown in four traffic scenarios against two different sized participating traffic aircraft. This test utilized a 3x1 array of High Definition (HD) cameras, with a fixed forward field-of-view, mounted on NASA Langley’s UC-12 test aircraft. Test scenarios, with participating NASA aircraft serving as traffic, were presented to two evaluation pilots per flight – one using the proof-of-concept (POC) XVS and the other looking out the forward windows. The camera images were presented on the XVS display in the aft cabin with Head-Up Display (HUD)-like flight symbology overlaying the real-time imagery. The test generated XVS performance data, including comparisons to natural vision, and post-run subjective acceptability data were also collected. This paper discusses the flight test activities, its operational challenges, and summarizes the findings to date.
The operating concepts emerging under the Next Generation air transportation system (NextGen) require new technology
and procedures - not only on the ground-side - but also on the flight deck. Flight deck display and decision support
technologies are specifically targeted to overcome aircraft safety barriers that might otherwise constrain the full
realization of NextGen. One such technology is the very lightweight, unobtrusive head-worn display (HWD). HWDs
with an integrated head-tracking system are being researched as they offer significant potential benefit under emerging
NextGen operational concepts. Two areas of benefit for NextGen are defined. First, the HWD may be designed to be
equivalent to the Head-Up Display (HUD) using Virtual HUD concepts. As such, these operational credits may be
provided to significantly more aircraft for which HUD installation is neither practical nor possible. Second, the HWD
provides unique display capabilities, such as an unlimited field-of-regard. These capabilities may be integral to
emerging NextGen operational concepts, eliminating safety issues which might otherwise constrain the full realization of
NextGen. The paper details recent research results, current HWD technology limitations, and future technology
development needed to realize HWDs as a enabling technology for NextGen.
NASA is researching innovative technologies for the Next Generation Air Transportation System (NextGen) to
provide a "Better-Than-Visual" (BTV) capability as adjunct to "Equivalent Visual Operations" (EVO); that
is, airport throughputs equivalent to that normally achieved during Visual Flight Rules (VFR) operations rates
with equivalent and better safety in all weather and visibility conditions including Instrument Meteorological
Conditions (IMC). These new technologies build on proven flight deck systems and leverage synthetic and
enhanced vision systems. Two piloted simulation studies were conducted to access the use of a Head-Worn Display
(HWD) with head tracking for synthetic and enhanced vision systems concepts. The first experiment evaluated
the use a HWD for equivalent visual operations to San Francisco International Airport (airport identifier: KSFO)
compared to a visual concept and a head-down display concept. A second experiment evaluated symbology
variations under different visibility conditions using a HWD during taxi operations at Chicago O'Hare airport
(airport identifier: KORD).
Two experiments were conducted, one in a simulated San Francisco airport (KSFO) approach operation and
the other, in simulated Chicago O'Hare surface operations, evaluating enhanced/synthetic vision and head-worn
display technologies for NextGen operations. While flying a closely-spaced parallel approach to KSFO, pilots
rated the HWD, under low-visibility conditions, equivalent to the out-the-window condition, under unlimited
visibility, in terms of situational awareness (SA) and mental workload compared to a head-down enhanced vision
system. There were no differences between the 3 display concepts in terms of traffic spacing and distance and
the pilot decision-making to land or go-around. For the KORD experiment, the visibility condition was not a
factor in pilot's rating of clutter effects from symbology. Several concepts for enhanced implementations of an
unlimited field-of-regard BTV concept for low-visibility surface operations were determined to be equivalent in
pilot ratings of efficacy and usability.
Synthetic Vision Systems and Enhanced Flight Vision System (SVS/EFVS) technologies have the potential to provide
additional margins of safety for aircrew performance and enable operational improvements for low visibility operations
in the terminal area environment with equivalent efficiency as visual operations. To meet this potential, research is
needed for effective technology development and implementation of regulatory and design guidance to support
introduction and use of SVS/EFVS advanced cockpit vision technologies in Next Generation Air Transportation System
(NextGen) operations.
A fixed-base pilot-in-the-loop simulation test was conducted at NASA Langley Research Center that evaluated the use
of SVS/EFVS in NextGen low visibility ground (taxi) operations and approach/landing operations. Twelve crews flew
approach and landing operations in a simulated NextGen Chicago O'Hare environment. Various scenarios tested the
potential for EFVS for operations in visibility as low as 1000 ft runway visibility range (RVR) and SVS to enable lower
decision heights (DH) than can currently be flown today. Expanding the EFVS visual segment from DH to the runway
in visibilities as low as 1000 RVR appears to be viable as touchdown performance was excellent without any workload
penalties noted for the EFVS concept tested. A lower DH to 150 ft and/or possibly reduced visibility minima by virtue of
SVS equipage appears to be viable when implemented on a Head-Up Display, but the landing data suggests further study
for head-down implementations.
KEYWORDS: Safety, Visualization, Heads up displays, Telecommunications, Fermium, Frequency modulation, Data communications, Control systems, Interfaces, Algorithm development
By 2025, U.S. air traffic is predicted to increase 3-fold and may strain the current air traffic management system, which
may not be able to accommodate this growth. In response to this challenge, a consortium of industry, academia and
government agencies have proposed a revolutionary new concept for U.S. aviation operations, termed the Next
Generation Air Transportation System or "NextGen". Many key capabilities are being identified to enable NextGen,
including the concept of "net-centric" operations whereby each aircraft and air services provider shares information to
allow real-time adaptability to ever-changing factors such as weather, traffic, flight trajectories, and security. Data-link is
likely to be the primary source of communication in NextGen. Because NextGen represents a radically different
approach to air traffic management and requires a dramatic shift in the tasks, roles, and responsibilities for the flight
deck, there are numerous research issues and challenges that must be overcome to ensure a safe, sustainable air
transportation system. Flight deck display and crew-vehicle interaction concepts are being developed that proactively
investigate and overcome potential technology and safety barriers that might otherwise constrain the full realization of
NextGen.
The Crew Vehicle Interface (CVI) group of the Integrated Intelligent Flight Deck Technologies (IIFDT) has done
extensive research in the area of Synthetic Vision (SV), and has shown that SV technology can substantially
enhance flight crew situation awareness, reduce pilot workload, promote flight path control precision and improve
aviation safety. SV technology is being extended to evaluate its utility for lunar and planetary exploration
vehicles. SV may hold significant potential for many lunar and planetary missions since the SV presentation
provides a computer-generated view of the terrain and other significant environment characteristics independent
of the outside visibility conditions, window locations, or vehicle attributes. SV allows unconstrained control of
the computer-generated scene lighting, terrain coloring, and virtual camera angles which may provide invaluable
visual cues to pilots/astronauts and in addition, important vehicle state information may be conformally displayed
on the view such as forward and down velocities, altitude, and fuel remaining to enhance trajectory control and
vehicle system status. This paper discusses preliminary SV concepts for tactical and strategic displays for a lunar
landing vehicle. The technical challenges and potential solutions to SV applications for the lunar landing mission
are explored, including the requirements for high resolution terrain lunar maps and an accurate position and
orientation of the vehicle that is essential in providing lunar Synthetic Vision System (SVS) cockpit displays. The
paper also discusses the technical challenge of creating an accurate synthetic terrain portrayal using an ellipsoid
lunar digital elevation model which eliminates projection errors and can be efficiently rendered in real-time.
Experiments and flight tests have shown that a Head-Up Display (HUD) and a head-down, electronic moving map
(EMM) can be enhanced with Synthetic Vision for airport surface operations. While great success in ground operations
was demonstrated with a HUD, the research noted that two major HUD limitations during ground operations were their
monochrome form and limited, fixed field of regard. A potential solution to these limitations found with HUDs may be
emerging Head Worn Displays (HWDs). HWDs are small, lightweight full color display devices that may be worn
without significant encumbrance to the user. By coupling the HWD with a head tracker, unlimited field-of-regard may
be realized for commercial aviation applications. In the proposed paper, the results of two ground simulation
experiments conducted at NASA Langley are summarized. The experiments evaluated the efficacy of head-worn
display applications of Synthetic Vision and Enhanced Vision technology to enhance transport aircraft surface
operations. The two studies tested a combined six display concepts: (1) paper charts with existing cockpit displays, (2)
baseline consisting of existing cockpit displays including a Class III electronic flight bag display of the airport surface;
(3) an advanced baseline that also included displayed traffic and routing information, (4) a modified version of a HUD
and EMM display demonstrated in previous research; (5) an unlimited field-of-regard, full color, head-tracked HWD
with a conformal 3-D synthetic vision surface view; and (6) a fully integrated HWD concept. The fully integrated HWD
concept is a head-tracked, color, unlimited field-of-regard concept that provides a 3-D conformal synthetic view of the
airport surface integrated with advanced taxi route clearance, taxi precision guidance, and data-link capability. The
results of the experiments showed that the fully integrated HWD provided greater path performance compared to using
paper charts alone. Further, when comparing the HWD with the HUD concept, there were no differences in path
performance. In addition, the HWD and HUD concepts were rated via paired-comparisons the same in terms of
situational awareness and workload. However, there were over twice as many taxi incursion events with the HUD than
the HWD.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.