DTIC ADA528575: Aircraft Survivability: Live Fire Test and Evaluation, Fall 2007

1.5 MB·English

by  Defense Technical Information Center

Report Documentation Page Form Approved
OMB No. 0704-0188
Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and
maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information,
including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington
VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it

does not display a currently valid OMB control number.
1. REPORT DATE 3. DATES COVERED
2007 2. REPORT TYPE 00-00-2007 to 00-00-2007
4. TITLE AND SUBTITLE 5a. CONTRACT NUMBER
Aircraft Survivability: Live Fire Test and Evaluation, Fall 2007
5b. GRANT NUMBER
5c. PROGRAM ELEMENT NUMBER
6. AUTHOR(S) 5d. PROJECT NUMBER
5e. TASK NUMBER
5f. WORK UNIT NUMBER
7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) 8. PERFORMING ORGANIZATION
JAS Program Office,200 12th Street South,Crystal Gateway #4, Suite REPORT NUMBER
1103,Arlington,VA,22202
9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR’S ACRONYM(S)
11. SPONSOR/MONITOR’S REPORT
NUMBER(S)
12. DISTRIBUTION/AVAILABILITY STATEMENT
Approved for public release; distribution unlimited
13. SUPPLEMENTARY NOTES
14. ABSTRACT

15. SUBJECT TERMS
16. SECURITY CLASSIFICATION OF: 17. LIMITATION OF 18. NUMBER 19a. NAME OF
ABSTRACT OF PAGES RESPONSIBLE PERSON
a. REPORT b. ABSTRACT c. THIS PAGE Same as 32
unclassified unclassified unclassified Report (SAR)
Standard Form 298 (Rev. 8-98)
Prescribed by ANSI Std Z39-18
Table of Contents
4 News Notes
by Dennis Lindell
Aircraft Survivability is published 6 First National Live Fire Test and Evaluation (LFT&E) Conference in Over 5 Years:
three times a year by the Joint Aircraft Successful, Productive and Vital
Survivability Program Office (JASPO)
chartered by the U.S. Army Aviation by James O’Bryon
& Missile Command, U.S. Air Force It has been more than 5 years since the last national live fire test and evaluation
Aeronautical Systems Center, and U.S. (LFT&E) conference was sponsored at the Naval Postgraduate School in Monterey, CA.
Navy Naval Air Systems Command.
As one would expect, much has changed since then. Not only has terrorism now taken
center stage, but with it have come new threats, new tactics, new technologies, and new
sources of damage. The LFT&E conference held at Charleston Air Force Base (AFB), SC,
in the last week of June 2007 was packed with nearly 60 presentations covering a wide
variety of topics of importance to the LFT&E community.
8 An Historic Perspective on Live Fire Test and Evaluation (LFT&E)
by Lowell Tonnessen
Live fire test and evaluation (LFT&E) has now been a statutorily required program
for more than 20 years, and each year, fewer of us remember its historic origins. In
preparation for this article, I asked a number of professionals to nominate some of
the significant events or ideas that have shaped the history of LFT&E. I’ve selected
15 items that provide a balanced perspective on the scope of LFT&E, the institutions
involved in test and evaluation, and the evolution of LFT&E in practice.
JAS Program Office
200 12th Street South 11 Joint Live Fire/Aircraft Systems Program
Crystal Gateway #4, Suite 1103
by John Murphy and Jon Wheeler
Arlington, VA 22202
An analysis of historical and more recent combat events indicates that our U.S. military
Phone: [phone]
DSN: 327–3509 aircraft—both fixed and rotary wing—continue to be somewhat vulnerable to various
https://jaspo.wpafb.af.mil enemy threats, including uniformed combatants, insurgents, and terrorists. Because of
Views and comments are welcome our nation’s acquisition trend to purchase fewer but more expensive air assets, we must
and may be addressed to the continue to reduce our aircraft vulnerability to enemy threats. Survivability is as much a
Editor necessity for our current air vehicle inventory as it is for our newest acquisitions.
Dennis Lindell
Phone: [phone]
16 H-1 Upgrades Helicopter Live Fire Test and Evaluation (LFT&E) Program
mil [email protected]
b.af. Assistant Editor bTyh Me icUhaneilt eKodu vSatraakteoss aMnda Drianrreel l CLioarrdposn (USMC) H-1 Upgrades program will replace the
af Dale B. Atkinson
p
w [email protected] existing fleet of Bell Helicopter AH-1W Super Cobra attack helicopters and UH-1N
o.
p Huey utility helicopters with improved AH-1Z attack helicopters and UH-1Y utility
s
a
s://j helicopters. The current program calls for buying 180 AH-1Z and 100 UH-1Y aircraft.
p All AH-1Z helicopters will be remanufactured from existing AH-1W aircraft.
htt
7 •
00 20 Excellence in Survivability—Mark Stewart
2
all by Dale Atkinson
F
y • Mr. Mark Stewart is a Principal Systems Engineer at Lockheed Martin in Fort Worth,
bilit TX, where he is the F-35 Technical Lead for Vulnerability Analysis and Live Fire Test.
a Mark graduated from the University of Florida in 1983 with a BS in Mechanical
v
vi
ur Engineering and went to work at General Dynamics after graduation.
S
aft
cr
Air
2
Table of Contents
Mailing list additions, deletions,
changes, and calendar items may
be directed to:
22 CH–53E Joint Live Fire Ballistic Testing
by Joseph Manchor
SURVIAC Satellite Office
Over the past several years, an operational CH-53E aircraft has been undergoing an
13200 Woodland Park Road
extensive series of ballistic tests. The aircraft was acquired in 2004 from the Aerospace Suite 6047
Herndon, VA 20171
Maintenance and Regeneration Center (AMARC) at Davis-Monthan Air Force Base
Fax: [phone]
(AFB). This high-time, but flyable, aircraft was acquired specifically for this testing
Promotional Director
through the assistance and support of the H-53 Heavy Lift Helicopter Program Office
Christina P. McNemar
(PMA-261). The testing itself had been sponsored and funded under the Joint Live
Phone: [phone]
Fire (JLF) program, with the objective of evaluating the vulnerabilities of this aircraft. [email protected]
Lessons learned from this testing can be applied to future vulnerability-reduction
Creative Director
efforts for both the CH-53E and its successor, the CH-53K. K. Ahnie Jenkins
Art Director
24 F-22 Live Fire Test and Evaluation (LFT&E) Program Donald Rowe
by Hugh Griffis Technical Editor
The F-22 Raptor replaces and complements the F-15 Eagle air-superiority fighter. Gina Abruzzese
The F-22 combines stealth design with the supersonic, highly maneuverable, dual-
Newsletter Design
engine, long-range requirements of an air-to-air fighter, and it will have an inherent Maria Candelaria
air-to-ground capability, if needed. The F-22 provides a first of its kind air dominance
Illustrations, Cover Design, Layout
capability with improved capability over current United States Air Force (USAF) Tammy Black
Kacy Cummings
aircraft. The F-22 is designed to defeat the quantitative advantage and emerging
Michelle DePrenger
qualitative equivalency of aircraft employed by air forces worldwide. The F-22 ensures

a clear advantage over future generation fighters. Distribution Statement A:
Approved for public release;
distribution is unlimited, as
27 Lessons Learned from the Implementation of Live Fire Test and Evaluation
submitted under NAVAIR Public
(LFT&E) Program Release Authorization 07-522.
by Hardy Tyson
It is difficult to separate vulnerability reduction from live fire test and evaluation
(LFT&E), even though public law only requires a program to test, evaluate, and
report. In part, this difficulty arises because the law requires that LFT&E “shall
be carried out sufficiently early in the development phase…to allow any design
deficiency demonstrated by the testing to be corrected in the design of the
system…before proceeding beyond low-rate initial production.” The observations
in this article are drawn from the author’s participation in a number of aircraft mil
acquisition programs that included LFT&E. af.
b.
af
p
28 F-35: First-Ever Fixed Wing Full-Up System Level w
o.
by Jeff Johnson and Timothy Staley p
s
a
After 20 years of the live fire test law, nearly every type of aircraft has undergone s://j
testing, paving the way for programs to come. In spite of this long and impressive p
htt
legacy of testing, the F-35 Joint Strike Fighter (JSF) program still marks many firsts. 7 •
0
0
2
all
F
y •
bilit
a
v
vi
ur
S
aft
cr
Air
3
News Notes
n by Dennis Lindell
NDIA Vulnerability aircraft types, under the assumption LV treated less appropriately than other
Reduction Workshop that the case for low vulnerability (LV) warfighter metrics? What programs would
On 17 May 2007, the Combat technology would be different in each of best be approached for low-vulnerability
Survivability Division (CSD) of the the three types. “Case study” briefings design? What should be done about
National Defense Industrial Association were given for each aircraft type: Joint vulnerability reduction? What other
(NDIA) conducted a workshop on Strike Fighter, representing fixed-wing metrics would best feature low vulnerability
aircraft vulnerability reduction, which tactical air; the multi-mission maritime in the requirements, design, and testing
was hosted by the Institute for Defense aircraft (MMA), representing large process? A final report from the workshop,
Analyses (IDA) and sponsored by the fixed-wing aircraft; and the V-22 due out in late summer 2007, will include
Deputy Director, Operational Test and and AH-1 programs, representing actions identified from the workshop and
Evaluation/Live Fire Test and Evaluation helicopters. There were three workshop specific recommendations for the NDIA
(DDOT&E/LFT&E). The objectives breakout sessions, and each focused on CSD to pursue.
of this workshop were to understand one of the aircraft types.
the current environment for applying The Fifth Triennial International
vulnerability-reduction technologies The table below shows some initial results Aircraft Fire and Cabin Safety
to existing and future aircraft and to of the workshop. The results focus on Research Conference
identify steps necessary to improve the five questions that were asked of This conference takes place at the
vulnerability reduction in the future. The the breakout session attendees: Is there Tropicana Casino and Resort in
workshop was designed around three a vulnerability-reduction problem? Is Atlantic City, NJ, from 29 October
through 1 November 2007. It is the
fifth in a series of triennial conferences
Question Helicopters TACAIR Large Aircraft sponsored by international aviation
authorities. These conferences were
1. Is there a problem? Yes Yes: Need LV use Yes: Fire is an issue
established to inform the international
cases in requirements
aviation community about recent,
development; some
ongoing, and planned research activities
LV technologies need
maturation (limited in transport category airplane fire and
R&D funds) cabin safety. The conference addresses
both certification and operational issues.
2. Is LV treated Yes & No Yes & No: it’s the last Yes & No: LV is an
differently? link in the threat kill afterthought in the
chain, but we haven’t design process
mil made the case for LV
af.
b.
af 3. What programs CH-53K, CSAR, Aircraft for which a Not commercial
p
w should best be AH-64, CH-46 credible LV use case aircraft; ask the
o.
p approached? can be developed; warfighter
s
a
ps://j Aol/dCe rc uterrcehnntolyl ougsying
htt
07 • 4. What should Link LV to force Develop LV use cases; Link to safety; educate
0
2 be done? protection KPP; develop vulnerability warfighter and
all educate warfighter and specifications; develop acquisition personnel;
F
y • acquisition personnel; new metrics and M&S; link to force protection
bilit link to safety educate warfighter and KPP; better metrics
a acquisition personnel and M&S
v
vi
ur
S
aft 5. Ideas for new Force sustainability, Personnel casualties; Ties to safety metrics;
cr metrics? recoverability; longer kill levels; ties ties to personnel
Air personnel casualties to safety metrics survivability; ties to
campaign level metrics
Research is being conducted to develop a totally
4
Table 1. Initial workshop breakout session results. fire resistant passenger aircraft cabin.
Research topics covered in the fire In another early study (1964), Mr. Eusanio has provided analytical
sessions include materials fire safety, Mr. Eusanio led a project to determine support for most of the aircraft and
fire resistant materials, cabin and the effectiveness of conventional anti-aircraft programs conducted to date
hidden area protection, burnthrough, munitions in realistic environments, under LFT&E statutory requirements.
engine fire protection, and aircraft cargo such as vegetation and snow. Until He and his IDA team have provided
compartments. Research topics that then, effectiveness estimates were based the Director, Operational Test and
will be covered in the other sessions on a bald earth. The Joint Technical Evaluation (DOT&E) with test and
include crashworthiness, evacuation, Coordinating Group on Munitions evaluation concepts, technical reviews of
and operational issues. Effectiveness (JTCG/ME) later used service test and evaluation strategies, and
these models and data to produce the technical reviews of detailed test plans.
Complete conference details are Joint Munitions Effectiveness Manuals They have monitored key test events and
available at http://www.fire.tc.faa.gov (JMEM) for this type of weapon system, provided independent assessments of the
under the “Conference” tab at the top of which were urgently needed for the completed LFT&E in support of DOT&E’s
the home page. Southeast Asia conflict. reports to the congressional committees.
A number of these test and evaluation
Larry Eusanio Receives In the 1970s and 1980s, Mr. Eusanio’s programs have resulted in substantial
Art Stein LFT&E Award primary emphasis was on the improvements to system survivability
effectiveness of countermeasures as a through changes to aircraft design or
function of various flight profiles. His operational employment.
tradeoff analyses led to identification of
optimal countermeasure suites, tactics, Mr. Eusanio has led initiatives to improve
and flight profiles for Army and Air Force the state of LFT&E, place greater emphasis
standoff aircraft, such as Guardrail, Quick on the evaluation of human casualties,
Fix, and Joint Stars. The Joint Stars project integrate battle damage assessment and
manager unofficially gave Mr. Eusanio repair (BDAR) into LFT&E, and integrate
credit for saving the program from early LFT&E with related safety tests.
cancellation caused by Office of the
Secretary of Defense (OSD) concerns Mr. Eusanio’s academic credentials
about platform survivability. include a BS in Mechanical Engineering
(1956) and an MS in Mechanical
In 1989, Mr. Eusanio moved to the Engineering (1961), both from the
Institute for Defense Analyses (IDA). University of Buffalo, as well as
Mr. Larry Eusanio received the Art Stein It is fitting that he was hired, in part, graduate studies in Operations
Live Fire Test and Evaluation (LFT&E) based on a strong recommendation from Research (1968–1972) from the State
Award on 26 June 2007 at the National Mr. Arthur Stein, an early pioneer of University of New York at Buffalo.
Defense Industrial Association (NDIA) the aircraft survivability discipline. Until He has authored, co-authored, or
LFT&E Conference held at Charleston Air recently, Mr. Eusanio led the Air Systems made major contributions to more mil
Force Base, SC. Mr. Eusanio’s contributions LFT&E project for manned aircraft, anti- than 70 publications in survivability af.
to aircraft survivability began decades air weapons, missile defense systems, and effectiveness. b.
af
p
before the formal requirement for LFT&E. Joint Live Fire (JLF) of aircraft, and w
o.
He spent 33 years at Cornell Aeronautical the Joint Aircraft Survivability Program In summary, Mr. Eusanio has provided p
s
a
Laboratory (later called Calspan) (JASP). He continues his support of sustained analytical contributions s://j
in Buffalo, NY, where he worked on a those programs today. to improve the survivability and p
htt
variety of survivability and effectiveness effectiveness of U.S. military 7 •
programs. One of his first innovations was In 1991, Mr. Eusanio co-authored aircraft and weapon systems. These 00
2
the development of a digital simulation in a briefing to the National Research contributions have received visibility all
F
1961 to conduct end game studies of the Council’s Committee on Weapons at high levels, including OSD and y •
Eagle missile warhead-fuze combination Effects and Airborne Systems. This Congress, and they have addressed all bilit
to speed design tradeoff studies. This briefing concerned the applicability of classes of manned aircraft, including a
v
vi
innovation was one of the first digital end aircraft survivability test and evaluation most of the aircraft currently in the ur
S
game models. Before that time, end game methodologies for the LFT&E of aircraft defense inventory or in the acquisition aft
studies were done manually using physical such as the C-17 and F-22. process. Congratulations Larry! n cr
Air
scale models to work out the geometry.
5
First National Live Fire Test and Evaluation
(LFT&E) Conference in Over 5 Years:
Successful, Productive, and Vital
n by James O’Bryon
It has been more than 5 years since days of discussions. He reminded the presents nearly 800 pages of unclassified
the last National Live Fire Test and attendees that there are really only two LFT&E lessons learned applied to land,
Evaluation (LFT&E) Conference was overarching objectives of LFT&E— sea, and air systems. The CD sorts the
sponsored at the Naval Postgraduate information into several categories,
School in Monterey, CA. As one would n Survivability—Ensuring soldiers, including design changes, crew casualty
expect, much has changed since then. sailors, airmen, and Marines have the reduction, modeling and simulation
Not only has terrorism now taken center equipment that will save their lives adequacy, test planning, LFT&E funding
stage, but with it have come new threats, and resources, battle damage, and repair.
new tactics, new technologies, and new n Lethality—Ensuring these same
sources of damage. people that they can project the Mr. Sayre emphasized the priorities
necessary force to destroy or of the Director, OT&E, Honorable
The conference held at Charleston Air incapacitate the enemy. Dr. Charles McQueary, including
Force Base (AFB), SC, in the last week “providing timely performance
of June 2007 was packed with nearly He went on to screen a recent video clip information to the warfighters.” Mr.
60 presentations covering a wide from Iraq showing an infantry soldier Sayre also stressed the importance of
variety of topics of importance to the being fired upon as he negotiated an “enhancing test realism in early testing,
LFT&E community. urban target. It showed the soldier being including developmental testing.” Other
hit by a threat bullet in the chest, being areas of current activity in the LFT&E
The conference drew a crowd of people knocked to the ground by the force of office include—
from a widely diverse community. Besides the impact, and then getting back up
a strong representation from the Army, and successfully engaging his attacker, n Congressional inquiry and hearings
Navy, Air Force, and Marine Corps, thanks to the body armor he was wearing. on body armor
other government participants included
the Office of the Secretary of Defense A quick survey of the conference audience n Congressional inquiry on
(OSD), Director, Operational Test and indicated that although a significant combat helmets
Evaluation (DOT&E), Department of number of conference participants had
Homeland Security (DHS), Government been working on LFT&E issues for a n Participation on joint improvised
Accountability Office (GAO), National number of years, it was the first LFT&E explosive device (IED) defeat/joint
milmil Aeronautics and Space Administration conference for many, and many had test board
af.af. (NASA), Department of Energy (DOE), been working on LFT&E issues for less
afb.afb. and Defense Threat Reduction Agency than five years. It was encouraging n Uparmor initiatives on high mobility
pp
ww (DTRA). Mr. Douglas Bruder, Director, to see new people embarking on this multipurpose wheeled vehicle
o.o.
pp Counter Weapons of Mass Destruction important work. However, the presence (HMMWV), trucks, and LTAS
ss
aa
s://js://j (WMD) Technologies Directorate, of these newcomers also made clear
pp DTRA, gave the keynote presentation. the importance of ensuring the LFT&E n Lethality assessment of the
htthtt
7 7 •• Nearly 70 government and non- lessons learned to date are communicated M855 5.56mm ball round in
0000 governmental agencies were represented clearly and promptly to those entering current operations
22
all all at the conference, including all military the LFT&E workforce.
FF
y y •• branches and numerous defense n Standardization of wound ballistics
bilitbilit hardware contractors, defense study In light of the newcomers, the Deputy test and assessment methodologies.
aa agencies, test ranges, and universities Director, OT&E/LFT&E authorized each
vv
vivi
urur performing work for the Department of conference participant to receive a copy An update was also presented on
SS
aft aft Defense (DoD) and DHS. of the CD “LFT&E Lessons Learned from the additional congressional LFT&E
crcr Live Fire Testing: Insights Into Designing, oversight requirements placed on the
AirAir
Mr. Richard Sayre, the newly minted Testing, and Operating U.S. Air, Land, Deputy Director OT&E/LFT&E in light
Deputy Director, OT&E/Live Fire and Sea Combat Systems for Improved of Operation Enduring Freedom and
66
Testing, set the tone for the entire four Survivability and Lethality.” [1] This CD Operation Iraqi Freedom. The FY07
National Defense Authorization Act crew casualties were each addressed. outstanding achievement in support of
(NDAA), Subtitle D, Section 231 adds Several presentations provided combat LFT&E. Mr. Richard Sayre presented this
the following to Section 139 of the Act: feedback on LFT&E issues, including year’s award to Mr. Larry Eusanio of IDA
“OT&E and/or Survivability testing of Force presentations from aeromedical for his outstanding analytical support of
Protection Equipment (including non-lethal evacuation crew (AEC), ARL, and LFT&E. Mr. Eusanio’s more than 50-year
weapons).” SURVICE engineering. career of outstanding service, beginning
at Cornell Aeronautical Laboratory in
Furthermore, this FY07 NDAA The conference understandably had an western New York and continuing at the
modifies Title 10, Section 2399 of the unusually high emphasis on battle damage IDA as a leader of the LFT&E aircraft
Act to read, “Operational use of a system and repair. There was also a significant group, along with his numerous technical
(or use of procurement funds) prior to focus on the vulnerability of aircraft to articles and presentations made him the
full-rate production decision review, surface-to-air threats (e.g., RPGs, man- obvious choice for this year’s award.
the Director [DOT&E] will submit a portable air defense system [MANPADS],
report to Congress on test adequacy and small arms fire), particularly helicopters As a side note, although Mr. Art Stein
effectiveness and suitability.” and large commercial aircraft being passed away more than a decade ago,
modified for military use (e.g., tankers, his wife Dr. Annette Stein remains very
This congressional language patrol aircraft, cargo). engaged in a number of community
demonstrates Congress’s awareness pursuits near her home in Buffalo, NY.
that some smaller systems and upgrades Interestingly, although the bulk of DoD When she was contacted about the
fall below the level of a major system; aircraft procurement funds are being possibility of Mr. Eusanio being named
however, because these systems are vital directed at purchasing fixed-wing fighters for the award, her response was, “I can’t
to the current conflict, they still require (F-22, F-35, F/A-18E/F, etc.), the focus of think of a person who is more deserving.
some DOT&E oversight even though the conference was not on small fighter My husband knew Larry very well and
they might not follow the traditional aircraft but rather on helicopters and large had great respect for him.” We were
Milestone ABC paths of major systems. transport aircraft, reflecting the concerns sorry that her overseas travel prevented
of those in the combat theater. her from joining us in Charleston for this
Early on in the conference, a survey of special presentation.
the conference participants revealed that A number of briefings were also given
nearly half of them did not know what the to describe new LFT&E facilities that When given the choice of when to have
Survivability/Vulnerability Information have recently come online, including the next National Defense Industrial
Analysis Center (SURVIAC) is or how to UNDEX upgrades, tactical telemetry Association (NDIA) LFT&E conference
access it to support their LFT&E activities. improvements, China Lake’s Missile (either in 2, 3, 4, or 5 years), more than
Hence, the tutorials presented on the Engagement Threat Simulator, directed- 70 percent of the conference attendees
first day were especially valuable to those energy warfare (DEW) facilities, and indicated that 2 years was as long as they
unfamiliar with SURVIAC and the value improved metrology capabilities. wanted to wait. Because of this, NDIA is
it can bring in support of LFT&E. Four now working on finding the appropriate
tutorials were presented addressing the location, hosts, and sponsors for the
mil
SURVIAC, Weapons Systems Technology conference. If you wish to be involved, af.
Information Analysis Center (WSTIAC), please contact Mr. Sam Campagna, NDIA, b.
af
Automated Joint Threat Systems at [email protected]. n wp
o.
Handbook (AJTSH), and Joint Aircraft p
s
Survivability Program Office (JASPO) Reference s://ja
“Threat Effects Video.” 1. CDs (FOUO) can be purchased on a need to p
htt
know basis from SURVIAC. 7 •
Dr. Lowell Tonnessen and Dr. Lenny 00
2
Truett, both of Institute for Defense About the Author all
F
Analyses (IDA), and Mr. Marty Lentz Mr. James O’Bryon served as the first y •
of Wright-Patterson Air Force Base Director, Live Fire Testing, OSD from bilit
(WPAFB) gave informative presentations Larry Eusanio (left) is congratulated by 1986–2001. He now serves as a consultant va
vi
on the history and practices of LFT&E. Mr. Richard Sayre (right) during presentation on national defense and homeland ur
S
of the Arthur Stein Award. security, and as Chairman of the Test aft
The presentations also heavily and Evaluation Division of NDIA. cr
Air
emphasized casualty reduction, which The highlight of the conference was the
is the statutory focus of LFT&E. presentation of the Arthur Stein Award.
7
Aircrew, land vehicle crews, and ship This award is periodically presented for
An Historic Perspective on Live Fire Test
and Evaluation (LFT&E)
n by Dr. Lowell Tonnessen
States Code [U.S.C.]). Among its features
Editor’s Note was a requirement for side-by-side testing
The following is a transcript of Dr. Tonnessen’s presentation from the Live Fire Test of armored vehicles against the system it
and Evaluation (LFT&E) Conference in Charleston, SC, held on 25–28 June, 2007. was intended to replace. This statute was
rescinded in 1994.
Congress Passes a Statutory
Live fire test and evaluation (LFT&E) Director, Defense Test and Evaluation in
Requirement for Survivability
has now been a statutorily required March 1984. It differed primarily from
and Lethality LFT&E (1986)
program for more than 20 years, and later LFT&E in that JLF was funded by the
In 1986 (FY87), the requirement for live fire
each year, fewer of us remember its Office of the Secretary of Defense (OSD),
testing of armored vehicles was expanded
historic origins. In preparation for this rather than the program being tested.
to require survivability LFT&E of all major
article, I asked a number of professionals Also, JLF tested fielded systems, rather
manned platforms (land, sea, and air) that
to nominate some of the significant than systems undergoing acquisition. Like
provide some degree of protection to the
events or ideas that have shaped the LFT&E, however, it emphasized the need
user, and lethality LFT&E for munitions
history of LFT&E. I’ve selected 15 items for system evaluations that are based on
and missile programs. Section 2366, Title
that provide a balanced perspective on realistic survivability and lethality testing.
10, U.S.C. is what is commonly known as
the scope of LFT&E, the institutions JLF continues as a strong test program that
the “LFT&E law.”
involved in test and evaluation, and complements LFT&E. It is administered by
the evolution of LFT&E in practice. I’ll OSD’s Office of the Director, Operational
present them in their historic order. Test and Evaluation (DOT&E).
Joint Live Fire (JLF) The Army Conducts Live Fire
Test Charter (1984) Testing of the Bradley Fighting
The JLF test program preceded the statutory Vehicle (1984–1987)
requirement for LFT&E. It resulted from a The Bradley tests began as a JLF program,
perceived absence of data from full scale but Phase II was conducted as an Army
vulnerability and lethality testing. The live fire test, with oversight from OSD.
Joint Logistics Commanders endorsed This live fire test was conducted under
mil the proposed test in December 1983, and substantial scrutiny of the Congress and
b.af. the JLF test charter was signed by the national media. Together with later tests
paf of the M1A1 Abrams tank, the Bradley live
w
o. fire test established disciplined standards
p Figure 2. An Abrams live fire test. Realistic
as for realistic testing and developed many of
s://j the procedures that have become standard testing provides a basis for understanding the
p effects of combat hits.
htt practice for subsequent armored vehicle
7 • vulnerability testing. (See Figure 1. and 2.)
0
20 JLF Tests are Used to Support
all Congress Passes a Statutory LFT&E of the F/A-18 (1991–2000)
F
y • Requirement for LFT&E of Through the years, numerous JLF tests
bilit Armored Vehicles (1985) have supported the LFT&E of acquisition
a
v
vi The first statutory requirement addressed programs. A prime example is the JLF
ur
S only armored vehicles. During the tests that were done on earlier models of
aft controversy concerning testing of the the F/A-18 and whose results were then
cr
Air Bradley, Congress passed a statutory incorporated into the F/A-18E/F LFT&E
Figure 1. The Bradley was tested in a full-up
requirement for LFT&E of armored program. Aircraft Survivability describes
configuration, with a standard load of fuel
8 vehicles (Section 2362 of Title 10, United these tests in its summer 2004 issue.
and munitions.
The Army Research practice for ship LFT&E. These included 1994, LFT&E responsibility had been in
Laboratory (ARL) Develops the a total ship survivability trial (TSST), various offices in the developmental side
Operational Requirements-based which addressed recoverability and of OSD. At one time, responsibility for
Casualty Assessment (ORCA) crew response to damages that might air and space programs was separated
Model to Assess Personnel be suffered by a ship after impact by a from land and maritime programs.
Casualties (1992) threat weapon. The DDG 53 and its crew The 1994 FASA act linked LFT&E and
The LFT&E law requires that LFT&E give experienced the first TSST. The DDG 51 operational test and evaluation (OT&E)
primary emphasis to user casualties. There program also established an analytical and laid the foundation for a unified
have been several methods for estimating approach called a Damage Scenario- assessment of effectiveness, suitability,
whether an impacted crew member Based Engineering Analysis (DSBEA) as and survivability. (See Figure 3.)
can perform the necessary functions. standard practice for LFT&E. The DSBEA
An early incapacitation methodology to approach employs an in-depth analysis Dynamic Rotor Blade Testing
evaluate the effectiveness of fragmenting for a limited number of damage scenarios Introduces a New Level of
munitions against infantry personnel was using all available analytical means, Realism to Helicopter Live Fire
developed by Sperazza and Kokinakis including both computer modeling Testing (1998)
(c. 1965). The ComputerMan Model and human engineering judgment. Until the landmark JLF tests in China
initially was developed in 1980 to Typically, a DSBEA will address only Lake in 1998, rotor blade vulnerability
overcome some of the limitations of the 20–30 scenarios. This approach is in had been limited to static loaded testing,
Sperazza-Kokinakis methodology and contrast to many vulnerability models sometimes with follow-on dynamic
to provide new casualty assessment that address hundreds or thousands of spin-up of the rotor blades to determine
capabilities. It is based on an extensive impact scenarios, but with significant dynamic effects. China Lake developed
empirical wound ballistics database and limitations in scope or validity. The the test technology to impact a moving
on interviews with pilots to determine intent of a DSBEA analysis is to predict, rotor blade on a helicopter system. The JLF
whether they could perform the functions through analysis and limited testing, the tests of AH-1 helicopters demonstrated
necessary for controlled flight with chain of events that might occur after an cascading effects that would not have
specified types of injuries. ComputerMan actual threat attack. been observed in static testing, and thus
is implemented within MUVES-S2. The brought increased test realism to the
ORCA model, whose development began Congress Establishes DOT&E LFT&E of helicopter programs.
in 1992, incorporates ComputerMan but as the Oversight Authority for
expands the modeling and simulation to LFT&E (1994) The Sense and Destroy Armor
address non-ballistic effects. The 1994 Federal Acquisition (SADARM) LFT&E Program
Streamlining Act (FASA) transferred Includes End-to-End Lethality
Survivability Testing of F-22 LFT&E responsibility to DOT&E. Testing (1998)
Wing Demonstrates Value of The original law had specified the No LFT&E program for a munition
Early Live Fire Testing (1992) Secretary of Defense as responsible for or missile has ever needed a waiver
Early in the program, the F-22 program LFT&E, but did not establish a director from full-up, system-level testing. In
conducted a preliminary hydrodynamic of LFT&E or delegate responsibility to part, this is due to LFT&E programs mil
ram test series of a wing box to determine a particular office within OSD. Until that include end-to-end shots that are af.
whether it could survive impact from b.
af
p
threat munitions. The test results were w
Operational Effectiveness Operational Suitability Operational Survivability o.
sufficiently definitive that the wing design p
s
a
was changed. This was only possible Mission Effectiveness Reliability Susceptibility s://j
beaerclayu isne ththe ep rtoegsrta mha. dA lbaeteern livceo nfidrue ctteesdt Aircraft Performance Maintainability (cid:115)(cid:115) (cid:0)AEWSVE uS Elufnfseeccertapivbteibinlieilitstyys 7 http•
in 2001 confirmed the ballistic tolerance 00
of the new wing design. (cid:115)(cid:115) BE3a lVlisutlince Troableirliatnyce all 2
F
DADnaGl y5t1ic Easl tAapbplirsohaecsh a tno Conduct Net Ready Operating Environments (cid:115)(cid:115) (cid:0)FCCorrearwsche Bw aPolrlritoshttiinecec Pstsriootnection vability •
LFT&E of Ships (1994) Logistics Support Repairability urvi
S
Tfohre LNFaTv&y En oinm iAnaptreidl 1th9e8 7D. DTGhe 51L FCTl&asEs (cid:115) (cid:0)BAasstteles sDmaemnat gaen d Repair craft
Safety Air
strategy was gradually refined, and by
1994 that strategy included many of the Figure 3. DOT&E provides an integrated assessment of operational effectiveness,
9
features that would become standard suitability, and survivability.