2.4 Flight simulation training device qualification

2.4.1 In dealing with FSTDs, NAAs differentiate between the technical criteria of the FSTD and its use for

training/testing and checking. Qualification is achieved by comparing the FSTD performance against the criteria

specified in the Qualification Test Guide (QTG) for the qualification level sought.

2.4.2 The validation, functions and subjective tests required in the QTG enable the NAA to “spot check” the

performance of the FSTD. Without such “spot checking”, using the QTG, the FSTD performance could not be verified

in the time normally available for the authority evaluation. It should be understood that the QTG does not perform a

rigorous examination of the quality of the simulation in all areas of flight and systems operation. The full testing of the

FSTD is intended to have been completed by the FSTD manufacturer and its operator prior to the FSTD being offered

to the NAA for evaluation and prior to the offer of the results in the QTG. This testing is a fundamental part of the

whole cycle of testing and is normally carried out by following acceptance and testing procedures contained in

documents which also provide a medium to record the test results. These documents will direct testing of the

functionality and performance in many areas of the simulation that are not addressed in the QTG as well as such items

as the Instructor Operating Station, etc.

2.4.3 Once the FSTD has been qualified, the authority responsible for oversight of the activities of the user of

the FSTD can approve what training tasks can be carried out. This determination should be based on the FSTD

qualification, the availability of FSTDs, the experience of the FSTD user, the training programme in which the FSTD is

to be used and the experience and qualifications of the pilots to be trained. This latter process results in the approved

use of an FSTD within an approved training programme.

2.5 Testing for flight simulation training device qualification

2.5.1 The FSTD should be assessed in those areas which are essential to completing the flight crew member

training, testing and checking process. This includes the FSTD’s longitudinal and lateral-directional responses;

performance in take-off, climb, cruise, descent, approach and landing; all-weather operations; control checks; and pilot,

flight engineer and instructor station functions checks. The motion, visual and sound systems will be evaluated to

ensure their proper operation.

2.5.2 The intent is to evaluate the FSTD as objectively as possible. Pilot acceptance, however, is also an

important consideration. Therefore, the FSTD will be subjected to the validation tests listed in Appendix B of this Part

and the functions and subjective tests in Appendix C. Validation tests are used to compare objectively FSTD and

aeroplane data to ensure that they agree within specified tolerances. Functions tests are objective tests of systems using

aeroplane documentation. Subjective tests provide a basis for evaluating the FSTD capability to perform over a typical

training period and to verify correct operation and handling characteristics of the FSTD.

2.5.3 Tolerances listed for parameters in Appendix B should not be confused with FSTD design tolerances and

are the maximum acceptable for FSTD qualification.

2.5.4 The validation testing for initial and recurrent evaluations listed in Appendix B should be conducted in

accordance with the FSTD Type against approved data. An optional process for recurrent evaluation using MQTG

results as reference data is described in Attachment H in Volume I, Part II of this manual.

2.5.4.1 Where the fidelity level is S, the initial and recurrent evaluations should be based on objective

evaluation against approved data. For evaluation of FSTDs representing a specific aeroplane type, the aeroplane

manufacturer’s validation flight test data is preferred. Data from other sources may be used, subject to the review and

concurrence of the NAA responsible for the qualification. The tolerances listed in Appendix B are applicable for the

initial evaluation. Alternatively, the recurrent evaluation can be based on objective evaluation against MQTG results as

described in Attachment H in Volume I, Part II of this manual.

2.5.4.2 Where the fidelity level is R, the initial and recurrent validation will be based on objective evaluation

against approved data for a class of aeroplane with the exception of aeroplane type specific FSTDs (sound and motion

systems) where these evaluations are against aeroplane type specific data. For initial evaluation of FSTDs representing

a class of aeroplane, the aeroplane manufacturer’s validation flight test data is preferred. Data from other sources may

be used, subject to the review and concurrence of the NAA responsible for the qualification.

2.5.4.2.1 For motion and sound systems, where approved subjective development is submitted for the initial

evaluation, the QTG should contain both:

III-2-8

Manual of Criteria for the Qualification

of Flight Simulation Training Devices

a) the original objective test results showing compliance to the validation flight test data; and

b) the "improved" results, based upon approved subjective development against the validation flight

test data. If approved subjective development is used, the MQTG result for those particular cases

will become the reference data standard. Recurrent validations should be objectively measured

against the reference data standard.

2.5.4.2.2 The tolerances listed in Appendix B are applicable for both initial and recurrent evaluations except

where approved subjective development is used for motion and sound systems.

2.5.4.2.3 Alternatively, the recurrent evaluation can be based on objective evaluation against MQTG results as

described in Attachment H in Volume I, Part II of this manual.

2.5.4.3 Where the fidelity level is G, the initial validation will be based on evaluation against approved data

where available, complemented if necessary by approved subjective development, to determine a reference data

standard. Correct trend and magnitude (CT&M) tolerances can be used for the initial evaluation only. Recurrent

validations should be objectively measured against the reference data standard. The tolerances listed in Appendix B are

applicable for recurrent evaluations and should be applied to ensure the device remains at the standard initially

qualified.

2.5.5 Requirements for generic or representative FSTD data are defined below.

2.5.5.1 Generic or representative data may be derived from a specific aeroplane within the class of

aeroplanes the FSTD is representing or it may be based on information from several aeroplanes within the class. With

the concurrence of the NAA, it may be in the form of a manufacturer’s previously approved set of validation data for

the applicable FSTD. Once the set of data for a specific FSTD has been accepted and approved by the NAA, it will

become the validation data that will be used as reference for subsequent recurrent evaluations with the application of

the stated tolerances.

2.5.5.2 The substantiation of the set of data used to build validation data should be in the form of a

"Reference Data" engineering report and shall show that the proposed validation data are representative of the

aeroplane or the class of aeroplanes modelled. This report may include flight test data, manufacturer’s design data,

information from the aeroplane flight manual (AFM) and maintenance manuals, results of approved or commonly

accepted simulations or predictive models, recognized theoretical results, information from the public domain, or other

sources as deemed necessary by the FSTD manufacturer to substantiate the proposed model.

2.5.6 In the case of new aeroplane programmes, the aeroplane manufacturer’s data, partially validated by flight

test data, may be used in the interim qualification of the FSTD. However, the FSTD should be re-qualified following

the release of the manufacturer’s data resulting from the type certification of the aeroplane. The re-qualification

schedule should be as agreed by the NAA, the FSTD operator, the FSTD manufacturer and the aeroplane manufacturer.

For additional information, refer to Attachment A in Part II of this document.

2.5.7 FSTD operators seeking initial or upgrade evaluation of an FSTD should be aware that performance and

handling data for older aeroplanes may not be of sufficient quality to meet some of the test standards contained in this

manual. In this instance it may be necessary for an FSTD operator to acquire additional flight test data.

2.5.8 During FSTD evaluation, if a problem is encountered with a particular validation test, the test may be

repeated to ascertain if test equipment or personnel error caused the problem. Following this, if the test problem

persists, an FSTD operator should be prepared to offer alternative test results which relate to the test in question.

2.5.9 Validation tests which do not meet the test criteria should be satisfactorily rectified.