Title
A methodology for certification of modeling and simulation applications
Abstract
Certification of modeling and simulation (M&S) applications poses significant technical challenges for M&S program managers, engineers, and practitioners. Certification is becoming increasingly more important as M&S applications are used more and more for military training, complex system design evaluation, M&S-based acquisition, problem solving, and critical decision making. Certification, a very complex process, involves the measurement and evaluation of hundreds of qualitative and quantitative elements, mandates subject matter expert evaluation, and requires the integration of different evaluations. Planning and managing such measurements and evaluations requires a unifying methodology and should not be performed in an ad hoc manner. This paper presents such a methodology. The methodology consists of the following body of methods, rules, and postulates: (a) employment of subject matter experts, (b) construction of a hierarchy of indicators, (c) relative criticality weighting of indicators using the analytic hierarchy process, (d) using a rule-based expert knowledge base with an object-oriented specification language, (e) assignment of crisp, fuzzy, and nominal scores for the indicators, (f) aggregation of indicator scores, (g) graphical representation of the indicator scores and weights, (h) hypertext certification report, and (i) interpretation of the results. The methodology can be used for certification of any kind of M&S application either throughout the M&S development life cycle or after the development is completed.
Year
DOI
Venue
2001
10.1145/508366.508369
ACM Trans. Model. Comput. Simul.
Keywords
Field
DocType
validation,indicator score,subject matter expert evaluation,evaluation,different evaluation,certification,hypertext certification report,quality assessment,credibility assessment,development life cycle,verification,analytic hierarchy process,simulation application,unifying methodology,rule-based expert knowledge base,complex system design evaluation,complex process,accreditation,object oriented,life cycle,subject matter expert,modeling and simulation,specification language,rule based,complex system
Specification language,Mathematical optimization,Subject-matter expert,Computer science,Operations research,Accreditation,Software development process,Knowledge base,Hierarchy,Certification,Management science,Analytic hierarchy process
Journal
Volume
Issue
Citations 
11
4
25
PageRank 
References 
Authors
2.99
17
1
Name
Order
Citations
PageRank
Osman Balci1872175.02