Abstract | ||
---|---|---|
Certification of modeling and simulation (M&S) applications poses significant technical challenges for M&S program managers, engineers, and practitioners. Certification is becoming increasingly more important as M&S applications are used more and more for military training, complex system design evaluation, M&S-based acquisition, problem solving, and critical decision making. Certification, a very complex process, involves the measurement and evaluation of hundreds of qualitative and quantitative elements, mandates subject matter expert evaluation, and requires the integration of different evaluations. Planning and managing such measurements and evaluations requires a unifying methodology and should not be performed in an ad hoc manner. This paper presents such a methodology. The methodology consists of the following body of methods, rules, and postulates: (a) employment of subject matter experts, (b) construction of a hierarchy of indicators, (c) relative criticality weighting of indicators using the analytic hierarchy process, (d) using a rule-based expert knowledge base with an object-oriented specification language, (e) assignment of crisp, fuzzy, and nominal scores for the indicators, (f) aggregation of indicator scores, (g) graphical representation of the indicator scores and weights, (h) hypertext certification report, and (i) interpretation of the results. The methodology can be used for certification of any kind of M&S application either throughout the M&S development life cycle or after the development is completed. |
Year | DOI | Venue |
---|---|---|
2001 | 10.1145/508366.508369 | ACM Trans. Model. Comput. Simul. |
Keywords | Field | DocType |
validation,indicator score,subject matter expert evaluation,evaluation,different evaluation,certification,hypertext certification report,quality assessment,credibility assessment,development life cycle,verification,analytic hierarchy process,simulation application,unifying methodology,rule-based expert knowledge base,complex system design evaluation,complex process,accreditation,object oriented,life cycle,subject matter expert,modeling and simulation,specification language,rule based,complex system | Specification language,Mathematical optimization,Subject-matter expert,Computer science,Operations research,Accreditation,Software development process,Knowledge base,Hierarchy,Certification,Management science,Analytic hierarchy process | Journal |
Volume | Issue | Citations |
11 | 4 | 25 |
PageRank | References | Authors |
2.99 | 17 | 1 |
Name | Order | Citations | PageRank |
---|---|---|---|
Osman Balci | 1 | 872 | 175.02 |