Starting Point: CEN Workshop Agreement
We have developed novel methods for the comparison of predictive numerical models with full-field experimental data in order to achieve a robust, quantitative validation of the simulation. In particular an understanding has been gained of the uncertainties in simulation and experimental data and their influence on predictions and measurements.
Criteria allowing an easy comparison and interpretation of data have been embedded in novel correlation methods that allow confidence in simulations to be established, supported by the quantifcation of 'the degree to which a model is an accurate representation of the real world from the perspective of the intended uses of the model', as the ASME definition of validation reads. Work at ULIV has demonstrated that feature vectors, obtained via image decomposition, can be used to generate relative error metrics. This preliminary work is being integrated with the prior work embedded in the CEN guideline to produce a validation methodology.
The MOTIVATE Validation Flowchart, reproduced below, forms the basis of the MOTIVATE Protocol which can be downloaded from Zenodo, together with a GUI that guides the user through the validation process step by step. A key novel feature is the evaluation of historical data. In addition, the development of the model takes priority, while physical testing is performed only if required. The processes involved are shown as coloured boxes. This includes the decision sequence required to evaluate historical data for use in the validation process and the quantitative validation process described in the recently published CEN guide. To allow for an unbiased comparison of the data sets, it is recommended to implement a “double blind” procedure, in which interaction of the testing and modelling teams are only allowed as far as to clarify and agree on test object, boundary conditions and load cases. Then, data are generated by experiment (blue box) and by simulation (orange box) independently, and the results are transferred to an independent validation team who is in charge of the Quantitative Comparison (red box). It should be noted that, prior to starting the validation process, it will be necessary for decision-makers to state their expectations so that appropriate decision criteria can be adopted, for instance requirements for measurement uncertainty. While this activity of the decision-makers was not within the brief of the MOTIVATE project, their review at the end of the process is shown for completeness and comparison with the existing ASME flowchart