Understanding climate change impacts on global marine ecosystems and fisheries requires complex marine ecosystem models, forced by global climate projections, that can robustly detect and project changes. The Fisheries and Marine Ecosystems Model Intercomparison Project (FishMIP) uses an ensemble modelling approach to fill this crucial gap. Yet FishMIP does not have a standardised skill assessment framework to quantify the ability of member models to reproduce past observations and to guide model improvement. In this study, we apply a comprehensive model skill assessment framework to a subset of global FishMIP models that produce historical fisheries catches. We consider a suite of metrics and assess their utility in illustrating the models’ ability to reproduce observed fisheries catches. Our findings reveal improvement in model performance at both global and regional (Large Marine Ecosystem) scales from the Coupled Model Intercomparison Project Phase 5 and 6 simulation rounds. Our analysis underscores the importance of employing easily interpretable, relative skill metrics to estimate the capability of models to capture temporal variations, alongside absolute error measures to characterise shifts in the magnitude of these variations between models and across simulation rounds. The skill assessment framework developed and tested here provides a first objective assessment and a baseline of the FishMIP ensemble’s skill in reproducing historical catch at the global and regional scale. This assessment can be further improved and systematically applied to test the reliability of FishMIP models across the whole model ensemble from future simulation rounds and include more variables like fish biomass or production.

There is an urgent need for models that can robustly detect past and project future ecosystem changes and risks to the services that they provide to people. The Fisheries and Marine Ecosystem Model Intercomparison Project (FishMIP) was established to develop model ensembles for projecting long-term impacts of climate change on fisheries and marine ecosystems while informing policy at spatio-temporal scales relevant to the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP) framework. While contributing FishMIP models have improved over time, large uncertainties in projections remain, particularly in coastal and shelf seas where most of the world’s fisheries occur. Furthermore, previous FishMIP climate impact projections have mostly ignored fishing activity due to a lack of standardized historical and scenario-based human activity forcing and uneven capabilities to dynamically model fisheries across the FishMIP community. This, in addition to underrepresentation of coastal processes, has limited the ability to evaluate the FishMIP ensemble’s ability to adequately capture past states - a crucial step for building confidence in future projections. To address these issues, we have developed two parallel simulation experiments (FishMIP 2.0) on: 1) model evaluation and detection of past changes and 2) future scenarios and projections. Key advances include historical climate forcing, that captures oceanographic features not previously resolved, and standardized fishing forcing to systematically test fishing effects across models. FishMIP 2.0 is a key step towards a detection and attribution framework for marine ecosystem change at regional and global scales, and towards enhanced policy relevance through increased confidence in future ensemble projections.