Model ranking in the study area

[seyedmohammad19]

Hi
Is it possible for EsmvalTool to introduce models or rank models, that has less bias among the CMIP6 models for my area?

I have 6 variables : evspsbl, pr, rsdt, etc.

For each variable, I want a ranking

Thanks for taking the time to read this.

[bouweandela]

You could have a look at recipe_impact.yml and add a preprocessor function that extracts your area of interest.

[seyedmohammad19]

Hi @bouweandela i was talking about this recipe with @ehogan in discussion #3180 but its closed now...

mr @bouweandela i change the "recipe_impact.yml" a little bit and i got error again

can u plz check the recipe?

"""ESMValTool
#recipe_impact.yml

documentation:
title: Quick insight for climate impact researchers
description: >
This recipe provides quick insight into the spread and performance of multiple models.

authors:

• kalverla_peter
• andela_bouwe
  maintainer:
• kalverla_peter
  project:
• isenes3

datasets:
filenames: ['/home/seyedmohamad/climate_data/data/evspsbl.nc']
#CMIP6

{project: CMIP6, exp: [historical], dataset: ACCESS-ESM1-5, ensemble: r1i1p1f1, grid: gn}
{project: CMIP6, exp: [historical], dataset: CNRM-CM6-1-HR, ensemble: r1i1p1f2, grid: gr}
{project: CMIP6, exp: [historical], dataset: GFDL-ESM4, ensemble: r1i1p1f1, grid: gr1}
{project: CMIP6, exp: [historical], dataset: HadGEM3-GC31-MM, ensemble: r1i1p1f3, grid: gn}
{project: CMIP6, exp: [historical], dataset: IPSL-CM6A-LR, ensemble: r1i1p1f1, grid: gr}
{project: CMIP6, exp: [historical], dataset: MPI-ESM1-2-HR, ensemble: r1i1p1f1, grid: gn}
{project: CMIP6, exp: [historical], dataset: MRI-ESM2-0, ensemble: r1i1p1f1, grid: gn}
{project: CMIP6, exp: [historical], dataset: UKESM1-0-LL, ensemble: r1i1p1f2, grid: gn}

observations: &observations

filename: ['/home/seyedmohamad/climate_data/era/evspsblpot_ERA5.nc']

{mip: Amon, dataset: ERA5, project: native6, type: reanaly, version: v1, tier: 3, tag: observations}

preprocessors:

calculate_anomalies:
custom_order: true
extract_region: &region
start_longitude: 46.0
end_longitude: 49.0
start_latitude: 31.0
end_latitude: 36.5
area_statistics:
operator: mean
anomalies:
period: full
reference: &reference_period
start_year: 1990
start_month: 1
start_day: 1
end_year: 2014
end_month: 12
end_day: 31
standardize: false

climate_statistics:
operator: mean

prepare_for_bias_calculation:
regrid:
scheme: linear
target_grid: 0.5x0.5
extract_region:
<<: *region
extract_time:
<<: *reference_period

diagnostics:
bias_and_change:
description: >
Provide quick insights into the behaviour of each model by plotting the
bias with respect to observations and change with respect to the reference
period.

themes:

• phys
  realms:
• atmos

variables:
ETo_change:
short_name: evspsbl
mip: Amon
tag: model
timerange: '1850/2014'
preprocessor: calculate_anomalies

ETo_bias:
short_name: evspsbl
mip: Amon
tag: model
timerange: '1990/2014'
preprocessor: prepare_for_bias_calculation
additional_datasets: *observations

scripts:
visualize:
script: impact/bias_and_change.py"""

here is the error i got:

ERROR Program terminated abnormally, see stack trace below for more information:

Traceback (most recent call last):
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvalcore/_main.py", line 521, in run
fire.Fire(ESMValTool())
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/fire/core.py", line 141, in Fire
component_trace = _Fire(component, args, parsed_flag_args, context, name)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire
component, remaining_args = _CallAndUpdateTrace(
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace
component = fn(*varargs, **kwargs)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvalcore/_main.py", line 408, in run
self._run(recipe, session)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvalcore/_main.py", line 450, in _run
process_recipe(recipe_file=recipe, session=session)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvalcore/_main.py", line 119, in process_recipe
recipe = read_recipe_file(recipe_file, session)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 78, in read_recipe_file
check.recipe_with_schema(filename)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvalcore/_recipe/check.py", line 53, in recipe_with_schema
recipe = yamale.make_data(filename)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/yamale/yamale.py", line 29, in make_data
raw_data = readers.parse_yaml(path, parser, content=content)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/yamale/readers/yaml_reader.py", line 35, in parse_yaml
return parse(f)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/yamale/readers/yaml_reader.py", line 11, in _pyyaml
return list(yaml.load_all(f, Loader=Loader))
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/yaml/init.py", line 93, in load_all
yield loader.get_data()
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/yaml/constructor.py", line 45, in get_data
return self.construct_document(self.get_node())
File "yaml/_yaml.pyx", line 665, in yaml._yaml.CParser.get_node
File "yaml/_yaml.pyx", line 687, in yaml._yaml.CParser._compose_document
File "yaml/_yaml.pyx", line 731, in yaml._yaml.CParser._compose_node
File "yaml/_yaml.pyx", line 847, in yaml._yaml.CParser._compose_mapping_node
File "yaml/_yaml.pyx", line 860, in yaml._yaml.CParser._parse_next_event
yaml.parser.ParserError: while parsing a block mapping
in "/home/seyedmohamad/esmvaltool/bias.yml", line 4, column 1
did not find expected key
in "/home/seyedmohamad/esmvaltool/bias.yml", line 20, column 3
2023-06-09 20:32:38,446 UTC [26045] INFO

[bouweandela]

The error message means that there is a mistake in the YAML syntax. I would recommend doing a tutorial on YAML and using the yamllint tool to check that your recipe is correct.

[seyedmohammad19]

Hi @bouweandela i excactly run the "recipe_impact.yml"

and this is error i got from bias_and_change script:

version: 2.8.0
work_dir: /home/seyedmohamad/esmvaltool_output/recipe_impact_20230619_193415/work/bias_and_change/visualize

2023-06-19 19:34:49,833 [6949] INFO esmvaltool.diag_scripts.shared._base,550 Creating /home/seyedmohamad/esmvaltool_output/recipe_impact_20230619_193415/work/bias_and_change/visualize
2023-06-19 19:34:49,833 [6949] INFO esmvaltool.diag_scripts.shared._base,550 Creating /home/seyedmohamad/esmvaltool_output/recipe_impact_20230619_193415/plots/bias_and_change/visualize
Traceback (most recent call last):
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvaltool/diag_scripts/impact/bias_and_change.py", line 265, in
main(config)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvaltool/diag_scripts/impact/bias_and_change.py", line 258, in main
plot_htmltable(tidy_df, ancestors, cfg)
File "/home/seyedmohamad/mambaforge/envs/esmvaltool/lib/python3.10/site-packages/esmvaltool/diag_scripts/impact/bias_and_change.py", line 172, in plot_htmltable
.render()
AttributeError: 'Styler' object has no attribute 'render'. Did you mean: '_render'?

[bouweandela]

Great to see that you managed to run the recipe! This issue is due to a change in pandas version 2.0.0. The recipe works with versions of pandas prior to v2.0.0. See also #3196. The upcoming release of ESMValTool (see #3198) will support the latest versions of pandas.