zstash a whole ensemble or individual members?

[wagmanbe]

The e3sm step-by-step guide demonstrates how to zstash simulations separately using a loop. The DECKv1 members are archived separately, consistent with the example.

Why not archive ensemble members together? Is there a reason not to do that? I have 250 ensemble members (34 TB). If I wanted to extract all 250, or a subset of files from all 250, wouldn't it be easier if they were archived together?

[forsyth2]

Hi @wagmanbe,

First I want to note that if you're using the latest Unified environment you should be using the updated instructions.

I'm not quite sure I understand the question. Are you asking why the HPSS path is //nersc/home/<first letter>/<username>/E3SMv2/${EXP} rather than say //nersc/home/<first letter>/<username>/E3SMv2/<ensemble-name>/${EXP}?

[golaz]

@wagmanbe,

If you have all your simulations in a common directory, you could certainly try to archive all of them at once. I don't think there is anything within zstash that would prevent from you doing so.

There are pros and cons to both approaches.

• Pro: simplicity of dealing with only a single zstash archive.
• Con: possibly reduced performance due to more sequential work.