Task requested on farm.zimit.kiwix.org with too much memory

[benoit74]

We have a task on farm.zimit.kiwix.org which requests more memory than mwoffliner workers have available:

I removed the task on the farm.

Is it an issue to fix on WP1 side or was this just a test?

[audiodude]

Here's the logic that WP1 uses for requesting resources:

https://github.com/openzim/wp1/blob/main/wp1/logic/selection.py#L187

I don't remember how that was determined, but you can see that it's variable.

[kelson42]

To me it seems that this selection would have more than 5M of lines! We should not propose to do that. This infra is not conceived to make very large ZIM files.

[benoit74]

At least, the resources should be capped to worker resources.