Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Runs out of memory for bigger examples #6

Open
Julia820 opened this issue Dec 15, 2022 · 2 comments
Open

Runs out of memory for bigger examples #6

Julia820 opened this issue Dec 15, 2022 · 2 comments

Comments

@Julia820
Copy link
Contributor

For bigger example combined from five files from ENCODE uniwig runs out of memory (32GB). The memory usage increases slowly for processing starts and it's not cleaned after program is done with starts. Similar thing happens for ends and for core there isn't memory left. I've put the problematic file in test folder under name test_big.bed and it sorted version tes_big_sorted.bed

@nleroy917
Copy link
Member

I just got an oom kill as well:

slurmstepd: error: Detected 1 oom-kill event(s) in StepId=49580627.batch. Some of your processes may have been killed by the cgroup out-of-memory handler.

This was in slurm. I used #SBATCH --mem=12000. Retrying with #SBATCH --mem=128G

@nsheff
Copy link
Member

nsheff commented May 9, 2023

if using that much memory, make sure to use the largemem queue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants