A large Celery queue

[dxdx123]

Describe the issue

I uploaded an Excel file with 460,000 entries as the source file, along with translations in 4 languages. The Celery queue is currently extremely large, reaching millions of tasks. It has been running for 2 days, and the consumption rate is still very slow. Is there any way to cancel the queue?

I already tried

• I've read and searched the documentation.
• I've searched for similar filed issues in this repository.

Steps to reproduce the behavior

Upload the Excel file to the Git repository and synchronize the Git repository on Weblate.

Expected behavior

No response

Screenshots

Exception traceback

No response

How do you run Weblate?

Docker container

Weblate versions

No response

Weblate deploy checks

No response

Additional context

No response

[dxdx123]

Can I stop using the command directly? And delete the redis data at the same time
Will there be any problems:

docker-compose exec --user weblate weblate supervisorctl stop celery-memory

---

notify queue:
I tried to delete notify from reids. After restarting celery-notify, weblate started to perform subsequent tasks.

After deleting notify from reidis, reidis memory usage dropped by 50%, and the load on the ec2 instance also dropped from 5 to 1. I don’t know if I can use the same method to clear the memory queue. I don’t know exactly what this queue does.

[nijel]

The memory queue is used for translation memory updates. When you discard it, you can always rebuild it from scratch.

What Weblate version do you use? The 5.9 release heavily improved these operations.

[dxdx123]

5.5.5

[github-actions]

This issue has been marked as a question by a Weblate team member. Why? Because it belongs more to the professional Weblate Care or community Discussions than here. We strive to answer these reasonably fast here, too, but purchasing the support subscription is more responsible and faster for your business. And it makes Weblate stronger as well. Thanks!

In case your question is already answered, making a donation is the right way to say thank you!