Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Milvus exits after inserting 8.6 million data #39323

Open
1 task done
Esme-Ren opened this issue Jan 16, 2025 · 3 comments
Open
1 task done

[Bug]: Milvus exits after inserting 8.6 million data #39323

Esme-Ren opened this issue Jan 16, 2025 · 3 comments
Assignees
Labels
kind/bug Issues or changes related a bug triage/needs-information Indicates an issue needs more information in order to work on it.

Comments

@Esme-Ren
Copy link

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:
- Deployment mode(standalone or cluster):milvus-standalone
- MQ type(rocksmq, pulsar or kafka):    This is deployed based on the official website
- SDK version(e.g. pymilvus v2.0.0rc2): milvusdb/milvus:v2.5.3
- OS(Ubuntu or CentOS): Ubuntu
- CPU/Memory: Intel 12490f 
- GPU: 2080ti 22G
- Others:

Current Behavior

I wanted to insert a vector into the milvus database, but after inserting 8.6 million pieces of data, milvus automatically disconnected

Expected Behavior

What I expect is that milvus will remain connected until all of my data insertions are completed. Or in other words, Milvus can stay connected even when I don't actively shut it down or when the computer is turned off.

Steps To Reproduce

error:QueueCoord exit

Milvus Log

Image

Anything else?

No response

@Esme-Ren Esme-Ren added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Jan 16, 2025
@yanliang567
Copy link
Contributor

@Esme-Ren it seems that the etcd service is running slow, could you please make sure the etcd is running against SSD volume? Also please attach the completed milvus logs. For Milvus installed with docker-compose, you can use docker-compose logs > milvus.log to export the logs.

/assign @Esme-Ren
/unassign

@sre-ci-robot sre-ci-robot assigned Esme-Ren and unassigned yanliang567 Jan 16, 2025
@yanliang567 yanliang567 added triage/needs-information Indicates an issue needs more information in order to work on it. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Jan 16, 2025
@yanliang567 yanliang567 changed the title [Bug]: [Bug]: Milvus exits after inserting 8.6 million data Jan 16, 2025
@Esme-Ren
Copy link
Author

milvus (2).log
Thank you for your reply! My ETCD runs on a 14T mechanical hard drive.

@xiaofan-luan
Copy link
Collaborator

milvus (2).log Thank you for your reply! My ETCD runs on a 14T mechanical hard drive.

We suggested etcd to be running on SSDs or Cloud disks, since it requires a lot of IO.
ETCD slow may bring extra issues, including milvus crash

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug triage/needs-information Indicates an issue needs more information in order to work on it.
Projects
None yet
Development

No branches or pull requests

3 participants