Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data import does not support batch insertion operations #593

Open
daiagou opened this issue Jun 2, 2023 · 1 comment
Open

Data import does not support batch insertion operations #593

daiagou opened this issue Jun 2, 2023 · 1 comment

Comments

@daiagou
Copy link

daiagou commented Jun 2, 2023

Moqui's tools include dataimport, but they do not support batch operations. When there is a large amount of data, there will be timeout/failure issues. At this point, the timeout time can be increased (default 60s),
But there are several issues:

  1. When deploying online, Moqui is usually not external, and the outermost layer usually has nginx/address. However, changing the Moqui timeout does not take effect.
  2. Due to the lack of batch operations, the import process is very slow. Even if Ops personnel agree to adjust the timeout time, this time cannot be estimated due to the amount of data. Usually, it is not recommended to adjust the timeout to a very large value.
    So it is recommended to determine whether the imported data is duplicate and can support batch inserts? Especially for importing in CSV format.
@daiagou daiagou changed the title Dataload does not support batch insertion operations Data import does not support batch insertion operations Jun 2, 2023
@eigood
Copy link
Contributor

eigood commented Jun 9, 2023

Could you provide some further examples of what exactly is occurring? Repeatable steps, so that others can help to isolate what the problem(s) actually are?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants