Locust Load Testing

Setup Environment

In your Python environment with model dependencies installed, install the Locust utility:

pip install -r requirements.txt

Run a test using a dataset of variable input prompts generated by generate_prompts.

Command to run the load test:

locust --config locust_config.conf

You can configure Locust tests using .conf files. The key configurations to modify are:

users: Maximum number of concurrent users.
spawn-rate: Number of users spawned per second.
run-time: Total duration of the test (e.g., 300s, 20m, 3h, 1h30m, etc.).

For more details, see the Locust configuration guide.

To run a test with 32 users, all launched simultaneously, for a duration of 3 minutes, set the parameters:

users = 32
spawn-rate = 32
run-time = 3m