The http service holds a queue of all the http requests, and the worker threads get one request each, so max 4 (the default value) requests are processed in parallel.
This doesn’t explain the behavior you see though, so we need to investigate that too.