tree 8fb7328f21cc0a3f13593e4aaf01615d4e3f051a
parent 59153fef8659753e2d512d574b7107c5736d1920
author Willy Tarreau <w@1wt.eu> 1592989862 +0200
committer Willy Tarreau <w@1wt.eu> 1592994086 +0200
encoding latin1

MEDIUM: tasks: add a tune.sched.low-latency option

Now that all tasklet queues are scanned at once by run_tasks_from_lists(),
it becomes possible to always check for lower priority classes and jump
back to them when they exist.

This patch adds tune.sched.low-latency global setting to enable this
behavior. What it does is stick to the lowest ranked priority list in
which tasks are still present with an available budget, and leave the
loop to refill the tasklet lists if the trees got new tasks or if new
work arrived into the shared urgent queue.

Doing so allows to cut the latency in half when running with extremely
deep run queues (10k-100k), thus allowing forwarding of small and large
objects to coexist better. It remains off by default since it does have
a small impact on large traffic by default (shorter batches).