Does moving a GPU server's request loop into the kernel save CPU?
eunomia
Does moving a GPU server's request loop into the kernel save CPU?
bpf-gpu-server lets eBPF and iouring own the TCP path of a GPU server so that no user thread touches a request. Against an efficient epoll server driving the same GPU executor, its CPU use and latency matched the baseline. This post explains where the per-request cost actually goes.
0 comments
No comments yet.