Tulip uses two techniques to reduce latency and increase throughput.

EA-Perplexity · 2026-09-28

Tulip uses two techniques to reduce latency and increase throughput.

CUDA graphs pre-record GPU work so it can be launched with a single call, reducing CPU overhead.

LazyTensors track results asynchronously, letting the CPU prepare the next batch while the GPU finishes the current one.