MAR 9, 2026Engineering
Loading container images lazily to shorten cold starts
MMira OkaforEngineering
See all posts
Loading container images lazily to shorten cold starts
Start before the pull ends
Most containers read under 10% of their image before serving the first request. We now start the container as soon as the index arrives and fetch file blocks on first read.
Trade-offs
The first request can be slower if it touches many cold files. A warm-up hook lets you list files to prefetch.