pingora — Engineering Performance

Fix chunked trailer end parsing httparse itself does not treat the terminating chunk (0 + CRLF) any differently when parsing its chunk size, and the body reader does not validate the following CRLF required to close the body. Additionally, that current parsing scheme will not consider trailers before the end CRLF. Now the trailers are considered but simply discarded. The CRLFs between the trailers (and now, the CRLFs after the body payloads) are validated, however.

Upgrade body mode on 101 Previously the body reader would initialize to HTTP/1.0 mode when the upgrade request header is found. Now the reader is only converted to that mode when both the upgrade header and 101 is received.

Subrequest sessions, clear body headers if no input Subrequests are now a separate server Session type, instantiated with corresponding SubrequestHandles that can send or receive HttpTasks to or from the subrequest. This makes it possible to communicate with created subrequests. Additionally the subrequest ctx now has a BodyMode input. If unset the background subrequest will clear request headers related to the request body to prevent issues where the upstream might expect body.

make Lru::shard_weight a lock-free read Add a per-shard atomic shadow of total weight (shard_weights: [AtomicUsize; N]) maintained alongside the existing global weight counter at every weight-mutating site (admit, increment_weight, evict_shard_at, remove, insert_tail). Rewrite Lru::shard_weight() to read from the shadow with a Relaxed load instead of acquiring the shard's RwLock to read the LruUnit::used_weight field. This mirrors the pattern already established for shard_lens/shard_len(). Like shard_len(), the same 'best-effort, no cross-thread ordering' caveat applies: the sum of shard_weight(i) is not guaranteed to equal weight() at any single instant, since the global and per-shard atomics are updated independently with Relaxed ordering. Motivation: callers (eviction-balance heuristics, observability) that want to scan all N shards every few seconds should not pay N brief read-lock acquisitions when an atomic shadow is cheap enough to maintain on the write path. Adds a single-threaded regression test verifying the shadow stays consistent with the truth across all five weight-mutating paths.

Reject ambiguous authorities on ingress and egress

Share health across load-balancing selectors Add grouped selectors with asynchronous bounded rebuilds and shared active health across backend views.

Parameterize custom downstream sessions

identify eviction entries with storage markers Adds a storage-provided marker to the cache and eviction APIs. This allows multiple entries for the same cache key to coexist. Active purges remove the current entry, while eviction paths target the exact entry selected by the eviction manager. Existing persisted key-only LRU data remains readable, and storage implementations without markers retain key-only behavior. This is a breaking API change.

Discard extra upstream body and disable keepalive Explicitly disable keepalive on upstream connection when excess body (content-length) is detected.

Add cancel-safe proxy task API for Subrequest server sessions Implement the same proxy task API functionality for subrequest server sessions as HTTP/1. Also fix the regular subrequest header write path so upgrade state is only marked after the 101 task is sent.