Benchmarks

This page summarizes curated benchmark results for Eden's Eve gateway runtime.

Raw benchmark artifacts are environment-specific and are intentionally not

committed. Treat these numbers as a public performance brief from controlled

internal runs, not as a universal hardware guarantee.

Redis is the only production-ready gateway protocol in this release. Results for

AI/LLM, agent, Postgres, Mongo, and other protocol surfaces should be read as

development and evaluation data until those surfaces are explicitly promoted.

Summary

Eve is Eden's high-performance data plane. It proxies Redis traffic and

OpenAI-compatible AI workloads while preserving layer-7 awareness for policy,

analysis, routing, mirroring, migration, and telemetry.

The key result from the current benchmark set: Eve is competitive with Envoy on

raw gateway throughput while doing substantially more product work inline. On a

matched Redis workload, Eve used about one-third less CPU per completed request

than Envoy and produced lower tail latency.

ClaimProof PointBaseline
Lower CPU cost per request10.83 vs 15.95 CPU-seconds per million Redis requests at matched 400k req/sEnvoy Redis proxy
Lower Redis tail latencyp99 2.10 ms vs 2.37 ms; p99.9 3.25 ms vs 3.67 msEnvoy Redis proxy
Clean overload behaviorZero connection errors across the 64 KiB max-throughput vCPU sweepEnvoy Redis proxy
AI gateway ceilingBuffered 64 KiB AI responses reached 12k req/s / 6.36 Gb/s with zero errorsEnvoy HTTP proxy
Multi-agent overhead2k offered req/s with p99 1.38 ms and zero errorsSynthetic OpenAI-compatible backend
Redis large-payload throughputUp to 15.5 Gb/s wire / 1.94 GB/s payload goodputEnvoy Redis proxy
Live observability185-metric catalog, gateway timing breakdowns, traces, logs, and ClickHouse/DuckDB exportProxy counters

Redis Gateway

Matched Throughput

At a controlled 400k req/s mixed Redis load where both gateways completed the

same work without shedding, Eve matched Envoy throughput with lower latency and

lower CPU use.

TargetCompleted req/sShedp99p99.9
Direct Redis~305,9211,881,3035.72 ms-
Envoy Redis~399,90102.37 ms3.67 ms
Eve Redis Gateway~399,90802.10 ms3.25 ms

CPU attribution from the sampled run:

TargetCPU-s / million reqCycles / reqInstructions / reqDSO Split
Envoy Redis15.95~53.7k~33.4k~53% kernel / ~38% envoy
Eve Redis Gateway10.83~35.2k~23.9k~72% kernel / ~18% eden-service

Direct Redis was saturated at this offered load, so it is best read as a

saturation signal rather than an added-latency baseline.

Overload Behavior

In a 400k offered open-loop Redis load, Eve sustained materially more completed

throughput than Envoy while avoiding shed.

TargetCompleted req/sShedp99
Direct Redis287k2.02M5.99 ms
Envoy Redis165k4.57M7.27 ms
Eve Redis Gateway384k02.45 ms

With telemetry export and capture-all request analysis enabled, Eve still held

384k req/s at zero shed with p99 3.93 ms on this workload.

Large Payload Throughput

On 64 KiB Redis GET workloads, Eve was competitive with Envoy on wire

throughput and showed cleaner error behavior at saturation.

TopologyEve PeakEnvoy PeakNotes
Single backend, 4 vCPU14.0 Gb/s13.9 Gb/sEve had zero connection errors across the sweep
Single backend, host network, 4 vCPU14.4 Gb/s13.6 Gb/sEve stayed error-free through peak
Four backends, ring hash, 4 vCPU15.5 Gb/s16.1 Gb/sEve was within ~3.5% on wire, with 0 errors vs Envoy's 11
Single backend, 6-8 vCPU~15.0 Gb/s~16.0 Gb/sEve recovered most of the gap with additional cores

The ceiling in these runs was the backend, host, and TCP path rather than only

gateway worker count.

AI And LLM Gateway

Eve exposes an OpenAI-compatible AI gateway for chat, multi-agent/tool, and

streaming workloads. These runs used a synthetic OpenAI-compatible backend and a

generic Envoy HTTP proxy.

Sustained Load

WorkloadEve Clean CeilingEnvoy Behavior
Buffered 64 KiB responses12k req/s, 6.36 Gb/s, p99 1.68 ms, 0 errorsCollapsed at 8k offered: 2,530 req/s and 42,779 errors
Streaming 64 KiB responses6k req/s, 3.75 Gb/s, p99 1.64 ms, 0 errorsCollapsed at 6k offered: 2,421 req/s and 24,137 errors

Latency

WorkloadEve Req/sErrorsp50p99p99.9
Multi-agent, 2k offered, 8 tool schemas1,998.800.60 ms1.38 ms1.69 ms
Streaming, 1k offered999.800.72 ms0.94 ms0.99 ms
LLM chat, 5k offered4,992.1913.9 ms47.5 ms52.0 ms

For small-response LLM traffic, recent fast-path work allowed Eve to hold a full

12k req/s at about 1.2 ms p99 with zero shedding.

Observability Validation

Eve telemetry was validated end-to-end under live Redis load. In a 30-minute

window with a 100k-request Redis workload running at 175,472 req/s, the runtime

produced:

  • 185 metrics across core, gateway, LLM, IAM, endpoint, workload, migration,

tool-safety, and analytics groups.

  • 14,043 gateway metric rows stored in ClickHouse, including request and command

counts, per-command duration, endpoint-vs-overhead timing, parse

decode/materialize breakdown, bridge queue/write timing, byte counters, and

mirror latency/divergence.

  • 2,105 trace spans captured and queryable alongside structured logs.
  • Dashboard series coverage from emission through storage, query, and UI.

This matters because Eve's performance profile includes built-in protocol-aware

observability rather than only generic proxy counters.

Capability Context

The raw numbers should be read alongside the feature set being exercised. Redis

is one measured protocol in this report, but the product surface is broader:

Eden is a data and AI gateway for databases, model providers, and agent

workloads.

CapabilityEden / Eve GatewayEnvoy / Envoy-Based GatewayHAProxy / TCP Baseline
Protocol awarenessLayer-7 protocol handling across gateway families: Redis/RESP, Postgres, Mongo, HTTP/OpenAI-compatible AI, and endpoint schemasStrong HTTP/L7 proxying, with narrower protocol-specific database support depending on filters/extensionsByte forwarding unless custom protocol logic is added outside the proxy
Data gateway behaviorRequest routing, endpoint-aware dispatch, database policy hooks, interlays, mirroring, migration routing, and consistency checksGeneric routing/load balancing plus protocol-specific features where availableGeneric server selection and health checks
AI gateway behaviorOpenAI-compatible chat, streaming, agent/tool workloads, request normalization, routing hooks, and usage accountingUsually delivered through Envoy-based AI gateway products or custom filtersNot applicable at L7
Per-request analysisCommand/query/request classification, audit events, analytics, prompt/tool-shape analysis, and policy decisionsMostly proxy/filter counters and access logs unless extended by custom servicesConnection/request logs only
Content securityPII detection, redaction/blocking hooks, prompt security inspection, and policy enforcement pathsRequires separate filters, external authorization, or companion servicesNot available without application-side tooling
Auth and policyControl-plane JWT/RBAC/ELS plus upstream protocol credentials such as Redis ACLs and database/user credentialsProxy auth, external auth, and protocol auth where configuredGeneric TCP/TLS/userlist controls
Mirroring and migrationRead/write toggles, sampling, in-flight limits, divergence metrics, ratio routing, user-hash routing, fallback-on-miss, and version comparison pathsMirroring/routing support varies by protocol and deployment modelNot available beyond generic fanout patterns
ObservabilityBuilt-in metrics, logs, traces, per-command/per-request timing, parse breakdowns, pool/lane/mirror/bridge metrics, and ClickHouse/DuckDB exportAdmin counters, histograms, access logs, and tracing integrationsStats/Prometheus when configured

Reproducing Workloads

Source benchmark tools live in the repository's

benchmark/

directory:

  • cacophony runs open-loop Redis workloads against a Redis-compatible target.
  • ai-workload runs synthetic OpenAI-compatible HTTP workloads.

Keep raw result files, profiler captures, and host-specific scenario files

outside the repository unless they are deliberately curated for publication.

Last updated: October 20, 2018
Size: 8.67 KB
    Eden | Govern AI Access