What is UltraBalancer?
UltraBalancer is a modern, high-performance load balancer built from the ground up in Rust. Designed for extreme throughput (500k+ RPS), it supports HTTP/1.1, HTTP/2, WebSockets, and TLS termination out of the box.500k+ RPS
Built with Tokio async runtime and lock-free data structures
HTTP/2 & WebSocket
Full HTTP/2 multiplexing and WebSocket proxying support
Production Ready
TLS termination, rate limiting, and graceful shutdown
Observable
Built-in metrics, access logs, and Prometheus integration
Key Features
Load Balancing Algorithms
Load Balancing Algorithms
- Round Robin - Equal distribution across backends
- Least Connections - Smart connection-aware balancing
- IP Hash - Consistent hashing for session affinity
- Weighted Round Robin - Priority-based distribution
- Random - Stochastic distribution
Protocol Support
Protocol Support
- HTTP/1.1 with keep-alive connection pooling
- HTTP/2 multiplexing for improved performance
- WebSocket full-duplex proxying support
- TLS termination with rustls (modern, memory-safe TLS)
Caching & Compression
Caching & Compression
- Response caching with TTL and Cache-Control support
- Gzip compression for text content
- Brotli compression for better ratios
- Zstd compression for maximum performance
- Automatic content-type detection
Security & Rate Limiting
Security & Rate Limiting
- Global rate limiting - requests per second cap
- Per-IP rate limiting - prevent abuse from single sources
- IP filtering - whitelist/blacklist with CIDR support
- TLS termination - secure client connections
Session Management
Session Management
- Sticky sessions - cookie-based backend affinity
- Health checking - automatic backend monitoring
- Circuit breaker - fault tolerance pattern
- Retry with backoff - exponential backoff on failures
Operations & Observability
Operations & Observability
- Graceful shutdown - drain connections on SIGTERM
- Access logging - combined and JSON formats
- Real-time metrics - response times (p50, p95, p99)
- Prometheus endpoint -
/prometheusmetrics export - Request ID tracking - distributed tracing support
Why UltraBalancer?
Extreme Performance
500k+ RPS with lock-free data structures and zero-copy I/O. HTTP/2 multiplexing for reduced latency.
Feature Complete
Caching, compression, rate limiting, sticky sessions, TLS - everything built in, no plugins needed.
Zero Config
Start with a single command. YAML/TOML config for production. Sane defaults throughout.
Quick Example
Installation
- Linux (Binary)
- Build from Source
- Docker
Use Cases
High-Traffic APIs
Handle 500k+ RPS with caching, compression, and rate limiting. Perfect for production APIs.
Microservices
Health checking, circuit breakers, and sticky sessions for stateful services.
WebSocket Apps
Full WebSocket proxying for real-time applications like chat and gaming.
Edge Proxies
TLS termination, IP filtering, and access logging at the edge.
Next Steps
Quickstart
Get up and running in 5 minutes
Installation
Install UltraBalancer on your system
Architecture
Learn about the system architecture
Algorithms
Explore load balancing algorithms