
Rate Limiter
Rate Limiter, yeah as it sounds like a rate limiter, this was built in go as rate limiter sidecar which helps in handling massive traffic across the backend. This uses GCRA algorithm and Compare and Swap (CAS) to manage the traffic.
- It treats traffic as a continuous flow rather than discrete buckets, providing much smoother rate limiting
- It only needs to store one value,the Theoretical Arrival Time making it extremely lightweight
- It can handle thousands of concurrent requests across multiple CPU cores with near-zero latency overhead.



