⚠ Switch to EXCALIDRAW VIEW in the MORE OPTIONS menu of this document. ⚠

Text Elements

api/webservers

client(s)

success

failure (too many requests)

cache (high throughput)

logging mechanism

database (nosql)

http 200

  • server-side rate-limiter
  • use ip/user-id for unique identifier
  • send HTTP 429 on rejection
  • use load balancer to scale with multiple load balancers
  • each rate limiter can send to specific set of servers so that we don’t need another layer of load balancers

rate limiter

load balancer

multiple rate limiters