What is a Load Balancer?

A load balancer is a network device or appliance that distributes client traffic across a pool of backend/application servers. Load balancing can be implemented to operate at either Layer 4 (transport layer) or Layer 7 (application layer) of the OSI networking model. Layer 4 load balancing entails distributing traffic for protocols that operate at the transport layer (TCP, UDP) and sometimes at the network layer (IP). Layer 7 load balancing operates at the application layer and makes balancing decisions based on data content and metadata available at that layer.

Different hashing algorithms can be employed to operate on the data available at the relevant OSI networking layer to facilitate decision making around the distribution of client traffic. Common hashing algorithms used include round robin, least response time, least recently used, among others.

A load balancer monitors the backend servers they proxy by performing health checks to specified network (layer 4) or application (layer 7) endpoints. A load balancer takes the health of backend servers into account when deciding what server to send client traffic to, in addition to other decision making mechanisms such as hashing.