The strong law of large numbers heavily depends on the fact that each of appears repeatedly in the sequence
. We prove a version of the strong law of large number in which no random variable gets “recycled.” More precisely, we prove the Hsu-Robbins-Erdős theorem, which states that for i.i.d.
, we have
if and only if
and
.