Epoch — one pass over the training set
One complete pass over the training data. With n examples and batch size B, an epoch is n / B steps.
Large language models usually train for about one epoch over a huge dataset and count progress in tokens instead (section 4.5).