epoch vs iteration vs batch code example
Example: Epoch vs Batch Size vs Iterations
One Epoch is when an ENTIRE dataset is passed forward and backward
through the neural network only ONCE.
Batch Size is the Total number of training examples present in a
single batch.
Iterations is the number of batches needed to complete one epoch.