GPU

The GPU performance state APIs are used to get and set various performance levels on a per-GPU basis. P-States are GPU active/executing performance capability and power consumption states. P-States range from P0 to P15, with P0 being the highest performance/power state, and P15 being the lowest performance/power state. Each P-State maps to a performance level.…

Batch Size

Batch size refers to the number of training examples utilized in one step or iteration. One step or iteration is one step of gradiend decent (one update of weights and parameters) The batch size can be either: The same number of the total number of samples which makes one step = an epoch, this is called batch…