the weight associated with, say, x2, to say y4 or y2 to z1 are basically pointless to the results of the calculation, so as a result, it makes total sense to prune those, so for the next however many epochs, that value doesn’t need to be calculated. On 1,000 epochs, that saves 2 calculations per epoch just by eliminating 2 synapses for a total of 2,000 calculations saved on a tiny network that in 1,000 epochs will be 16,000 calculations for a net saving of 12.5%, on a bigger network, those numbers could easily be way bigger, and the net saving, much larger.

An example might look like this-