The Lottery Ticket Hypothesis

The Lottery Ticket Hypothesis

THE MOTIVATION

Pruned network is difficult to train from the start.

THE MAIN WORK

This paper states “the lottery ticket hypothesis” and proposes “iterative pruning” to identify "winning tickets"

The Lottery Ticket Hypothesis

Iterative pruning

What’s more, they stressed the importance of winning ticket initialization.

LIMITATIONS

• only magnitude pruning methods used. structured puning and non-magnitude pruning methods need to be tested.
• Iterative pruning is computationally intensive, requiring training a network 15 or more times.