Dad's Puzzle is the first sliding tile puzzle with non-square pieces. The eariest copyright of this puzzle was in 1909 under the name 'Pennant Puzzle'.
L'Ane Rouge (The Red Donkey) was popular in France. The large piece had a picture of a red donkey. The object was to move the donkey to the bottom, as stubborn as he is.
Line Up the Quinties Puzzle first came out in 1934 to celebrate the birth of the Dionne quintuplets. This version features the Parker quints.
Ma's puzzle (in obvious competition with Dad's) was the first puzzle (1927) to feature non-rectangular pieces.
The above four puzzles are from Martin Gardner's "Mathematical Games" column in the February 1964 issue of Scientific American.