What's the point of getting Stamps?

Since stamps are rewards to you, the motivation to get them is clear! You want them! Plus, given the fact that stamps can be seen publicly on your penguin, it's fun to show off how many you have, and what you still need to get.