Will it cost me a lot to start a collection?

No! Start with used stamps and a few inexpensive accessories (such as a small album and a package of hinges), and you can have a great time on a limited budget. Remember to put stamps, albums and hinges on your birthday and holiday wish lists, too!