How to make my own Derby Hat?

I am wanting to make my own derby hat to save money and have fun. I know to add flowers,ribbon, jewels, feathers, etc but dont know where to get an inexpensive hat to make pretty. Any suggestions of what kind of hat to get and where I can get them without spending a fortune?