and run you about $50
And then those sporting good stores have tackle sets that are specific to types of fishing (IE, lake, catfish, etc) They're not amazing, but a good start to get the basics of what you need.
If you're going to a lake, set a sinker on a swivel with about 12" of lead to a hook with powereggs and a salmon egg. You should be able to catch fish all day long if you set up near an inlet.