Used is always a great way to go. I'm sure you won't have too hard a time finding an inexpensive high quality amp (Rotel, Denon, NAD, Marantz etc).
As for speakers, I've been in love with Angstrom speakers since I first heard them (I also used to be a person who didn't think bookshelf speakers were worth even looking at haha). I know it's subjective but I really haven't heard anything near as good in the same price range. Check out the Reference Cabinet section
Loud Speakers | Angstrom Loudspeakers
Not sure where you live but if you are anywhere near the GTA you can contact them and get some b stock for a great price and probably even get to go for a listening session at their office in Markham. The Mod 4's are about $1000 but I got a pair of their B stock for somewhere around half that price. The Mod 1's retail for $500 give or take and can probably be had for a bit less. My B-stock's were immaculate...not a scratch on them. They use silk dome tweeters and Vifa drivers in all the Mod series speakers.