Welcome to a possibly very expensive addiction!
For someone new to W/C, I recommend reading some of Skinee labs reviews. he does some thorough testing on blocks and rads.
Skinnee Labs | CPU Blocks
Firstly, you need to decide if you want to water cool just your CPU or your GPU also. If you decide on just the CPU, then you can go with an "all in one" kit like the H50 or coolit eco, or with a conventional "pieced together" watercooling system.
If you are going to piece it together, then you have a lot of choices!
For the CPU block, I am a big fan of the EK supreme HF. EK, Swiftech, Koolance, and Danger Den all make decent GPU blocks. Then you need to pick some tubing (3/8 or 1/2"), fittings (barbed or compression), pump (Generally a 350, 355, or 655 and possibly an aftermarket pump top) and a reservoir(bay mounted, or other) Be aware of what your components are made of internally. If you mix say a copper waterblock with an aluminum rad (not recommended), you will need a corrosion inhibitor in your fluid as well.
Most of these things really come down to personal preference. You'll have people saying that compressions are better than barbs etc. but as long as you're careful, take your time and leak test, it's all good. People will also tell you that 1/2" ID is better than 3/8 , but since the majority of your restriction is in your rad and blocks, it is really not a big deal. If you are using a pump with a stock top that has non removable barbs, just go with whatever size that is instead of trying to use reducers etc.
One choice that I think is critical though, is your Rad choice. Different radiators will have different fin densities. If you want less noise, you will want a low density rad with slow fans. If you want extreme cooling, you want a high density rad with fast fans as illustrated on the chart on this page
Skinnee Labs | Triple Radiator Comparison V2
Also, a bigger case will help you out, but be creative and think outside the box for mounting locations for your W/C system. IE: you can cut new holes in the case for your radiator, or even mount it outside the case with a bracket on the back. The possibilities are basically endless.
As far as fluids go, you will see things like primochill ICE and Fesser ONE, as well as different dyes and additives. They claim cooling gains, but really distilled water with a biocide like "NUKE - cu" and possibly a silver coil (silver has antibacterial properties) is a cheaper and better choice. UV lights help kill bacteria too

Dyes are tempting, but they lose their colour over time and that colour usually ends up as restrictive slime in your waterblocks. In one of my systems I actually use half and half water and automotive antifreeze (green ethylene glycol). This acts as a biocide, antifreeze (pc is in my garage), and corrosion inhibitor, and has a cool green colour
To buy your parts, I recommended Dazmode, NCIX, Sidewinder PCs, pertrastechshop and frozencpu.
Hope that helps!
Oh, and as to the pump noise question.. I am running a very quiet PC. 1000 rpm nexus and noctua fans, a Zalman PS(physically huge with internal heatsinks = dead silent) and the cpu, mobo and video cards are all liquid cooled. In my last pc I used a themaltake pump :( and it was quite noisy. This time I bought a 355 and a 655(the adjustable one) and tried them both. I found that the 655 was not only much quieter, but it was a less noticeable pitch as well if that makes any sense. The 355 ended up going in a small garden fountain lol, and I got a second 655. Below setting 3 you can hear them if you open the case and put your ear within a foot or so, but from any farther they are silent once the air is worked out of the system. I later read right on swiftechs site that it says that the 355 is much noisier than the 350 or the 655. I've never tried a 350, so I can't comment on it.