WordPress does adds a lot of stuff via wp_head() hook while some of this is useful in nature while others not. For cleaning up the wp_head() easily, simply add the following snippet and you are done while the plus point is that you need not require any plugin for the same.

Snippet Source/Credit: Noumaan Yaqoob