If you look at our stats on Area 51, you will see that one of the areas where we are falling behind is in the number of users with a good reputation. This is sad, because we do have quite a good answer rate, and so we most likely have a large number of users who are not getting the upvotes they deserve.
Of course, this could also mean a smaller number of users are doing all the heavy lifting. Either way, for the site to remain healthy, you need to vote (up or down) on questions and answers where you can. Just remember - vote fair and honestly, because the system is built to catch fraud, and the moderators are also watching (even when we are sleeping, with one eye open!) ;)
If you are new to Stack Exchange, as likely many of our users will be, here's some further reading: