Relevant links help your site for several reasons.  The main reasons are that it helps the search engines find the "theme" to your website and can place it into a category that fits your website.  While the number of backlinks are important, the quality is important as well.