One of the most common SEO mistakes I encounter every day is the mishandling of 404 errors. URLs that return a 404 HTTP response code are a normal part of the web; just about every site has them. 404 errors can be served for a couple of reasons. Maybe you are trying to access a page that has been moved or no longer exists on the sites server, or maybe you misspelled the URL for that particular page. Although 404 errors do not have a direct correlation to your sites rankings, it is believed that too many of these errors can act as a signal to search engines that maybe your sites content isn't the best or most up to date for the query. The most important part is understanding how to approach them correctly in order to preserve user experience and link juice. This can be accomplished by creating a customized 404 page and installing 301 redirects when appropriate.
What Should I Do With Them?
The web is constantly changing and so are the sites that populate it. Many sites want to change content, and should often, in order to stay fresh. But what do you do in the case of retired pages or a change in URL structure? In many cases I see sites set up to redirect all 404 errors to the homepage. Unfortunately this is killing the site rather than helping it. Approaching 404s in this manner is essentially devaluing your homepage by sending the user and search engines to a page that is not relevant to the original URL.
Another problem I see often is when a site is set up to take the user or search engine to a custom error page but instead of returning 404 response it will return a 200 OK, this is known as a soft 404.
The goal here is to get the visitors to where they want to go, and to keep search engines from leaving the site and continue crawling once a 404 error is reached. So how do we accomplish this?
Well, there are a couple of ways to ensure that visitors and search engines stay on your site while also retaining some of that traffic and link juice from those retired pages.
It is also important to remember that if you do retire pages that will return a 404, you must remove any links to that page from within your site or they will still be indexed.
Importance of a Custom 404 Page
One of the most overlooked aspects of site design and SEO is the implementation of a custom 404 page. Too often I see sites using the default error page instead (shown below), which can result in lost visitors and keep search engines from crawling the entire site.
What is wrong with the page above? Do you think the average user knows what a 404 HTTP Response Code is? This is why customized 404 pages are so very important. A customize page will allow visitors and search engines to continue navigating your website in the event of a broken link or deleted page. Remember, search engines do not have a back button. If you do not include links for the crawling process to continue then the spider will see it as a dead end and jump off site.
Custom error pages also offer the user a more personalized experience and a better explanation of what a 404 is. There are some important elements that every sites 404 page should contain that will keep visitors browsing and search engines crawling: