There are a number of common ‘build’ obstacles that can affect how easily your site can be crawled. Fixing these hitches is a fundamental part of on-page optimization and can make a real difference to the volume of traffic you receive. Here are a few bug bears:

Images with no alt text: Search engines cannot read images. Your page may look beautiful thanks to the glorious image you’ve included but it will be completely invisible to the search engine’s spiders. Likewise if you have submission forms, diagrams or text box images, none of the important content you’ve created will get its due credit from the likes of Google etc. This is easily remedied with either an alt tag providing a description of the image that the human users can see, or by ensuring your text is not embedded in an image file, but as HTML text.

Flash heavy and framed sites: As with images, spiders don’t deal very well with Flash or Java. While Flash can enhance a user’s experience of a site, as long as it doesn’t slow down the loading time, it hides important content from the spiders. Highly creative sites commonly have their homepage in Flash, which looks great but is detrimental to the site given that most inbound links will point there, yet the spiders can’t see it. Finding ways to secure a balance or at least ensure there is a text option available is crucial to a successful ranking. Similarly, a framed site can cause spidering problems as frames tend to fragment your site. Content from pages within the overall framework can be hidden as the spiders might only read one of the frames on a page. It is best to avoid building your site in frames if possible.

General functionality: Being too clever, including whizzy graphics and such like can sometimes slow down your site. The user experience has to be as smooth and as uninterrupted as possible so avoid over-complicated functions, ensure file sizes are low for downloads etc and invest in some high quality server hosting. Checking your site works in different browsers is prudent and it also pays to check regularly for broken links in order to limit user frustrations and also ensure that all content can be accessed by the spiders at all times. Having a site map helps both user and spider as, if your site’s not vast, it means that most of the content can be accessed in two clicks.

Duplicate content: Search engine spiders like unique content. If they find duplicated versions of the same content, they will take one page as ‘canonical’ and display that single page as the result. This is particularly damaging to your ranking in the search engine results as the strength you have built up through the links to a particular page will be diluted by the additional copies. Commonly this can occur on a site’s homepage when multiple versions of the URL are used e.g. the inclusion and exclusion of the ‘www.’. As most external links tend to point to the homepage, it is important to protect its strength which can be done simply by using a 301 redirect. This ensures you dictate the canonical page to the search engine spiders by pointing all duplicate pages to the primary page.

Design and navigation: The design and navigation of your site can guide a user seamlessly through your content on a path you have pre-ordained. This is the same for the search bots. By creating a clear and logical network of internal links, obvious navigation systems, breadcrumbs, well written anchor text so it is clear what will be returned on the click of a link, and so forth, you not only create a smooth user experience but lead the bots deeper into your site. Search engines look for relevancy so designing your navigation system to act as a funnel; taking them from broader to narrower subject matter within an overall theme, will help them rate your relevancy and suggest there is depth and quality to your site.

These are just a few of the most common adjustments that can help improve your site’s crawlability. Speaking very generically, it stands to reason that the better the experience for the web user, the better it will be for the search engines. The key is to make sure a literal, textual translation is provided at all times for the internet’s creepy crawlies.

Read more about increasing visibility and crawlability in the search engine’s through the optimization of your keywords.

Strategic keyword placement increases site visibility

1. Create order: On-page optimization includes making the structure of your site clean, easy to navigate and highly visible (through correct code, links and meta data) to the search engine spiders. Your keywords should support these efforts. Stuffing all your keywords into your home page is not effective. Think about how the search engines crave theme and order; and how a web user refines their search the closer they get to purchase (see our Search Process article). Your website should reflect this hierarchy of cascading information. Your home page, by its very nature, is likely to be fairly generic, and more appropriate for using your broader theme or category keyword descriptions. The rest of your site should be structured to explore more specific sub-categories within a clear framework. If you have a travel site for example, you may be talking about holidays in general on the home page, subsequent pages might talk about certain types of holiday i.e. beach, with sub-pages investigating products or locations. You can then create keyword clusters throughout your site that will generate pockets of strength and relevance for the search engines, resulting in more of your site being crawled more often. Be careful not to dilute your keywords by trying to target too many unrelated words in one area.

Strategically clustering your keywords hierarchically throughout your site will also help with inbound links. Bloggers and webmasters prefer to link to particular articles or pages rather than generic home pages and deep links to certain sections of your site will lend further relevance and strength overall.

2. Get to the point: When it comes to SEO, it pays to be direct. Highly creative writing on a website is all well and good, but a search engine does not currently have the ability to make conceptual or suggestive leaps like that of a human brain. Search engines do not read between the lines. For example, if you are talking aspirationally about your holiday company using phrases such as ‘time to unwind’ etc, the chances are the search engines will not relate you to holidays, but you might get returned in a search for easy listening music. To that end, your headlines and priority text should contain your targeted words and phrases. The words that are important to you and directly relevant to your site should be your focus as they will tell the search engines what your article or page is about. Using clear explanation and words related to your theme will help them do this quicker. Examples of proper keyword placement include:

Keywords in URLs: Your URL is a key descriptor of your site. If possible you should have your keyword forming part of your URL in order to help with SERPs rankings.

Keywords in title tags: The search engines place more importance on page titles than subsequent text. Putting your keyword at the start of your title will immediately tell the search engine’s what that page is about. What’s written in your title tag also shows up as the page title in the search results listing.

Keywords in headings: Headlines also carry more weight in the search engine’s eyes. Using HTML H1, H2 etc headings makes your content more visible to the spiders and enables clearer categorisation of your site content.

Keywords in anchor text: Using your keywords in link descriptions, i.e. your anchor text is another way of getting your keywords into your site content without appearing repetitive. Anchor texts provide more clues to the search engines as to the content of your linking pages.

Keywords in body text: While we’ve established you should be clear and ‘themed’ as far as the search engines go, you should be careful in terms of overdoing it with overuse of your keywords. Not only will this provide difficult reading for the user, but the search engines will punish excessive ‘keyword stuffing’. Keyword ‘density’ is a term used to describe the percentage of keywords you have in an article in proportion to other text. Over 10% of core keywords in an article is thought to start looking suspicious to the search engines. But common sense needs to feature here anyway, if a piece becomes difficult or frustrating to read, there is less likelihood of it ever getting linked to so you really need to be writing for the web user and not the search engines.

Keywords in alt tags: The search engines cannot read images. What may look nice or be highly explanatory to a web user, may be completely invisible to the spiders. It is important to include an image description with any image you post to make it ‘readable’ for the search engines, and adding your keyword to this makes sense. However, you need avoid the temptation to stuff the alt tag with keywords and should make sure the description is still relevant to the image itself.

Keywords in meta tags: This is less important, especially as far as Google is concerned. However, writing a good meta description for each page is good practice and lends some added relevancy to each page. Again, beware of keyword stuffing as it will do more harm than good.

Read more about on-page optimization and how to make your site visible and accessible to the search engines.

Link baiting helps drive traffic

Creating reasons to visit
There are a number of ways in which you can seduce other bloggers and webmasters to link to you.

1. Staying current: Where are you getting your information from? If you are compiling articles by sweeping the web for information, that’s fine as long as you put your own spin on it and don’t directly duplicate content. However, it won’t necessarily get you noticed.
In order to stay fresh and be able to create a piece that will resonate through the web, it is a good idea to spend some time in the online community; searching latest blogs participating in forums relevant to your field and so forth. By properly listening to what people are saying in these forums i.e. what they’d like to see more of, pet hates and current issues etc, you can get some good fodder for your next post. Being active in the social networks i.e. Digg can kick-start your popularity and lend you some visibility to start with.

2. Capitalizing on partnerships: Think about whether you could team up with an expert in your field. This will lend immediate credibility to you and your site. A joint venture or even securing a quote from said expert can work. You could do a feature on them and link to their site. If the article is good, you could get the expert linking back to you for self-promotion.

3. Being funny or unique: Comedy is arguably the primary reason for a web feature to go viral. For example, some of the most highly visited youtube videos have consisted of nothing more than a baby Panda’s sneezing (to its mum’s great surprise). Nothing groundbreaking there, but it did manage to tickle the global nation for a while.

If you can’t think of something funny, or it seems inappropriate to do so, it also pays to be unique. As mentioned above, monitoring blog subjects will help give you ideas, but you could have a personal view or opinion that might spa rk debate. Something that has neither been proved or disproved in the past stands a good chance of getting talked about in the present.

4. Link baiting: While all content designed to get links could be referred to as link baiting, it is more common that you associate the phrase with giving away free stuff. Providing one-stop solutions e.g. complete how to guides/top 10 lists etc, free tools such as BMI calculators, search tools and so on, is a great way to attract links. A website can make itself more useful by providing access to such tools to web users, but even more effective is if you can provide a tool that a blogger or webmaster would be interested in. This will provide an excellent source of links.

5. Avoiding overt commerciality: Websites that feature lots of ads or overtly sell within their content are generally avoided by bloggers or webmasters. A piece that appears purely informative is far more likely to attract genuine links of quality.

While this article only picks up on a few of the techniques that can be employed to generate interesting content, the overall message should be that generating less high quality pages is far more valuable to the virtual community, and your site, than having hundreds of irrelevant filler pages. The goal with online content is to become an authority or reference point for a subject in order to get linked to time and again.