Everybody wants their site to be indexed on top by the search engines.

Indexing or not indexing the becomes a prime concern once a site is submitted to the search engines. Due to several reasons as well as due to some common mistakes, a site is often not indexed by Major Search Engines.

Let’s look at some of the probabilities for which a website may not be indexed.

Index Time: It often requires one to eight weeks for a site to be indexed. So enough time is to be given to let a site get indexed by the major search engines. You might come across the amount of time required to index your website from the search engine’s submission page.

Limits for Submission: Many of the search engines maintain a limit for submission for a domain. You have to be aware of that particular limit of submitting pages and make sure you have not exceeded that limit. Many are of the opinion that not more than a page should be submitted per day for a site.

Deep Links: If only the home page of a site is submitted to the search engine, then there is a chance that the crawlers will visit only one or two links from the submitted page. There is a high possibility that the bots will not go deeper to the site. That is why it is better to submit the pages individually or you have to create more number of direct links from the site.

Missing Page: Often a common mistake takes place while submitting the site to the search engines. It is often seen that the pages are not uploaded to a site before submission. It is utmost important to check that all the pages exists before the site is submitted.

Placing External Links: Some search engines like HotBot and Google do not index a site that does not have links to any other sites. The search engines might index only the home page of such sites and there is high probability that the other pages of the site would not be indexed.

Link from Homepage: Sometimes search engines refuse to index those internal pages of a site that are not linked from the home page of that site. And the search engines tend to drop those pages. If the crawlers do not find a roadway to reach your internal pages from the index page then they might consider them to be less important.

Frames: It is better to create non-framed versions of your sites. If you put content inside frames, then problem may arise with their submissions to the search engines. For framed pages, search engine may read the main content but not the surrounding menu frame. In that case only a part of the content would be visible to the readers.

IP Address: At times a site can be ignored from not being indexed as that particular website seems to share the same IP address with other sites. So it is advisable to use unique IP for each sites and prevent them from being banned through repetitive uses.

Dynamic Pages: Many of the search engines avoid indexing the dynamic web pages with special characters like an ampersand(&) and question mark(?). The search engines tend to leave the portion with Java Script and index the rest of the page. So a static version for each of the pages you want to be indexed, should be created in this case.

Technical Error: Random errors can take place in the search engines due to bugs and technical problems. Search engines run database of innumerable pages and error can take place during submission of web pages. Many prefer re submitting their pages every month so that none of the pages are missed out.

Spam: If a site is full of spam content then a search engine would not prefer to index its pages. Excessive use of keywords or attempts to spamming can prevent a site from being indexed.

Hosts: For submitting the sites, the web host needs to be very reliable. If a host remains down for most of the time then it would affect indexing of your sites. A site might be even removed from the database of the search engine. It is very important for your host to respond timely when the spiders crawl the pages.

Search engine optimization (SEO) is the process of improving the volume or quality of traffic to a web site from search engines.

Search engine optimization is no doubt a vital part of web development. A developer may have given all labor to develop a site, but if it’s not optimized properly, that site can never able to attract the attention of the online readers & visitors. Apart from writing keyword-rich web content and designing the layout, one should also give importance to the search engine optimization.

Web development with proper SEO is not that much difficult. It is basically the proper balance between information architecture and web design. However, if you are a fresher in this field, following points may help you:

Create valid and Clean Code – Usually search engines prefer codes, which are simpler and semantically defined. CSS & XHTML needs to be perfectly valid.

Avoid Splash Pages – There is no doubt in the fact that splash pages look attractive, but they block search engine spiders, which is not desirable.

Avoid Using Duplicate Content – Never insert duplicate content within the same website. It creates a negative impact on the minds of the readers.

Insert Relevant Alt Tags for Images – If the alt tags for images are given properly, it will help the search engines to know more about the web content.

Use Header Tags – Header tags play vital roles in SEO and so they should be used properly. The most important targeted keyword is generally used in ‘h1′ tag. But the titles should not be staffed with keywords. They need to be clear, simple and precise.

These are indeed some of the most remarkable points that usually the web developers need to follow.

Are you building HTML Newsletter? Following are some basic things you need to follow up before {{post id=”email-html-page-contents-using-php” text=”sending HTML email”}}:

• Remove HTML tags like DOCTYPE, html, meta tag, head, link, title and Comments from your mail content.
• Because of limited support of stylesheets in webmail client, Use of table is best to layout html email
• Hide Image Toolbar
• Dont Use Anchors
• Use Inline Stylesheet
• Create your design with a white background color and black font color
• Use
  instead of <br /> instead of <p>
• Strip out forms and Javascript
• Provide a URL for display in the browser
• Send your e-mail as multipart/alternative

I wonder why people are paying such a high price for keywords in advertisement. As i browse and search from net what i found is “mesothelioma”, the highest paying ads till now. People are paying US$ 84 for “mesothelioma”.

List of Highest Paying Search Keywords

• mesothelioma – $84.08
• mesothelioma attorneys – $80.93
• mesotheliomalawyers – $69.04
• malignant pleural mesothelioma – $55.95
• Asbestos Cancer – $54.17
• mesothelioma symptoms – $53.66
• peritoneal mesothelioma – $52.27
• trans union – $51.91
• lung cancer – $43.12
• search engine optimization – $30.19
• mesothelioma diagnosis – $28.70
• home equity loans – $20.06
• Baines and Ernst – $18.47
• consolidate loans – $17.74
• Lexington law – $17.68
• Lexington law firm – $16.81
• debt problems – $16.28
• register domain – $15.74
• home equity line of credit – $15.61
• affiliate programs – $14.33
• refinance – $14.21
• video conferencing – $13.63
• payday loans – $13.21
• credit counseling – $13.02
• asbestos – $12.79

Sources

1. Search in the Internet
2. Blogging and forums

Pretty simple and candid to get a traffic to a site. Due to the advent of advertising program and pay per click services offered by Google, Yahoo and MSN, earning has become an easy. But to make a money, your website must attract more visitor. And to get visitors regularly, the content of your site must be such that visitors browse regularly. The more visitor that come to your site, there is more chances of them clicking an advertisement and therefore more money for you. Further, even if they do not click on ads, Google Adsense’s CPM – Cost per thousand impressions ads generate money for you with every impression so the more the better.

Search engines

Search Engines are primary source of getting traffic. people search and find sites in search engine. So, optimize your site with particular keywords. But do not over stuff keywords, your site may be thrown out of google’s index.

If your site pulls up within the first page on search engines result, then its for sure; you will get a traffic on your site. Make sure that you have your site submitted major search engine and directory like Google, MSN Search (beta) and Yahoo!, DMOZ.

Try to be Spotted

Try blogging and do something to get noticed. Publish and try to get your articles featured in popular site like Sitepoint, CSSBeauty, SlashDot. This can benefit you with a bit of traffic and gets your site noticed.

Original Content

The content of a site should be fresh. Since most of the articles are published in this internet cloud somewhere, if the articles is already published then make sure to add up the site name as reference and make amendments to the articles and add your view as well. Update your content regularly. Once a person has visited your site they often come back a bit later. Offer RSS and email updates so that you keep your visitors. Also, the more you update, the more often the search engines will index your site.

The robots.txt file is a text file that has specific instructions for search engine robots about specific content that they are not allowed to index. These instructions tells search engine about which pages of a website should be indexed. The address of the robots.txt file is: www.yoursitename.com/robots.txt .

By Default, every robots at first searches for robots.txt file. It then follows the file for indexing the site content.
Any robots.txt file must contain two fields User-agent and Disallow.

User-agent: *
Disallow:

The User-agent field is for specifying robot name for which the access policy follows in the Disallow field. Disallow field specifies URLs which the specified robots have no access to.

User-agent: *
Disallow: /

Here “*” means all robots and “/” means all URLs. This is read as, “No access for any search engine to any URL”. Since all URLs are preceded by “/ ” so it bans access to all URLs when nothing follows after “/”. If partial access has to be given, only the banned URL is specified in the Disallow field.

Lets consider this example:
# access for MSNbot.
User-agent: MSNbot
Disallow:
User-agent: *
Disallow: /category/php/

Here we see that both the fields have been repeated. Multiple commands can be given for different user agents in different lines. The above commands mean that all user agents are banned access to /category/php/ except MSNbot which has full access. Characters following # are ignored up to the line termination as they are considered to be comments.

Make sure that the robots.txt file is always named in all lowercase (e.g. Robots.txt or robots.Txt is incorrect)