Ad

How Can I Get A History Of The Number Of Pages In Google's Index For A Particular Site?

- 1 answer

A Google search for "site:example.com" will tell you the number of pages of example.com that are currently in Google's index. Is it possible to find out how this number has changed over time?

Ad

Answer

I set up a Python script as a cron job to parse the result from the Google results page and save it. I set it to run once per day for each of a set of sites. I wrote another script to produce a CSV spreadsheet from the data. I can open that in a spreadsheet program and quickly make charts to visualise trends.

I have similar scripts for monitoring PageRank.

This will still only give me data from the day I begin checking. I do not know of a way to access historical values.

Ad
source: stackoverflow.com
Ad