Google Search Console (GSC), formerly Webmaster Tools, is a free service offered by Google that helps you monitor and maintain your site’s presence in Google search results. You don’t need to sign up for GSC for your site to be included in Google’s search results, but doing so can help you understand how Google views your site and optimize its performance in search results. Unfortunately, Google only stores the past 90 days of search analytic data within GSC, therefore clients must develop an archiving process to make quarter-over-quarter or year-over-year comparisons of general development of SEO rankings.
When choosing a service to develop a solution to continuously archive search analytics data, ensure you look at these google cloud platform products:
- BigQuery (BQ)
Maintain and worry free database cloud application to store and query your data from.
- App Engine (GAE)
Powerful platform to build both web and mobile apps. It’s very scalable and takes away the headache that comes along with a regular server.
- Cloud Storage (GCS)
Simple cloud storage solution to store data of all types and formats
Using these three products in conjunction with the GSC API which can query your search analytics data back 90 days, Analytics Pros developed a solution to archive GSC data as it becomes available. The architecture looks as follows:
Besides syncing the daily data that becomes available after a few days, the program can also kick start the BigQuery tables by backfilling the past 90 days of available data. Having data available for year-over-year comparison can give you insight into keyword search performance and the CTR of your landing pages. With this information in hand, you can put together a plan to address any issues found. Archiving search analytics data in BigQuery allows you to analyze how you perform in yearly annual seasonal search trends—something not possible without implementing an archiving process.
Reach out to Analytics Pros if you’re interested in deploying this solution. We can help!