BuildShip Logo
BuildShip Templates

Auto-Index Websites to Google

Automatically indexes all URLs from a website sitemap to Google Search. Accepts a sitemap URL, extracts and batches the URLs, checks their indexing status, submits new or updated URLs to Google Search Console, and returns a summary of indexing results.

84

Report this template

Select the reason for reporting

Describe the issue in detail

Share template

Link to template

https://templates.buildship.com/template/7ZQotyruzF3n/

Inputs

sitemapUrl

https://docs.buildship.com/sitemap.xml
This is a static example using sample inputs. Remix the template to run it with your own values.

Output

Read me

🌟 Auto-Index Websites to Google

Index all the pages of your website quickly and easily in just one click using your Sitemap URL. The workflow intelligently figures out the new pages to be indexed on Google Search.

No manual work required to add website URL one by one on your Google Search Console. Add in CRON triggers to make the workflow execute periodically, lets say every week for every new pages being added frequently.

This workflow goes through the provided sitemap file, loops through all the links and sub-sitemaps and aggregates all the links. These URLs are then used to sync to the Google Search Index. The workflow returns a categorized list of the URLs - fresh pages, updated pages, and not updated (already up to date) pages.

🚦 Quick Note: The Google Indexing and Metadata API are rate limited at 180 req/min and 200 req/day respectively. As a solution, we use the DeepSleep node to pause the BuildShip Workflow execution for a day. It auto-resumes the next day such that the requests do not fail with a 429 status code - too many requests.

Prerequisites

  • A Google Search Console account associated with your website
  • Sitemap URL for your website

✍️ How to Use

Step 1: Clone the "Auto-Index Websites to Google" template

Step 2: Authenticate the Index Site to Google Search Console node with your Google Account which has the permissions to the Google Search Console for your website

If you've not set up the website already

Step 3: Run workflow test with your Sitemap URL

🔗 Resources