Sitemap to Airtable synchronisation
Airtable is great for organising and keeping track off the work on your website. If your site is larger than a few pages keeping an airtable base up to date with that data is quite a challenge. This project solves that.
Frequently asked questions
This is a hobby project run just by one person. If you can't find what you're looking for feel free to reach out on twitter
Why did you start this project?
To scratch my own itch. Big fan of Airtable and use it to organise our marketing work. But I had a lot of long-running (and buggy) scripts to keep that airtable data up to date
Which data/fields do you store in airtable?
Url, First/Last seen, (meta) title, (meta) description, (meta) canonical URL
How does it work?
After you tell us the sitemap.xml we crawl it every few hours and ensure your airtable base it up to date with the pages you publish (and add to your sitemap).
Are you sure I can't just do this with Zapier/IFTTT or [insert no-code tool]
I tried. But when you have a lot of pages (200+) it gets challenging having to deal with API throttling limits. Also upsert/updating records is tricky with these tools
Why is it free? And will it always be?
I am currently not interested in monetising. I just want to learn how queuing, airtable API, supabase and other stuff I use works.
How long does it take to sync?
The speed is largely dependant on Airtable API limits. On my site (1000 pages) it takes about 30 minutes for the full sync to complete.