This talk is ideal for technical SEOs with a couple of years' experience who are comfortable with SSH, have some knowledge of setting up servers, and are beginning to incorporate AI tools into their workflows.
In this talk, Jonathon will talk you through how to build a bespoke technical SEO crawler using Node.js. He will cover the fundamentals of crawler architecture, explain how to extract and analyse critical on-page SEO elements, and demonstrate how to identify common issues such as broken links, redirect chains, and indexation problems.
The session will include practical examples of using popular Node.js libraries, managing asynchronous requests, and generating structured outputs for SEO audits. Whether you're an engineer, SEO specialist, or curious technologist, you’ll leave with a clear understanding of how to create your own flexible, scalable SEO crawler from the ground up.
