how to scrape serps to optimize for search intent

we need to try and tie that back to specific change or changes..   This concept was then developed in great article from BuiltVisibile, which walked through how you can use the same process to scrape results from 'People Also Ask suggestions that Google displays for certain keywords...   Configuration > Spider > Rendering > JavaScript.   When you've run your report, running go to Custom tab Screaming Frog then set Filter dropdown to Extraction..   With bit of luck, you should see set of page titles and meta descriptions returned for your target keywords, matching the criteria you specified with your URL parameters..   this is the I generated..   I also find that you can roll this out to list and it will be accurate..    You can use this research methodology to better match the types of content you are creating to the intent that Google seems to be most favoring for your target queries..   Beyond that, it's that traffic will perform well once it arrives on the site from engagement or conversion perspective ..   There's lot more you can do with custom extractions, especially custom SERP extractions, that can help with your SEO strategy, so I hope this article is useful and can act as framework for your own SERP extraction experiments..   Read more