![\"better-footprints\"](\"https:\/\/www.jacobking.com\/wp-content\/uploads\/2016\/05\/better-footprints.png\")
Efficient scraping of Google is arguably one of the best skills an SEO can have. Not just scraping any old bullshit though, being able to effectively drill down and find every last bit of whatever it is that you\u2019re looking for.<\/p>\nEfficient scraping of Google is arguably one of the best skills an SEO can have. Not just scraping any old bullshit though, being able to effectively drill down and find every last bit of whatever it is that you\u2019re looking for.<\/p>\n
I\u2019m going to work through an example and scratch the surface to show how hard you can go. Let\u2019s say I\u2019m trying to find SEO blogs that have written about “Scrapebox”<\/p>\n
I\u2019m going to start with my favorite operator, inurl:<\/p>\n
inurl:scrapebox<\/p>\n
Ok so we\u2019ve got some shit about Scrapebox, but we want SEO blogs. Let\u2019s refine it more.<\/p>\n
inurl:scrapebox “by”<\/p>\n
I added “by” because that\u2019s very common on blogs before the author name.<\/p>\n
inurl:scrapebox “by” “blog”<\/p>\n
or<\/p>\n
inurl:scrapebox “by” “Comments”<\/p>\n
We could even add “blog” or “comments” as a lot of people have that text as well.<\/p>\n
Lastly we don\u2019t want Scrapebox.com so let\u2019s finish it off.<\/p>\n
inurl:scrapebox “by” -scrapebox.com<\/p>\n
Note: Don\u2019t worry Google will hit you with a captcha every 2 seconds now days. Just grind through it.<\/p>\n
We could also manipulate the date range to past year only for example. And let\u2019s not forget taking scrapebox.com and putting dropping it into ahrefs<\/a>. You could export all the links and filter out the forums and shit then exclude every URL that contains “scrapbox”, and analyze those to build even more footprints to try and grab everything we\u2019re missing with our current footprint.<\/p>\n Remember to pay attention to the number of results that are returned. If the number is under a few thousand then your footprint is VERY specific. If the results are several million then your footprint is likely too broad. Hit the sweet spot, then merge in dictionary words and stop words to dig deep into the query and extract even more results.<\/p>\n inurl:scrapebox “by” “my” -scrapebox.com I used to use a really large list of stop words but then I reduced it to the most popular ones by “” exact match Google results. You can grab popular stop words<\/a> for free if you’d like. Yup no email option for once, isn’t that nice? I always keep those handy on my desktop for merging them into a scrape. <\/p>\n Also if you are just doing a quick scrape or don’t have any proxies handy, I have to give a shoutout to this handy bookmarklet<\/a>. All you have to do is put your settings to display 100 results.<\/p>\n Then you just click the bookmarklet to grab each page of 100 results. I’ve used it a few times, definitely comes in handy. <\/p>\n All it takes is practice and putting in some the effort then you\u2019ll be a scraping master in no time. If you\u2019d like me to walk through building some more footprints just comment below with an idea. Then I\u2019ll try to add it to the post. Until then, happy scraping :-)<\/p>\n","protected":false},"excerpt":{"rendered":" Efficient scraping of Google is arguably one of the best skills an SEO can have. Not just scraping any old bullshit though, being able to effectively drill down and find every last bit of whatever it is that you\u2019re looking for. I\u2019m going to work through an example and scratch the surface to show how… Read More →<\/a><\/span><\/p>\n","protected":false},"author":2,"featured_media":4390,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/posts\/4387"}],"collection":[{"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/comments?post=4387"}],"version-history":[{"count":0,"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/posts\/4387\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/media\/4390"}],"wp:attachment":[{"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/media?parent=4387"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/categories?post=4387"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.jacobking.com\/wp-json\/wp\/v2\/tags?post=4387"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\ninurl:scrapebox “by” “the” -scrapebox.com
\ninurl:scrapebox “by” “etc.” -scrapebox.com<\/p>\n![\"100-results-on-goog\"](\"https:\/\/www.jacobking.com\/wp-content\/uploads\/2016\/05\/100-results-on-goog.png\")
<\/p>\n