schematics

Sprinkling some insight into how Spidermon validation pipelines works…

Someone truly great once quoted that “if you can’t explain it simply. you don’t understand it well enough” That’s the way of life, isn’t it? Hence, I would like to take a shot in explaining how Scrapy‘s bigger brother, Spidermon validates the data scraped by spiders, how the gears turn and in the process, I would learn as well. Let’s jump in.

Let’s DIG IN!