promise-crawler
Promise support for node-crawler (Web Crawler/Spider for NodeJS + server-side jQuery)
Nodejs library for website crawling using node-crawler but on bluebird promises.
Install using npm:
npm i promise-crawler --save
Example:
const PromiseCrawler = ;//Initialize with node-crawler optionsconst crawler = maxConnections: 10 retries: 3; //perform setup and then use itcrawler;