Application of distributed web crawlers in information management system