JikeSpider是即刻搜索收集并更新互联网上网页的的一个自动程序,它的作用是访问互联网上的网页,建立索引数据库,使用户能在即刻搜索的相关服务站中检索到您网站上的网页,并向我们的用户推广您的网站。
JikeSpider会根据网页的重要程度,更新频繁度等因素决定重新访问的策略。
通常JikeSpider不会在数秒钟以内多次访问您的网站,但在很少的情况下由于网络的延迟及缓存原因,可能访问的频率在短时间内略有上升。
JikeSpider遵循 robots 协议。禁止JikeSpider访问您的网站,您需要在网站的根目录的 robots.txt(如:www.example.com/robots.txt )中禁止JikeSpider。
示例: 禁止访问网站所有内容 User-agent: JikeSpider Disallow: / 禁止访问网站指定目录 User-agent: JikeSpider Disallow: /private/
Developed by Jike Search, JikeSpider is a program that collects and updates web pages from the internet. It crawls websites and builds index, so that users at Jike can find and visit your websites.
JikeSpider will adjust the crawling strategy based on a series of factors, incl. web page importance, update frequency, etc.
Normally JikeSpider will not visit your website repetitively within just a few seconds. Under very few circumstances, however, revisiting frequency may rise within short period of time due to network delay or caching.
JikeSpider follows robots.txt. In order to prohibit JikeSpider from visiting your website, you can disallow JikeSpider in robots.txt
(for example: www.example.com/robots.txt)
Example: (Disallow all content) User-agent: JikeSpider Disallow: / (Disallow specific directory) User-agent: JikeSpider Disallow: /private/
版权所有©2011 人民搜索 保留所有权利 京ICP备10216100号 免责声明