怎么有效禁止虚假百度蜘蛛【2021年亲测有效】
<img src="https://mmbiz.qpic.cn/mmbiz_jpg/D1pMIEhzR6l7Jo9Rd7QMnkc5X9et0zGYUqQT3KP9vC9qtt6fkxG9EgmCG4AD1MzXxmfywMYdtI7Q7x3BWrict8g/640?wx_fmt=jpeg&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;"><p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">魔贝课凡</p>
<p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">一个IT互联网人的知识分享基地</p><img src="https://mmbiz.qpic.cn/mmbiz_png/D1pMIEhzR6l7Jo9Rd7QMnkc5X9et0zGYWxxmYteJsicPTdImvzuHfUQA6KGibiaDpdLG1BzZ0tiaWrmVqoNnaJ1brQ/640?wx_fmt=jpeg&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;"><span style="color: black;"><strong style="color: blue;">世界上<span style="color: black;">仅有</span>一种病，穷病</strong></span><strong style="color: blue;">。</strong><span style="color: black;"><strong style="color: blue;">—《我不是药神》</strong></span>
<p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><span style="color: black;">咱们</span>在分析网站日志的时候，常常会<span style="color: black;">发掘</span><span style="color: black;">有些</span>莫名其妙的IP段，<span style="color: black;">怎么样</span>分辨这些IP段<span style="color: black;">是不是</span>为真正的百度蜘蛛呢？<span style="color: black;">倘若</span>是虚假的百度蜘蛛<span style="color: black;">咱们</span>能否进行禁止<span style="color: black;">或</span>屏蔽呢？答案是<span style="color: black;">能够</span>的。</span></p><span style="color: black;">先来介绍<span style="color: black;">怎么样</span>分辨真假百度蜘蛛；</span><span style="color: black;">
<p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">其次，在网站日志中统计所有<span style="color: black;">必须</span><span style="color: black;">查找</span>的IP<span style="color: black;">位置</span>；</p>
</span><span style="color: black;"> <span style="color: black;">首要</span>，<span style="color: black;">针对</span>非苹果电脑用户，按住【windows+R】快捷键，打开“运行”，如下图 所示；</span> <img src="https://mmbiz.qpic.cn/mmbiz_png/D1pMIEhzR6lOibhUW1l1Jic8PnOxJIloJjOYWonLyWQlXiaD5Phbxia6sjYs9qBZUPJE8SSQkKA6VRbD7q6DtoEbzA/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;"> <span style="color: black;">第三，在“文本框”内输入“cmd”，<span style="color: black;">而后</span>按Enter键，<span style="color: black;">或</span>单击“确定”按钮！单击Enter键之后打开如下的对话框；</span><img src="https://mmbiz.qpic.cn/mmbiz_jpg/D1pMIEhzR6lOibhUW1l1Jic8PnOxJIloJjrgia21pCJDjic55y16UhGW28taEvicLpGZMVRs9ZQDiakicMfDZibNnDBib5Q/640?wx_fmt=jpeg&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;"><span style="color: black;">第四，在光标位置处输入nslookup 123.125.71.95，中间有一个空格；<span style="color: black;">亦</span><span style="color: black;">能够</span>先复制IP，<span style="color: black;">而后</span>在光标处右击，就会完成粘贴；IP输入完成后，按Enter就<span style="color: black;">能够</span><span style="color: black;">显现</span>分析结果；从下图<span style="color: black;">能够</span>看出这个IP是真正的百度蜘蛛。</span><img src="https://mmbiz.qpic.cn/mmbiz_jpg/D1pMIEhzR6lOibhUW1l1Jic8PnOxJIloJjAiaI90Geed14NCfwk499GwCTw5icLHrEMONVHSibvFpDewE9BFHpDM0WA/640?wx_fmt=jpeg&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;"><span style="color: black;"><span style="color: black;">经过</span>此<span style="color: black;">办法</span>，<span style="color: black;">咱们</span>还<span style="color: black;">能够</span><span style="color: black;">发掘</span>谷歌蜘蛛、360蜘蛛、搜狗蜘蛛、<span style="color: black;">神马</span>蜘蛛等。分辨真正百度蜘蛛的<span style="color: black;">办法</span>还有<span style="color: black;">非常多</span>，<span style="color: black;">大众</span><span style="color: black;">能够</span>自己百度一下并实操。<span style="color: black;">倘若</span>你不想让某一个或某几个虚假百度蜘蛛爬取你网站的内容，<span style="color: black;">咱们</span>就<span style="color: black;">能够</span>禁止或屏蔽这些IP，<span style="color: black;">怎么样</span>屏蔽呢？有2种<span style="color: black;">办法</span>。</span><span style="color: black;"> <span style="color: black;">第1</span>种<span style="color: black;">办法</span>：从服务器的防火墙上屏蔽IP，<span style="color: black;">不外</span>爬虫<span style="color: black;">一般</span>有<span style="color: black;">非常多</span>IP，<span style="color: black;">咱们</span><span style="color: black;">能够</span>屏蔽爬虫的IP段；<span style="color: black;">然则</span><span style="color: black;">倘若</span>爬虫的IP段<span style="color: black;">无</span>规律，那此种<span style="color: black;">办法</span>就不适用了。</span><span style="color: black;">第二种<span style="color: black;">办法</span>；.htaccess屏蔽虚假百度蜘蛛。有<span style="color: black;">有些</span>虚假的百度爬虫并不遵守robots规则，那<span style="color: black;">咱们</span>还<span style="color: black;">能够</span><span style="color: black;">经过</span>.htaccess来屏蔽它，代码如下：</span><img src="https://mmbiz.qpic.cn/mmbiz_jpg/D1pMIEhzR6lOibhUW1l1Jic8PnOxJIloJj1Kke6y5zlTzfL1neaiaTCa3GCRicpMDc9synWdCf88VnymicKBfiaTGClQ/640?wx_fmt=jpeg&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;"><span style="color: black;"> 上图中htaccess屏蔽蜘蛛的<span style="color: black;">办法</span>是一种比较简单的<span style="color: black;">办法</span>，还有其他的<span style="color: black;">有些</span><span style="color: black;">办法</span><span style="color: black;">能够</span><span style="color: black;">运用</span>，感兴趣的小伙伴<span style="color: black;">能够</span>尝试一下。<span style="color: black;">倘若</span>你在操作过程中遇到<span style="color: black;">有些</span>问题，欢迎咨询魔<span style="color: black;">贝课</span>凡，魔<span style="color: black;">贝课</span>凡专注于线上seo培训，任何<span style="color: black;">相关</span>seo的问题都<span style="color: black;">能够</span>咨询<span style="color: black;">咱们</span>；<span style="color: black;">同期</span>你想系统的<span style="color: black;">加强</span>你的seo技能，魔贝课凡是你不二的<span style="color: black;">选取</span>，魔贝课凡是腾讯课堂的top合作<span style="color: black;">公司</span>，想<span style="color: black;">认识</span>的<span style="color: black;">能够</span>到腾讯课堂上搜一搜。</span><img src="https://mmbiz.qpic.cn/mmbiz_jpg/D1pMIEhzR6lOibhUW1l1Jic8PnOxJIloJjRC8xJXkNE4MsAE2cicAKibULh9B4XgniawfEibKV9ehejCCibkFp91qrAzA/640?wx_fmt=jpeg&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;">
<p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">凯文</p>
<p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">魔<span style="color: black;">贝课</span>
</span></p>
<p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">凡SEO讲师</p>
<p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">5年SEO实战经验</p><span style="color: black;">对SEO<span style="color: black;">关联</span>数据有较强的分析能力，<span style="color: black;">熟悉</span><span style="color: black;">运用</span><span style="color: black;">各样</span>SEO<span style="color: black;">工具</span>，推广成绩优越。<span style="color: black;">善于</span>网站推广利用互联网平台对网络资源的整合进行推广网站，<span style="color: black;">重要</span>词排名。熟悉<span style="color: black;">认识</span>Baidu等各大搜索引擎的原理和特点，熟悉排名规则和规律，并制定优化策略</span>
<img src="https://mmbiz.qpic.cn/mmbiz_jpg/D1pMIEhzR6kI3YvxasDSXUwz16EAkEgA5icicMY863icnHfTFoicgylY2gt8qZwzrcxSsX3Cz11JkMlibBibN3wAeCeA/640?wx_fmt=jpeg&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;"><img src="https://mmbiz.qpic.cn/mmbiz_png/D1pMIEhzR6l7Jo9Rd7QMnkc5X9et0zGYMEYpE94iaFQyskBqjOEAkqcQPR8PiajDJplDibwt39VtnicpiaFIeL0Y9WA/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1&wx_co=1" style="width: 50%; margin-bottom: 20px;">长按指纹，识别二维码，一键关注
外贸B2B平台有哪些？ 你说得对，我们一起加油，未来可期。 “BS”（鄙视的缩写） 认真阅读了楼主的帖子，非常有益。
页:
[1]