221 lines
9.5 KiB
HTML
221 lines
9.5 KiB
HTML
<!DOCTYPE html>
|
|
<html lang="zh-cn">
|
|
|
|
<head>
|
|
<head>
|
|
<meta charset="UTF-8">
|
|
<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1">
|
|
<title>今天有空看了一下自己博客收录的链接，我开始慌了</title>
|
|
<link rel="alternate" type="application/rss+xml" title="优世界" href="/rss.xml">
|
|
<link rel="icon" type="image/x-icon" href="/favicon.ico">
|
|
<link rel='stylesheet' href='/css/main.css'>
|
|
<link rel="stylesheet" href="/css/normalize.css">
|
|
<link rel="stylesheet" href="/css/remixicon.css">
|
|
<link rel="stylesheet" href="/css/uikit.min.css">
|
|
<link rel="stylesheet" href="/css/nprogress.min.css">
|
|
<link rel="stylesheet" href="/css/mywaline.css" />
|
|
<script src="/js/jquery.min.js"></script>
|
|
<script src="/js/barrage.min.js"></script>
|
|
<script src="/js/jquery.scrollUp.min.js"></script>
|
|
<script src="/js/instantpage.min.js" type="module" defer></script>
|
|
<script src="/js/pjax.js"></script>
|
|
|
|
<link rel="stylesheet" href="/css/mywaline.css" />
|
|
|
|
<script>console.log("\n %c Amigo Theme %c https://usj.cc \n", "color: #fadfa3; background: #030307; padding:3px; font-size:12px;", "color: #ffffff;background: #16171a; padding: 3px; font-size: 12px;");</script>
|
|
<meta name="keywords" content="大学,教程,blog,优世界,优设计,博客,大学生博客,生活,文案," />
|
|
<meta name="template" content="Amigo" />
|
|
</head>
|
|
</head>
|
|
|
|
<body>
|
|
|
|
<div class="main">
|
|
<div class="container">
|
|
<div class="header">
|
|
<div class="head_author_img load-memos-editor">
|
|
<img src="/image/avatar.jpg" class="blog-img" width="80" height="80" alt="优世界" />
|
|
</div>
|
|
<div class="site-description">
|
|
<h2><span class="uk-invisible">风吹云散，云卷云舒</span></h2>
|
|
<nav class="nav social uk-visible@m">
|
|
<ul class="flat">
|
|
|
|
|
|
<a href="https://pan.usj.cc" title="GitHub" target="_blank"><i class="ri-cloudy-2-line"></i></a>
|
|
|
|
<a href="https://space.bilibili.com/525472039" title="Twitter" target="_blank"><i class="ri-bilibili-line"></i></a>
|
|
|
|
<a href="https://github.com/imzql" title="LinkedIn" target="_blank"><i class="ri-github-fill"></i></a>
|
|
|
|
|
|
</ul>
|
|
<div class="yiyandes">风吹云散，云卷云舒</div>
|
|
</nav>
|
|
</div>
|
|
<nav class="nav">
|
|
<ul class="flat">
|
|
<li class="active"><a href="/">首页</a></li>
|
|
<li class="active"><a href="/about/">关于</a></li>
|
|
<li class="active"><a href="/says/">留言</a></li>
|
|
<li class="active"><a href="/archives/">归档</a></li>
|
|
<li class="active"><a href="/links/">友链</a></li>
|
|
</ul>
|
|
</nav>
|
|
</div>
|
|
|
|
|
|
|
|
<div id="pjax-container">
|
|
<article style="margin-bottom: 3.5em;">
|
|
<h1 class="post-title" itemprop="name headline">今天有空看了一下自己博客收录的链接，我开始慌了</h1>
|
|
<div class="meta">
|
|
作者: 小赵同学 浏览: 字数: 827 分类:
|
|
|
|
<a href="%e7%94%9f%e6%b4%bb">生活</a>
|
|
|
|
</div>
|
|
<div class="post-content" itemprop="articleBody">
|
|
<p>临近放假，基本上没有什么课了，接下来主要是对考试内容的复习</p>
|
|
<p>咱们专业也是戴上了考试课最多的帽子，结课考试要考七门</p>
|
|
<p>排的是三天考试时间，时间的话，还好，反正比高中考试轻松很多</p>
|
|
<p>下午复习本学期seo课程的时候，心血来潮乘着下午不忙的时候要不要给自己的博客优化一下</p>
|
|
<p>立刻打开百度site了一下我的博客域名</p>
|
|
<p>
|
|
<img data-lazy-src="/pics/2021/12/3474612636.png" alt="" class="lazyload"></p>
|
|
<p>一个月前看还是单纯的一个首页，惊喜的发现自己链接已经被收录了30条</p>
|
|
<p>惊喜的同时也给我带来了惊吓，自己的一篇文章被百度搜索引擎重复收录了二十多篇，这…….</p>
|
|
<p>
|
|
<img data-lazy-src="/pics/2021/12/2188990027.png" alt="69539-i5x6ikt0m7t.png" class="lazyload"></p>
|
|
<p>
|
|
<img data-lazy-src="/pics/2021/12/3044843184.png" alt="67212-0lsjunim57ce.png" class="lazyload"></p>
|
|
<p>
|
|
<img data-lazy-src="/pics/2021/12/1721481832.png" alt="45966-heisviuud69.png" class="lazyload"></p>
|
|
<p>仔细分析发现这些被重复收录的链接基本上都是 ?replyTo= 这样的参数页，每个评论参数都被搜索引擎误认为一个新的页面</p>
|
|
<p>导致了百度蜘蛛的重复抓取和重复收录，还记得上课SEO老师讲过，搜索引擎重复收录一个页面链接</p>
|
|
<p>等百度引擎排查会认为你是批量做收录，会被拉入收录黑名单，汗，我这个不就正是这样吗，焯！</p>
|
|
<p>再仔细排查其他收录的链接，也有几篇收录的rss订阅链接，访客点进去，一堆看不懂的xml的代码</p>
|
|
<p>
|
|
<img data-lazy-src="/pics/2021/12/25366019.png" alt="" class="lazyload"></p>
|
|
<p>访客看见这些页面肯定会一下跳出去，这样只会增加自己的文章跳出率和网站的跳出率，不利于流量的留存</p>
|
|
<p>文章跳出率较高百度蜘蛛会认为你的文章质量不高，也会降低收录速度</p>
|
|
<p>解决方法其实很简单，在网站根目录放置一个 robots.txt 文件告诉各大搜索引擎蜘蛛那些目录可以爬，那些目录不可以爬</p>
|
|
<p>当然还是自己做博客之前的疏忽，才导致这样的结果，亡羊补牢，为时不晚，写了个 robots.txt 放入网站根目录</p>
|
|
<blockquote>
|
|
<p>User-agent: *</p>
|
|
<p>Disallow:</p>
|
|
<p>Disallow: /feed</p>
|
|
<p>Disallow: /<em>?replyTo=</em></p>
|
|
<p>Disallow: /admin</p>
|
|
</blockquote>
|
|
<p>这里我主要是对后台地址和订阅地址，评论参数进行禁止访问</p>
|
|
<p>这样等待下次搜索引擎抓取更新，这些被重复收录的链接，就会被清理掉</p>
|
|
<p>如果担心自己的规则写错，也可以在百度资源平台的站点管理测试一下</p>
|
|
<p>
|
|
<img data-lazy-src="/pics/2021/12/361471895.png" alt="28381-e0x3y1nybu9.png" class="lazyload"></p>
|
|
<p>
|
|
<img data-lazy-src="/pics/2021/12/2358107089.png" alt="24044-jspgtajhno.png" class="lazyload"></p>
|
|
<p>
|
|
<img data-lazy-src="/pics/2021/12/3329546138.png" alt="47008-7ycb9p20629.png" class="lazyload"></p>
|
|
<p>这样，测试之后，自己写的规则就生效了</p>
|
|
<p>当然不在意收录的博友可以忽略这些步骤</p>
|
|
<p>我的博客即将同步至腾讯云+社区，邀请大家一同入驻：https://cloud.tencent.com/developer/support-plan?invite_code=u6wnjiw8l3gr</p>
|
|
<p>感谢来访</p>
|
|
|
|
</div>
|
|
<div class="post-tags" style="margin-top: -30px;">
|
|
<nav class="nav tags">
|
|
<ul class="flat">
|
|
|
|
</ul>
|
|
</nav>
|
|
</div>
|
|
</article>
|
|
<hr class="uk-divider-icon">
|
|
<div id="comments" class="comments-area">
|
|
|
|
|
|
<link
|
|
rel="stylesheet"
|
|
href="/css/mywaline.css"
|
|
/>
|
|
<div id="waline" uk-scrollspy="cls:uk-animation-fade;delay: 300"></div>
|
|
<script src="/js/waline.js"></script>
|
|
|
|
|
|
|
|
</div>
|
|
|
|
<script>
|
|
for(let i =0;i<=100;i++){
|
|
loadBarrager();
|
|
}
|
|
function loadBarrager() {
|
|
|
|
var currentPath = "\/post\/39\/";
|
|
|
|
|
|
fetchCommentsAndCreateBarrager(currentPath, {
|
|
looper_time: 3000,
|
|
defaultAvatar: 'static/default-avatar.png',
|
|
defaultInfo: 'No comment',
|
|
defaultLink: '#',
|
|
speed: 10,
|
|
});
|
|
}
|
|
</script>
|
|
</div>
|
|
|
|
|
|
|
|
<div class="footer">
|
|
<nav class="nav" style="clear: both;">
|
|
© 2019 - 2024
|
|
<br>
|
|
<a href="https://beian.miit.gov.cn/" target="_blank"><span style="color:#999999;">鄂ICP备2022015735号-1</span></a>
|
|
<br>
|
|
本站由<a href="https://www.upyun.com/?utm_source=lianmeng&utm_medium=referral" target="blank" title="又拍云"
|
|
style="display:inline-block;text-decoration:none;height:20px;line-height:20px;">
|
|
<span style="color: var(--contentColor);font-weight: 700;">又拍云CDN</span>
|
|
</a>提供CDN加速服务
|
|
<br>
|
|
</nav>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<script src="/js/iconfont.js"></script>
|
|
<script src="/js/lightgallery.umd.min.js"></script>
|
|
<script src="/js/uikit.min.js"></script>
|
|
<script src="/js/EasyLazyload.min.js"></script>
|
|
<script src="/js/view-image.min.js"></script>
|
|
<script src="/js/main.js"></script>
|
|
<script src="/js/mypjax.js"></script>
|
|
<script src="/js/nprogress.js"></script>
|
|
<script src="/js/echarts.min.js"></script>
|
|
<script src="/js/waline.js"></script>
|
|
<script>
|
|
document.addEventListener('DOMContentLoaded', function () {
|
|
if (document.querySelector("#waline")) {
|
|
Waline.init({
|
|
el: '#waline',
|
|
serverURL: 'https://waline.usj.cc',
|
|
lang: "zh-cn",
|
|
imageUploader: false,
|
|
search: false,
|
|
copyright: false,
|
|
reaction: [
|
|
'/image/EhqxZ6DFIJojGNa.gif',
|
|
'/image/qmf5As3evWNXwGQ.gif',
|
|
'/image/ueWLPkmYw75x4cs.gif',
|
|
'/image/nsC1OGoBKfa8Hel.gif',
|
|
'/image/VKuBXqR91TPHnyc.gif',
|
|
'/image/2OmAWPeulq4ta8T.gif'
|
|
],
|
|
});
|
|
}
|
|
});
|
|
</script>
|
|
</body>
|
|
|
|
</html>
|
|
|