Say I have a site on https://example.com. I would really like allowing bots to see the home page, but any other page need to blocked as it is pointless to spider. In other words. I wou
阅读背景：
如何设置只允许站点的默认页面的robot.txt
来源：互联网
分享到：
