User-agent: * Allow: / Disallow: /__wltrap__ # Offline browsers / site copiers are not permitted User-agent: HTTrack Disallow: / User-agent: wget Disallow: / User-agent: WebCopier Disallow: / User-agent: WebZIP Disallow: / User-agent: Teleport Disallow: / User-agent: Offline Explorer Disallow: /