Home Explore Help
Sign In
heckyel
/
porfolio
mirror of https://c.hgit.ga/services/portfolio.git
Watch 1
Star 0
Fork 0
Files
Branch: master
Branches Tags
porfolio
/
robots.txt

robots.txt 1.1 KB
Permalink History Raw

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677787980818283848586878889909192 
  1. User-Agent: Googlebot
    2. 

  2. Disallow: /login
    3. 

  3. Disallow: /admin
    4. 

  4. Disallow: /download
    5. 

  5. 

  6. User-Agent: *
    7. 

  7. Disallow: /login
    8. 

  8. Disallow: /admin
    9. 

  9. 

  10. User-agent: Orthogaffe
    11. 

  11. Disallow: /
    12. 

  12. 

  13. User-agent: UbiCrawler
    14. 

  14. Disallow: /
    15. 

  15. 

  16. User-agent: DOC
    17. 

  17. Disallow: /
    18. 

  18. 

  19. User-agent: Zao
    20. 

  20. Disallow: /
    21. 

  21. 

  22. User-agent: Zealbot
    23. 

  23. Disallow: /
    24. 

  24. 

  25. User-agent: MSIECrawler
    26. 

  26. Disallow: /
    27. 

  27. 

  28. User-agent: SiteSnagger
    29. 

  29. Disallow: /
    30. 

  30. 

  31. User-agent: WebStripper
    32. 

  32. Disallow: /
    33. 

  33. 

  34. User-agent: WebCopier
    35. 

  35. Disallow: /
    36. 

  36. 

  37. User-agent: Fetch
    38. 

  38. Disallow: /
    39. 

  39. 

  40. User-agent: Offline Explorer
    41. 

  41. Disallow: /
    42. 

  42. 

  43. User-agent: Teleport
    44. 

  44. Disallow: /
    45. 

  45. 

  46. User-agent: TeleportPro
    47. 

  47. Disallow: /
    48. 

  48. 

  49. User-agent: WebZIP
    50. 

  50. Disallow: /
    51. 

  51. 

  52. User-agent: linko
    53. 

  53. Disallow: /
    54. 

  54. 

  55. User-agent: HTTrack
    56. 

  56. Disallow: /
    57. 

  57. 

  58. User-agent: Microsoft.URL.Control
    59. 

  59. Disallow: /
    60. 

  60. 

  61. User-agent: Xenu
    62. 

  62. Disallow: /
    63. 

  63. 

  64. User-agent: larbin
    65. 

  65. Disallow: /
    66. 

  66. 

  67. User-agent: libwww
    68. 

  68. Disallow: /
    69. 

  69. 

  70. User-agent: ZyBORG
    71. 

  71. Disallow: /
    72. 

  72. 

  73. User-agent: Download Ninja
    74. 

  74. Disallow: /
    75. 

  75. 

  76. User-agent: wget
    77. 

  77. Disallow: /
    78. 

  78. 

  79. User-agent: grub-client
    80. 

  80. Disallow: /
    81. 

  81. 

  82. User-agent: k2spider
    83. 

  83. Disallow: /
    84. 

  84. 

  85. User-agent: NPBot
    86. 

  86. Disallow: /
    87. 

  87. 

  88. User-agent: WebReaper
    89. 

  89. Disallow: /
    90. 

  90. 

  91. Sitemap: https://heckyel.ga/sitemap.xml
    92. 

  92.