CompTIA PenTest+ (PT1-002) — Question 20

Given the following output:
User-agent:*
Disallow: /author/

Disallow: /xmlrpc.php -

Disallow: /wp-admin -
Disallow: /page/
During which of the following activities was this output MOST likely obtained?

Answer options

• A. Website scraping
• B. Website cloning
• C. Domain enumeration
• D. URL enumeration

Correct answer: A

Explanation

The output provided is a part of a robots.txt file, which is commonly accessed during website scraping to understand which parts of the site are restricted from bots. The other options, while related to web activities, do not typically involve analyzing robots.txt files for disallowed paths.