User-agent: * Disallow: /dev/ Disallow: /wholesale/ Disallow: /magento/ Disallow: /app/ Disallow: /archive/ Disallow: /cgi-bin/