User-agent: * Disallow: /assets/ Disallow: /v1/ Disallow: /lg_admin/ Disallow: /Raw_Log_Files/