A user agent is a great tool for web scraping. Although it may not be the most used technique, it is very useful for scraping.