The virtual robots.txt file is generated via the do_robots() function, along with any directives added via the robots_tx