I'm getting errors where a robot is seeing pages that have been deleted. These should be botted out. Are you able to do this automatically?

 
 
In admin, you can create an exceptions robot list.  Below is a screenshot of this area.  You can visit http://www.robotstxt.org/orig.html for some formatting examples for setting this up.