Should I delete unused mods?

If my site is done, or as close as a site can get (they are rarely ever done...more so one is done with them).  should I delete any unused mods from my mod directory.  If so... why?  : )