Doing that could present the opposite problem - assume your pagination is such that the last comment is the only one displayed, if you delete that comment you get forwarded to a page with an invalid offset.

I didn't say it was a great fix:) but i have never had that happen but it is really frustrating to not having ELGG keep you where you were and it is across elgg not just this example.  Many other sites and forums have the ablity to stay where you are or go directly to a comment etc..