If you click on any letter in the members section, it gives you the total number of members at the bottom.
Deleting inactive members would not accomplish anything. If someone comes back after a year (it happens, trust me!) and their account isn't there anymore, they'd probably be mad... so only bad things can come of deleting members.
Matt