A couple things to remember here. If you are going to have a lot of characters moving about. You would be best suited by creating an LOD system for them. It would help out tremendously. Reducing shadow quality can help.
Also, the end goal for your games fps should be around 60. Game development usually consists of building the world. Then finding ways for it to perform around 60 fps.