Increase page speed when merging contacts

We have a lot of custom fields which takes us over the default field limit.  This creates log delays of 5 minutes or more when merging duplicate contact records.  We would love the ability to speed up this process despite the large custom field amount!