Thanks I will try that in a few minutes: Update - It is working, I appear to have removed the duplicates using your script, thank you so very much!
Turns out I am on a MySQL 4 server, they tell me they can drop me on a 5 box which is much newer as the box I am on is old.
Question. They are going to create a new account for me and my database and put it to the 5 box, (to see if I am better there) do I have any config changes to make other than pointing to the new address?
1. I should copy the tables from the 4 to the 5? 2. I then need to change my config file to associate to the 5?
Thanks for your help ruirib it really got me out of a jamb. I am now able to archive my site, I now suspect that was not really my problem but it has cleared up a failed archive attempt I did years ago and i am now archiving happily, I have reset the limits to 3 years though from the default 1 year as it is more suitable to my needs.
I think the root of my problem was degradation of the server I am on, I have been working with the hosting company and they have done a number of things to improve my performance so I am once again running on all cylinders. We don't really know what happened so the problem may re-occur, if it does I may opt to be moved to the ver5 platform. . . I hope that won't bring about any new problems. :)