Is there any reason why you can't break the run up into, say, batches of 50 or 100 and then merge the avi files into one upon completion?
To prevent overwrite, could you tag each file with the time as well as frame number, or do a file existence check from a component?
Stuart