[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [imapsync] Imapsync output question
|
From |
Gilles LAMIRAL <gilles dot lamiral at laposte dot net> |
|
Subject |
Re: [imapsync] Imapsync output question |
|
Date |
Sun, 07 Dec 2008 01:19:03 +0100 |
Hello David,
> Imapsync [flag, flag, flag] >> output.log
Do you use the same output.log for all 50 processes ?
On Unix the last writer win.
> When I run my script which runs for 2 hours, on the
> average it transfers 90 gig of data. Imapsync does a
> wonderful job in migrating the email.
45Go/hour is exactly 100 Mbps.
What is your bandwith 100M, 1G or 10Gbps ?
(bps = bit per second).
imapsync is slow, by design...
> Most of the log files produced are complete with all
> output expected. There are a number of times the log files
> are not complete. Some of the log files stop in the
> middle of printing a folder and it's email.
Does imapsync stop before it finishes its job ?
> I'm forking 50 connection of imapsync at a time.
imapsync is a very memory cruncher so you may decrease
this value to see what happens. 50 processes means 100 imap
connections. I don't know if you speed up the whole
transfer doing so much parallel runs, but may be. You know
better than me, I've never run imapsync in parallel, even 2
processes (believe me).
> I believe this is a buffering issue but how would I
> resolve this issue if the buffering is actually from
> imapsync itself. How would I flush imapsyncs print
> buffer?
I don't know since imapsync flushes out its stdout buffer on
every single output. It may not be just a flush problem.
--
Au revoir, 02 99 64 31 77
Gilles Lamiral. France, Chavagne (35310) 06 20 79 76 06