[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [imapsync] Imapsync output question


From Gilles LAMIRAL <gilles dot lamiral at laposte dot net>
Subject Re: [imapsync] Imapsync output question
Date Sun, 07 Dec 2008 01:19:03 +0100

Hello David,

> Imapsync [flag, flag, flag] >> output.log

Do you use the same output.log for all 50 processes ?
On Unix the last writer win.

> When I run my script which runs for 2 hours, on the
> average it transfers 90 gig of data. Imapsync does a
> wonderful job in migrating the email.

45Go/hour is exactly 100 Mbps. 
What is your bandwith 100M, 1G or 10Gbps ?
(bps = bit per second).

imapsync is slow, by design...

> Most of the log files produced are complete with all
> output expected. There are a number of times the log files
> are not complete.  Some of the log files stop in the
> middle of printing a folder and it's email.

Does imapsync stop before it finishes its job ?

> I'm forking 50 connection of imapsync at a time. 

imapsync is a very memory cruncher so you may decrease
this value to see what happens. 50 processes means 100 imap
connections.  I don't know if you speed up the whole
transfer doing so much parallel runs, but may be. You know
better than me, I've never run imapsync in parallel, even 2
processes (believe me).

> I believe this is a buffering issue but how would I
> resolve this issue if the buffering is actually from
> imapsync itself.  How would I flush imapsyncs print
> buffer?

I don't know since imapsync flushes out its stdout buffer on
every single output. It may not be just a flush problem.

-- 
Au revoir,                               02 99 64 31 77
Gilles Lamiral. France, Chavagne (35310) 06 20 79 76 06