Re: [imapsync] "UID search / fetch all" cause great delay for large mailbox

[Gilles LAMIRAL <gilles dot lamiral at laposte dot net>]

Hello Nikos,

> I have setup a cyrus-imapd to synchronize with my domino and serve 
> Blackberry requests. My inbox is large (about 100.000 messages) and I 
> set imapsync a --maxage parameter to filter out old mesages. Things are 
> going as expected as imapsync requests the UID of the --maxage messages
>
> Sending: 127 SELECT INBOX
> Sending: 26 SELECT INBOX
> Sending: 128 UID SEARCH sentsince 08-Aug-2010
> Sending: 27 UID SEARCH sentsince 08-Aug-2010
> Sending: 129 UID FETCH 
> 13819,15386,17595,20535,22994,23184,24529,28660,29302,30104,30800,36751,37892,38943,39014,39292,39343,39700,41061,41902,42042,42065,42074,42107,42142,42158,42205,42217,42222,42248:42249,42273,42284,42293,42329,42331,42333,42346,42362,42392,42396,42414:42416,42418,42429,42433,42443,42457,42463,42467,42482,42512:42513,42516:42517,42537,42565:42566,42568,42611,42654,42699,42843,42850,42862,42871,42918,42937,42972,43012,43032,43258,43339,43346:43347,43352,43375,43381,43383,43475,43501,43505,43541:43542,43705,43730,43765,44081,44084,44086,44091,44094,44098:44099,44120,44201,44211,44321,44491,44626,45209,45698,46038,46139,46386,46484,46675,46677,48976:48977,49282,49415,49925,51257,52081,53194 
> BODY.PEEK[HEADER]
>
> and the response time is acceptable. After these commands imapsync issues
>
> Sending: 130 UID SEARCH ALL
> Sending: 131 UID FETCH 1:57829 (FLAGS INTERNALDATE RFC822.SIZE)
>
> which I guess forces domino to parse messages for many minutes and makes 
> the concept unapplicable.
> I don't know IMAP in depth so I cannnot understand why is this full 
> parsing necessary, since we already have the requested UIDs. Please 
> confirm so as to accept the fact that IMAP retrieving from large inbox 
> is inefficient, at least with Domino.

Yes you're right.
Patching imapsync to be less stupid needs less than 4 hours coding.
I've added this wish in the TODO file.
If you need it quickly then a walk to
http://www.linux-france.org/prj/imapsync/#TODO
may show you the way to get it.
You can also code it and gave us the patch or keep it for yourself only.

--
Au revoir,                             09 51 84 42 42
Gilles Lamiral. France, Baulon (35580) 06 20 79 76 06