TeamForge : Post

Forum Topic - Slow rm / ls performance using 6.4.0 toolchain: (6 Items)

View: as

Dan Giorgis

08/27/2009 10:01 AM

post36775

Slow rm / ls performance using 6.4.0 toolchain

I'm using 6.4.0 on a Windows XP host.   Command line operations like "rm -f" and "ls" are taking 10x longer under 6.4.0 
than they did under 6.3.0.  This slows down our build process significantly.

Disconnecting the PC from the network (unplugging network cable) eliminates the delay,  so the slowdown has something to
 due to with network activity, perhaps checking filesystem permissions ???

What changed in the Windows binaries  between the 6.3.0 SP3 and 6.4.0 releases?   There is no cygwin1.dll in the host/
win32/x86/usr/bin - is cygwin no longer used?

Aleksandar Ristovski(deleted)

08/27/2009 10:38 AM

post36782

Re: Slow rm / ls performance using 6.4.0 toolchain

Dan Giorgis wrote:
> I'm using 6.4.0 on a Windows XP host.   Command line operations like "rm -f" and "ls" are taking 10x longer under 6.4.
0 than they did under 6.3.0.  This slows down our build process significantly.
> 
> Disconnecting the PC from the network (unplugging network cable) eliminates the delay,  so the slowdown has something 
to due to with network activity, perhaps checking filesystem permissions ???

Not sure why is the delay. I will try to reproduce.

> 
> What changed in the Windows binaries  between the 6.3.0 SP3 and 6.4.0 releases?   There is no cygwin1.dll in the host/
win32/x86/usr/bin - is cygwin no longer used? 

Starting with 6.4.0, we no longer use cygwin binaries, but 
rather msys.

Thanks,

Aleksandar Ristovski

Dan Giorgis

09/08/2009 4:33 PM

post37573

Re: Slow rm / ls performance using 6.4.0 toolchain

Aleksandar -

Any luck in trying to reproduce this?

What version of msys are you using?  Is the source for the binaries freely available?  I thought perhaps I could add 
some debug to the rm / ls operations to see where the slow down is occuring.

Aleksandar Ristovski(deleted)

09/08/2009 5:02 PM

post37578

Re: Slow rm / ls performance using 6.4.0 toolchain

Dan Giorgis wrote:
> Aleksandar -
> 
> Any luck in trying to reproduce this?
> 
> What version of msys are you using?  Is the source for the binaries freely available?  I thought perhaps I could add 
some debug to the rm / ls operations to see where the slow down is occuring.

I tried it on my machine but didn't see the delay. Then I 
unplugged the network cable and again - no delay.

If you want to diagnose this, you can get the sources for 
msys dll from here: 
http://mingw.cvs.sourceforge.net/mingw/msys/rt/src/winsup/cygwin/
You will want sources for version 1.0.11 (I don't think 
building it is very straight forward, unfortunately).

I believe the delay is happening in msys.dll, but I don't 
know where.

You can also try (at your own risk) with updating msys dll 
with the latest.

My guess is that it may have to do with network shares. 
Maybe, as an experiment, you could remove all network mapped 
drives and see if it changes anything.

Thanks,

Aleksandar

David Thompson(deleted)

09/30/2009 3:06 PM

post39124

Re: Slow rm / ls performance using 6.4.0 toolchain

I downloaded msysCORE-1.0.11-bin.tar.gz and upgraded any common binaries and the msys-1.0.dll in $(QNX_HOST)/usr/bin.

Upgrading only the msys dll did not seem to be enough.  One of the other binaries make some contribution.

The upgrade not only eliminated the performance issues of rm/ls, it also reduced a 6.4.1 build test case from 18min to 
less than 5min.

Can I assume QNX will patch this?

Aleksandar Ristovski(deleted)

10/01/2009 11:38 AM

post39207

Re: Slow rm / ls performance using 6.4.0 toolchain

Hello David,

Thank you for taking time to let us know.

So far we have had several reports about poor performance, 
but it is not reproducable on all machines and we don't 
really know what causes the problem.

Your report helps and most probably we will update msys 
tools, but first we would like to identify the culprit.

Thanks,

Aleksandar

Return