discuss: TARPL news 2005 week 21
Subject:
Re: TARPL news 2005 week 21
From:
Stein Gjoen ####@####.####
Date:
12 Jun 2005 12:23:39 -0000
Message-Id: <42AC284F.7060005@mail.nyx.net>
Tony Dodd wrote:
> Stein Gjoen wrote:
>>This weeks news is further improvement on the web correlator, see
>> http://www.nyx.net/~sgjoen/tarpl.html
>>
>>Note that the sample report is 500KB in size and is bigger than what
>>fits on a 1200 x 1600 screen. It might fit on an A3 paper sheet.
>>Processing 3000 hits takes 5 minutes on a low end machine so while
>>it should be ready to crunch the hit log for TLDP web pages it would
>>take a lot of time.
> I can provide a medium spec server to dedicate to this if that helps.
This could be very useful since longs from TLDP will be huge.
Someone was looking into these logs but I have still not heard
a word on what is happening about that.
I don't know the internals of AWK but with these huge tables it
is quite possible the analysis will require a fair bit of RAM.
Regards,
Stein Gjoen
