[Gc] Performance of bdwgc7.2 had degraded compared to 6.8

Carsten Kehler Holst kehler at pdc.dk
Wed Nov 24 02:09:49 PST 2010


	7.2a4		7.2a2		7.1		7.0
7.0a7		6.8
	

bague	0,76	98,70%	0,77	100,00%	0,77	100,00%	0,76	98,70%
0,77	100,00%	0,77
beval	1,33	101,53%	1,41	107,63%	1,29	98,47%	1,41	107,63%
1,29	98,47%	1,31
boyer	2,23	103,72%	2,23	103,72%	2,13	99,07%	2,14	99,53%
2,13	99,07%	2,15
cgc	0,47	102,17%	0,48	104,35%	0,48	104,35%	0,47	102,17%
0,48	104,35%	0,46
conform	1,91	106,70%	1,91	106,70%	1,74	97,21%	1,72	96,09%
1,73	96,65%	1,79
earley	2,49	111,66%	2,5	112,11%	2,08	93,27%	2,13	95,52%
2,09	93,72%	2,23
fib	0,01	100,00%	0,01	100,00%	0,01	100,00%	0,01	100,00%
0,01	100,00%	0,01
fft	2,51	100,80%	2,52	101,20%	2,52	101,20%	2,5	100,40%
2,52	101,20%	2,49
leval	1,12	102,75%	1,13	103,67%	1,05	96,33%	1,01	92,66%
1,02	93,58%	1,09
maze	1,67	120,14%	1,4	100,72%	1,36	97,84%	1,35	97,12%
1,26	90,65%	1,39
mbrot	7,03	99,72%	7,05	100,00%	7,04	99,86%	7,03	99,72%
7,05	100,00%	7,05
nucleic	1,18	88,06%	1,2	89,55%	1,2	89,55%	1,16	86,57%
1,16	86,57%	1,34
peval	1,46	123,73%	1,47	124,58%	1,2	101,69%	1,19	100,85%
1,2	101,69%	1,18
puzzle	1,96	101,55%	1,92	99,48%	1,97	102,07%	1,96	101,55%
1,92	99,48%	1,93
queens	2,29	159,03%	2,29	159,03%	1,55	107,64%	1,56	108,33%
1,55	107,64%	1,44
qsort	1,65	101,23%	1,64	100,61%	1,63	100,00%	1,62	99,39%
1,63	100,00%	1,63
rgc	1,28	100,00%	1,28	100,00%	1,23	96,09%	1,23	96,09%
1,24	96,88%	1,28
sieve	1,58	104,64%	1,6	105,96%	1,44	95,36%	1,42	94,04%
1,41	93,38%	1,51
traverse	5,14	143,58%	5,15	143,85%	3,55	99,16%	3,6
100,56%	3,56	99,44%	3,58
alabench	1,45	99,32%	1,45	99,32%	1,45	99,32%	1,45
99,32%	1,45	99,32%	1,46
	

	39,52		39,41		35,69		35,72
35,47		36,09
	109,50%		109,19%		98,89%		98,97%
98,28%		100%



-----Original Message-----
From: gc-bounces at linux.hpl.hp.com [mailto:gc-bounces at linux.hpl.hp.com]
On Behalf Of Manuel.Serrano at inria.fr
Sent: 24. november 2010 08:18
To: Ivan Maidanski
Cc: gc at linux.hpl.hp.com; bigloo mailling list
Subject: Re: Re[4]: [Gc] Performance of bdwgc7.2 had degraded compared
to 6.8

> Good. I see growth. Could you also provide test results for v6.8,
v7.2alpha2 and gc7.0alpha7?
> (representing all 6 variants in a table form is preferred).
It has been a little bit painful to run the Bigloo compiler with these
versions of the collector that had not been supported when they had been
released. However I did it and I hope it will help.
Here are the results:

ps: Just an additional information I have forgotten to mention, all
these benchmark are single threaded. The collector is configured with
--disable-gcj-support --disable-java-finalization --disable-libcord and
compiled with the extra option -DFINALIZE_ON_DEMAND. If you want to run
the tests by yourself, download Bigloo and the test suite that are
available at :

  ftp://ftp-sop.inria.fr/indes/fp/Bigloo/bigloo3.5a.tar.gz


== 7.2alpha4
============================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.2alpha4/bglstone/../bin/bigloo-
version`"
/misc/lab/bigloo/bench/3.5b-7.2alpha4/bglstone/bin/runit bigloo.runit -v
> bigloo.stat Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1
0.76s (cpu+sys) Executing [(cd ./beval/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.33s (cpu+sys) Executing [(cd
./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.23s (cpu+sys) Executing
[(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O ../src/long.c >
/dev/null)]....5.4.3.2.1 0.47s (cpu+sys) Executing [(cd
./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.91s (cpu+sys) Executing
[(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.49s (cpu+sys)
Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s (cpu+sys)
Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.51s (cpu+sys)
Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.12s
(cpu+sys) Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.67s (cpu+sys) Executing [(cd ./mbrot/bigloo;
./bigloo.exe)]....5.4.3.2.1 7.03s (cpu+sys) Executing [(cd
./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.18s (cpu+sys) Executing
[(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.46s (cpu+sys)
Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.96s
(cpu+sys) Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1
2.29s (cpu+sys) Executing [(cd ./qsort/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.65s (cpu+sys) Executing [(cd ./rgc/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.28s (cpu+sys) Executing [(cd
./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.58s (cpu+sys) Executing
[(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 5.14s (cpu+sys)
Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 7.2alpha2
============================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.2alpha2/bin/bigloo -version`"
/misc/lab/bigloo/bench/3.5b-7.2alpha2/bglstone/bin/runit bigloo.runit -v
> bigloo.stat
   Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.77s
(cpu+sys)
   Executing [(cd ./beval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.41s
(cpu+sys)
   Executing [(cd ./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.23s
(cpu+sys)
   Executing [(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O
../src/long.c > /dev/null)]....5.4.3.2.1 0.48s (cpu+sys)
   Executing [(cd ./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.91s
(cpu+sys)
   Executing [(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.5s
(cpu+sys)
   Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s
(cpu+sys)
   Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.52s
(cpu+sys)
   Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.13s
(cpu+sys)
   Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.4s
(cpu+sys)
   Executing [(cd ./mbrot/bigloo; ./bigloo.exe)]....5.4.3.2.1 7.05s
(cpu+sys)
   Executing [(cd ./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.2s
(cpu+sys)
   Executing [(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.47s
(cpu+sys)
   Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.92s
(cpu+sys)
   Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.29s
(cpu+sys)
   Executing [(cd ./qsort/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.64s
(cpu+sys)
   Executing [(cd ./rgc/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.28s
(cpu+sys)
   Executing [(cd ./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.6s
(cpu+sys)
   Executing [(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 5.15s
(cpu+sys)
   Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 7.1
==================================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.1/bglstone/../bin/bigloo-versio
n`"
/misc/lab/bigloo/bench/3.5b-7.1/bglstone/bin/runit bigloo.runit -v >
bigloo.stat Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1
0.77s (cpu+sys) Executing [(cd ./beval/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.29s (cpu+sys) Executing [(cd
./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.13s (cpu+sys) Executing
[(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O ../src/long.c >
/dev/null)]....5.4.3.2.1 0.48s (cpu+sys) Executing [(cd
./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.74s (cpu+sys) Executing
[(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.08s (cpu+sys)
Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s (cpu+sys)
Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.52s (cpu+sys)
Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.05s
(cpu+sys) Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.36s (cpu+sys) Executing [(cd ./mbrot/bigloo;
./bigloo.exe)]....5.4.3.2.1 7.04s (cpu+sys) Executing [(cd
./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.2s (cpu+sys) Executing
[(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.2s (cpu+sys)
Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.97s
(cpu+sys) Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.55s (cpu+sys) Executing [(cd ./qsort/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.63s (cpu+sys) Executing [(cd ./rgc/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.23s (cpu+sys) Executing [(cd
./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.44s (cpu+sys) Executing
[(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 3.55s (cpu+sys)
Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 7.0
==================================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.0/bglstone/../bin/bigloo-versio
n`"
/misc/lab/bigloo/bench/3.5b-7.0/bglstone/bin/runit bigloo.runit -v >
bigloo.stat Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1
0.76s (cpu+sys) Executing [(cd ./beval/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.41s (cpu+sys) Executing [(cd
./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.14s (cpu+sys) Executing
[(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O ../src/long.c >
/dev/null)]....5.4.3.2.1 0.47s (cpu+sys) Executing [(cd
./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.72s (cpu+sys) Executing
[(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.13s (cpu+sys)
Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s (cpu+sys)
Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.5s (cpu+sys)
Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.01s
(cpu+sys) Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.35s (cpu+sys) Executing [(cd ./mbrot/bigloo;
./bigloo.exe)]....5.4.3.2.1 7.03s (cpu+sys) Executing [(cd
./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.16s (cpu+sys) Executing
[(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.19s (cpu+sys)
Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.96s
(cpu+sys) Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.56s (cpu+sys) Executing [(cd ./qsort/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.62s (cpu+sys) Executing [(cd ./rgc/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.23s (cpu+sys) Executing [(cd
./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.42s (cpu+sys) Executing
[(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 3.6s (cpu+sys)
Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 7.0alpha7
============================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.0alpha7/bin/bigloo -version`"
/misc/lab/bigloo/bench/3.5b-7.0alpha7/bglstone/bin/runit bigloo.runit -v
> bigloo.stat
   Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.77s
(cpu+sys)
   Executing [(cd ./beval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.29s
(cpu+sys)
   Executing [(cd ./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.13s
(cpu+sys)
   Executing [(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O
../src/long.c > /dev/null)]....5.4.3.2.1 0.48s (cpu+sys)
   Executing [(cd ./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.73s
(cpu+sys)
   Executing [(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.09s
(cpu+sys)
   Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s
(cpu+sys)
   Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.52s
(cpu+sys)
   Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.02s
(cpu+sys)
   Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.26s
(cpu+sys)
   Executing [(cd ./mbrot/bigloo; ./bigloo.exe)]....5.4.3.2.1 7.05s
(cpu+sys)
   Executing [(cd ./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.16s
(cpu+sys)
   Executing [(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.2s
(cpu+sys)
   Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.92s
(cpu+sys)
   Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.55s
(cpu+sys)
   Executing [(cd ./qsort/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.63s
(cpu+sys)
   Executing [(cd ./rgc/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.24s
(cpu+sys)
   Executing [(cd ./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.41s
(cpu+sys)
   Executing [(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 3.56s
(cpu+sys)
   Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 6.8
==================================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-6.8/bin/bigloo -version`"
/misc/lab/bigloo/bench/3.5b-6.8/bglstone/bin/runit bigloo.runit -v   >
bigloo.stat
   Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.77s
(cpu+sys)
   Executing [(cd ./beval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.31s
(cpu+sys)
   Executing [(cd ./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.15s
(cpu+sys)
   Executing [(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O
../src/long.c > /dev/null)]....5.4.3.2.1 0.46s (cpu+sys)
   Executing [(cd ./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.79s
(cpu+sys)
   Executing [(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.23s
(cpu+sys)
   Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s
(cpu+sys)
   Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.49s
(cpu+sys)
   Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.09s
(cpu+sys)
   Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.39s
(cpu+sys)
   Executing [(cd ./mbrot/bigloo; ./bigloo.exe)]....5.4.3.2.1 7.05s
(cpu+sys)
   Executing [(cd ./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.34s
(cpu+sys)
   Executing [(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.18s
(cpu+sys)
   Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.93s
(cpu+sys)
   Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.44s
(cpu+sys)
   Executing [(cd ./qsort/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.63s
(cpu+sys)
   Executing [(cd ./rgc/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.28s
(cpu+sys)
   Executing [(cd ./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.51s
(cpu+sys)
   Executing [(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 3.58s
(cpu+sys)
   Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.46s
(cpu+sys)


--
Manuel


This message has been scanned for malware by Websense. www.websense.com



More information about the Gc mailing list