[Gc] Performance of bdwgc7.2 had degraded compared to 6.8

Carsten Kehler Holst kehler at pdc.dk
Wed Nov 24 05:41:55 PST 2010


Sorry about the layout of the table.
The relevant versions and tests are the taken out and highlighted here.


	7.2a4		7.2a2		7.1		6.8	
queens	2,29	159,03%	2,29	159,03%	1,55	107,64%	1,44
traverse	5,14	143,58%	5,15	143,85%	3,55	99,16%	3,58
peval	1,46	123,73%	1,47	124,58%	1,2	101,69%	1,18
maze	1,67	120,14%	1,4	100,72%	1,36	97,84%	1,39
earley	2,49	111,66%	2,5	112,11%	2,08	93,27%	2,23

As can be seen the step from 6.8 to 7.1 is fine.
Whereas the step from 7.1 to 7.2a2 is bad.

Only some of the test performs badly for others there are no slowdown.

Regards
Carsten


-----Original Message-----
From: gc-bounces at linux.hpl.hp.com [mailto:gc-bounces at linux.hpl.hp.com]
On Behalf Of Carsten Kehler Holst
Sent: 24. november 2010 11:10
To: Manuel.Serrano at inria.fr; Ivan Maidanski
Cc: gc at linux.hpl.hp.com; bigloo mailling list
Subject: RE: Re[4]: [Gc] Performance of bdwgc7.2 had degraded compared
to 6.8

	

bague	0,76	98,70%	0,77	100,00%	0,77	100,00%	0,76	98,70%
0,77	100,00%	0,77
beval	1,33	101,53%	1,41	107,63%	1,29	98,47%	1,41	107,63%
1,29	98,47%	1,31
boyer	2,23	103,72%	2,23	103,72%	2,13	99,07%	2,14	99,53%
2,13	99,07%	2,15
cgc	0,47	102,17%	0,48	104,35%	0,48	104,35%	0,47	102,17%
0,48	104,35%	0,46
conform	1,91	106,70%	1,91	106,70%	1,74	97,21%	1,72	96,09%
1,73	96,65%	1,79
earley	2,49	111,66%	2,5	112,11%	2,08	93,27%	2,13	95,52%
2,09	93,72%	2,23
fib	0,01	100,00%	0,01	100,00%	0,01	100,00%	0,01	100,00%
0,01	100,00%	0,01
fft	2,51	100,80%	2,52	101,20%	2,52	101,20%	2,5	100,40%
2,52	101,20%	2,49
leval	1,12	102,75%	1,13	103,67%	1,05	96,33%	1,01	92,66%
1,02	93,58%	1,09
maze	1,67	120,14%	1,4	100,72%	1,36	97,84%	1,35	97,12%
1,26	90,65%	1,39
mbrot	7,03	99,72%	7,05	100,00%	7,04	99,86%	7,03	99,72%
7,05	100,00%	7,05
nucleic	1,18	88,06%	1,2	89,55%	1,2	89,55%	1,16	86,57%
1,16	86,57%	1,34
peval	1,46	123,73%	1,47	124,58%	1,2	101,69%	1,19	100,85%
1,2	101,69%	1,18
puzzle	1,96	101,55%	1,92	99,48%	1,97	102,07%	1,96	101,55%
1,92	99,48%	1,93
queens	2,29	159,03%	2,29	159,03%	1,55	107,64%	1,56	108,33%
1,55	107,64%	
qsort	1,65	101,23%	1,64	100,61%	1,63	100,00%	1,62	99,39%
1,63	100,00%	1,63
rgc	1,28	100,00%	1,28	100,00%	1,23	96,09%	1,23	96,09%
1,24	96,88%	1,28
sieve	1,58	104,64%	1,6	105,96%	1,44	95,36%	1,42	94,04%
1,41	93,38%	1,51
traverse	5,14	143,58%	5,15	143,85%	3,55	99,16%	3,6
100,56%	3,56	99,44%	3,58
alabench	1,45	99,32%	1,45	99,32%	1,45	99,32%	1,45
99,32%	1,45	99,32%	1,46
	

	39,52		39,41		35,69		35,72
35,47		36,09
	109,50%		109,19%		98,89%		98,97%
98,28%		100%



-----Original Message-----
From: gc-bounces at linux.hpl.hp.com [mailto:gc-bounces at linux.hpl.hp.com]
On Behalf Of Manuel.Serrano at inria.fr
Sent: 24. november 2010 08:18
To: Ivan Maidanski
Cc: gc at linux.hpl.hp.com; bigloo mailling list
Subject: Re: Re[4]: [Gc] Performance of bdwgc7.2 had degraded compared
to 6.8

> Good. I see growth. Could you also provide test results for v6.8,
v7.2alpha2 and gc7.0alpha7?
> (representing all 6 variants in a table form is preferred).
It has been a little bit painful to run the Bigloo compiler with these
versions of the collector that had not been supported when they had been
released. However I did it and I hope it will help.
Here are the results:

ps: Just an additional information I have forgotten to mention, all
these benchmark are single threaded. The collector is configured with
--disable-gcj-support --disable-java-finalization --disable-libcord and
compiled with the extra option -DFINALIZE_ON_DEMAND. If you want to run
the tests by yourself, download Bigloo and the test suite that are
available at :

  ftp://ftp-sop.inria.fr/indes/fp/Bigloo/bigloo3.5a.tar.gz


== 7.2alpha4
============================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.2alpha4/bglstone/../bin/bigloo-
version`"
/misc/lab/bigloo/bench/3.5b-7.2alpha4/bglstone/bin/runit bigloo.runit -v
> bigloo.stat Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1
0.76s (cpu+sys) Executing [(cd ./beval/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.33s (cpu+sys) Executing [(cd
./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.23s (cpu+sys) Executing
[(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O ../src/long.c >
/dev/null)]....5.4.3.2.1 0.47s (cpu+sys) Executing [(cd
./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.91s (cpu+sys) Executing
[(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.49s (cpu+sys)
Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s (cpu+sys)
Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.51s (cpu+sys)
Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.12s
(cpu+sys) Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.67s (cpu+sys) Executing [(cd ./mbrot/bigloo;
./bigloo.exe)]....5.4.3.2.1 7.03s (cpu+sys) Executing [(cd
./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.18s (cpu+sys) Executing
[(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.46s (cpu+sys)
Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.96s
(cpu+sys) Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1
2.29s (cpu+sys) Executing [(cd ./qsort/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.65s (cpu+sys) Executing [(cd ./rgc/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.28s (cpu+sys) Executing [(cd
./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.58s (cpu+sys) Executing
[(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 5.14s (cpu+sys)
Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 7.2alpha2
============================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.2alpha2/bin/bigloo -version`"
/misc/lab/bigloo/bench/3.5b-7.2alpha2/bglstone/bin/runit bigloo.runit -v
> bigloo.stat
   Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.77s
(cpu+sys)
   Executing [(cd ./beval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.41s
(cpu+sys)
   Executing [(cd ./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.23s
(cpu+sys)
   Executing [(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O
../src/long.c > /dev/null)]....5.4.3.2.1 0.48s (cpu+sys)
   Executing [(cd ./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.91s
(cpu+sys)
   Executing [(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.5s
(cpu+sys)
   Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s
(cpu+sys)
   Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.52s
(cpu+sys)
   Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.13s
(cpu+sys)
   Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.4s
(cpu+sys)
   Executing [(cd ./mbrot/bigloo; ./bigloo.exe)]....5.4.3.2.1 7.05s
(cpu+sys)
   Executing [(cd ./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.2s
(cpu+sys)
   Executing [(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.47s
(cpu+sys)
   Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.92s
(cpu+sys)
   Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.29s
(cpu+sys)
   Executing [(cd ./qsort/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.64s
(cpu+sys)
   Executing [(cd ./rgc/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.28s
(cpu+sys)
   Executing [(cd ./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.6s
(cpu+sys)
   Executing [(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 5.15s
(cpu+sys)
   Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 7.1
==================================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.1/bglstone/../bin/bigloo-versio
n`"
/misc/lab/bigloo/bench/3.5b-7.1/bglstone/bin/runit bigloo.runit -v >
bigloo.stat Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1
0.77s (cpu+sys) Executing [(cd ./beval/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.29s (cpu+sys) Executing [(cd
./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.13s (cpu+sys) Executing
[(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O ../src/long.c >
/dev/null)]....5.4.3.2.1 0.48s (cpu+sys) Executing [(cd
./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.74s (cpu+sys) Executing
[(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.08s (cpu+sys)
Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s (cpu+sys)
Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.52s (cpu+sys)
Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.05s
(cpu+sys) Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.36s (cpu+sys) Executing [(cd ./mbrot/bigloo;
./bigloo.exe)]....5.4.3.2.1 7.04s (cpu+sys) Executing [(cd
./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.2s (cpu+sys) Executing
[(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.2s (cpu+sys)
Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.97s
(cpu+sys) Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.55s (cpu+sys) Executing [(cd ./qsort/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.63s (cpu+sys) Executing [(cd ./rgc/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.23s (cpu+sys) Executing [(cd
./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.44s (cpu+sys) Executing
[(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 3.55s (cpu+sys)
Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 7.0
==================================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.0/bglstone/../bin/bigloo-versio
n`"
/misc/lab/bigloo/bench/3.5b-7.0/bglstone/bin/runit bigloo.runit -v >
bigloo.stat Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1
0.76s (cpu+sys) Executing [(cd ./beval/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.41s (cpu+sys) Executing [(cd
./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.14s (cpu+sys) Executing
[(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O ../src/long.c >
/dev/null)]....5.4.3.2.1 0.47s (cpu+sys) Executing [(cd
./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.72s (cpu+sys) Executing
[(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.13s (cpu+sys)
Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s (cpu+sys)
Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.5s (cpu+sys)
Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.01s
(cpu+sys) Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.35s (cpu+sys) Executing [(cd ./mbrot/bigloo;
./bigloo.exe)]....5.4.3.2.1 7.03s (cpu+sys) Executing [(cd
./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.16s (cpu+sys) Executing
[(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.19s (cpu+sys)
Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.96s
(cpu+sys) Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1
1.56s (cpu+sys) Executing [(cd ./qsort/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.62s (cpu+sys) Executing [(cd ./rgc/bigloo;
./bigloo.exe)]....5.4.3.2.1 1.23s (cpu+sys) Executing [(cd
./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.42s (cpu+sys) Executing
[(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 3.6s (cpu+sys)
Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 7.0alpha7
============================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-7.0alpha7/bin/bigloo -version`"
/misc/lab/bigloo/bench/3.5b-7.0alpha7/bglstone/bin/runit bigloo.runit -v
> bigloo.stat
   Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.77s
(cpu+sys)
   Executing [(cd ./beval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.29s
(cpu+sys)
   Executing [(cd ./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.13s
(cpu+sys)
   Executing [(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O
../src/long.c > /dev/null)]....5.4.3.2.1 0.48s (cpu+sys)
   Executing [(cd ./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.73s
(cpu+sys)
   Executing [(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.09s
(cpu+sys)
   Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s
(cpu+sys)
   Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.52s
(cpu+sys)
   Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.02s
(cpu+sys)
   Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.26s
(cpu+sys)
   Executing [(cd ./mbrot/bigloo; ./bigloo.exe)]....5.4.3.2.1 7.05s
(cpu+sys)
   Executing [(cd ./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.16s
(cpu+sys)
   Executing [(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.2s
(cpu+sys)
   Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.92s
(cpu+sys)
   Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.55s
(cpu+sys)
   Executing [(cd ./qsort/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.63s
(cpu+sys)
   Executing [(cd ./rgc/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.24s
(cpu+sys)
   Executing [(cd ./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.41s
(cpu+sys)
   Executing [(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 3.56s
(cpu+sys)
   Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.45s
(cpu+sys)

== 6.8
==================================================================
/usr/bin/make one-runit SYSTEM=bigloo SUFFIX=exe DIR=bigloo TITLE=Bigloo
COMPILER="`/misc/lab/bigloo/bench/3.5b-6.8/bin/bigloo -version`"
/misc/lab/bigloo/bench/3.5b-6.8/bglstone/bin/runit bigloo.runit -v   >
bigloo.stat
   Executing [(cd ./bague/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.77s
(cpu+sys)
   Executing [(cd ./beval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.31s
(cpu+sys)
   Executing [(cd ./boyer/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.15s
(cpu+sys)
   Executing [(cd ./cgc/bigloo; ./bigloo.exe -Rminimal-push -O
../src/long.c > /dev/null)]....5.4.3.2.1 0.46s (cpu+sys)
   Executing [(cd ./conform/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.79s
(cpu+sys)
   Executing [(cd ./earley/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.23s
(cpu+sys)
   Executing [(cd ./fib/bigloo; ./bigloo.exe)]....5.4.3.2.1 0.01s
(cpu+sys)
   Executing [(cd ./fft/bigloo; ./bigloo.exe)]....5.4.3.2.1 2.49s
(cpu+sys)
   Executing [(cd ./leval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.09s
(cpu+sys)
   Executing [(cd ./maze/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.39s
(cpu+sys)
   Executing [(cd ./mbrot/bigloo; ./bigloo.exe)]....5.4.3.2.1 7.05s
(cpu+sys)
   Executing [(cd ./nucleic/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.34s
(cpu+sys)
   Executing [(cd ./peval/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.18s
(cpu+sys)
   Executing [(cd ./puzzle/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.93s
(cpu+sys)
   Executing [(cd ./queens/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.44s
(cpu+sys)
   Executing [(cd ./qsort/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.63s
(cpu+sys)
   Executing [(cd ./rgc/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.28s
(cpu+sys)
   Executing [(cd ./sieve/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.51s
(cpu+sys)
   Executing [(cd ./traverse/bigloo; ./bigloo.exe)]....5.4.3.2.1 3.58s
(cpu+sys)
   Executing [(cd ./almabench/bigloo; ./bigloo.exe)]....5.4.3.2.1 1.46s
(cpu+sys)


--
Manuel


This message has been scanned for malware by Websense. www.websense.com

_______________________________________________
Gc mailing list
Gc at linux.hpl.hp.com
http://www.hpl.hp.com/hosted/linux/mail-archives/gc/


==================================================== 
HWA siger: For at rapportere denne mail som spam:
   Click
https://www.mailcontrol.com/sr/DkvVbIzWVxfTndxI!oX7Uk4Sez3Gz8UuhQ6aSa1E2
M4yVJ5sc+ooDtJZPc73R9B3tZcnQ!K3EQZLwdQMGDtFKA==  
====================================================



More information about the Gc mailing list