Gaming tests suggestion: run once

[RenZO]

Hello,

I made about 300 gaming tests with pts (10 games, 3 resolutions, 10 cards). To do this, I had to change settings in order to run each test only once. Because with games, running 3 times is not usefull, results are always identical.

Another hint: With etqw-demo, first test is always higher, because running in 640x480. Reverse problem with doom3 and quake4, first test is always lower (and usecache isn't different). So if we do an average on 3 tests, it's false.

With pts 1.6, I use to do, for example:
phoronix-test-suite benchmark doom3 doom3 doom3

And I choose different resolutions for each test, I have 3 tests like i want. So I think changing "Times to run" to 1 is a good idea, for games.

Hope my feedback could help, thanks

EDIT: Maybe "Times to run" could be a variable?

[marek]

Bump.

I'd really like to run every test just ONCE. I don't have time to run everything three times. I am using PTS 2.8.0.

[Michael]

Not sure how I didn't notice this thread before...

marek and anyone else wanting to run something just once, you can do so easily with any PTS2.x release.

FORCE_TIMES_TO_RUN=1 phoronix-test-suite benchmark <whatever>

The FORCE_TIMES_TO_RUN environmental variable will override profile defaults.