Wine tests in PTS... please?

[Melcar]

I guess this has been asked before, but is there any chance to include a Wine based test to the suite (something heavy on 3D)? I don't know how it would end up working, but it will at least give us better insight on the capabilities of the nvidia and ATI drivers when it comes to Wine based "emulation", instead of relying on bug reports that never seem to be resolved. It would also give the fglrx devs. a better way to "understand" the behaviour of their driver with Wine (they seem to be big fans of PTS :D).

[Michael]

For those that know of any Windows tests that are able to be run under WINE and can be automated, I can get them integrated into PTS quickly and easily. I have a framework I've been planning out for WINE integration, but have lacked the time to find any Windows tests to actually go along with it.

Ideally what I am after is just a Windows program where you execute it, send it any needed arguments, it will run its test(s), then it either saves the results to a file or prints the information, and then gracefully exits.

[Melcar]

Like some form of benchmark then? I remember seeing a bunch of freely available openGL benchmarks for Windows. I'll see if I can hunt them down.

[Michael]

Yes, a benchmark or game that's similarly equipped to how Doom3 / Quake 4 benchmarking works.

[Regenwald]

perhaps 3dmark(s) 2000 or 2001? or pcmarks...they should work. but it's not brandnew software...seems like the version from 2005 works, too (http://www.wine-reviews.net/benchmarks/3dmark-05-score-on-wine-0949.html)

[d2kx]

3DMark2000/2001 use DirectX7 and that is rendered in software mode if 3D doesn't work (as far as I know), I'd prefer 2003/2005.

[Zhick]

Why not use the Windows-Binaries of Nexuiz/Sauerbraten/Warsow and the like? I imagine it would be pretty easy to adjust the already available tests for those to use wine+windows-binary instead of the linux-binary.

[skeetre]

Why not use the Windows-Binaries of Nexuiz/Sauerbraten/Warsow and the like? I imagine it would be pretty easy to adjust the already available tests for those to use wine+windows-binary instead of the linux-binary.

I agree. Though if you can get other programs that are windows only to run in windows and in Wine, that would be nice to compare also.

[Michael]

As far as I know, 3DMark/PCMark still requires the use of clicking a button to start a test.

[Michael]

Why not use the Windows-Binaries of Nexuiz/Sauerbraten/Warsow and the like? I imagine it would be pretty easy to adjust the already available tests for those to use wine+windows-binary instead of the linux-binary.

I am not really interested in that but something more unique.

[Melcar]

Well, Furmark (http://downloads.guru3d.com/FurMark-v1.4.0-download-1965.html) works, even with fglrx (release 8.5 to be precise), but it also requires some user interaction before the test begins.

Most DX based benchmarks I've seen require some sort of user interaction, so finding a "point 'n' click" one will be hard. I think the only option in this case would be timedemos in commercial games. Anyone know of any freely available demos for Windows games that can be used for such ends?

[Zhick]

I am not really interested in that but something more unique.
But it's way too easy for not doing it. I just played around a bit and found out replacing the strings ./warsow.i386 or ./warsow.x86_64 in ~/.phoronix-test-suite/installed-tests/warsow/warsow with wine warsow_x86.exe is enough to make the warsow test to use wine. It reports 0.00 FPS thought, but this seems to be a problem with pts, the test and/or my setup, since this also happens when using the linux-binaries.
Maybe someone who gets more than 0.00 FPS on the warsow test can confirm if this (very quick and dirty) hack works for him as well and he gets reported a reasonable FPS-amount?

[Michael]

but it also requires some user interaction before the test begins

See, that's the problem. I can't push in tests if it requires interaction like that.

[Melcar]

I tried and I failed :(. I attempted to run the FarCry and FEAR demos since I'm told they have integrated timed benchmarks, but could not get them to work. Maybe it's just the fglrx+Wine combo, but unfortunately I don't have an nvidia card handy.