Page 2 of 3 FirstFirst 123 LastLast
Results 11 to 20 of 27

Thread: A New & Exciting OpenGL 3 Benchmark To Run

  1. #11
    Join Date
    Jan 2012
    Location
    Moscow
    Posts
    56

    Default

    As for hosting, I believe SourceForge would be suitable. It has mirrors all over the world, and I'm sure CC-BY license is fine with them. If not, there's also archive.org

  2. #12
    Join Date
    Jul 2008
    Posts
    1,712

    Default

    so it is just another quake based benchmark.

    pts is full with that. Pretty one sided. Which aren't other engines used in tests? ut2004 is still around. For example. Vegastrike is VERY demanding, awesome to look at and scriptable. Crystal Space. Ogre. ...

  3. #13
    Join Date
    Jan 2012
    Location
    Moscow
    Posts
    56

    Default

    Vegastrike is demanding? Can't tell by the look of it. Space simulators are very easy to render because you have very little objects in the frame - just a few ships, no terrain or weather to render. If it's slow, it means it's just very poorly optimized.

    Ogre demos pack looks interesting, I'll check if it exposes any performance counters.

  4. #14

    Default

    Quote Originally Posted by Shnatsel View Post
    Vegastrike is demanding? Can't tell by the look of it. Space simulators are very easy to render because you have very little objects in the frame - just a few ships, no terrain or weather to render. If it's slow, it means it's just very poorly optimized.

    Ogre demos pack looks interesting, I'll check if it exposes any performance counters.
    I've checked Ogre before but as I remember right there was either not any good free demos or there wasn't a way to benchmark it in terms of no timedemo commands, etc.

  5. #15
    Join Date
    Jul 2008
    Posts
    1,712

    Default

    Quote Originally Posted by Shnatsel View Post
    Vegastrike is demanding? Can't tell by the look of it. Space simulators are very easy to render because you have very little objects in the frame - just a few ships, no terrain or weather to render. If it's slow, it means it's just very poorly optimized.

    Ogre demos pack looks interesting, I'll check if it exposes any performance counters.
    so you never played it.

    It is not 'just a few ships'.

    It is hundreds of ships. Reflecting. Planets with ring systems. Asteroid fields with 'real' objects.

    The game is an incredible big load as soon as you crank up the graphics settings and get into an intensive fight.

  6. #16
    Join Date
    Jan 2012
    Location
    Moscow
    Posts
    56

    Default

    There actually is a good demos pack but it's not very demanding and I can't figure out how to do a timedemo, there doesn't seem to be a way to do it without altering the code. There's no documented timedemo, only a GUI...
    If anybody is willing to help change that, it's probably best to start off by posting to http://www.ogre3d.org/forums

    I've checked out vegastrike and it looks ancient. I don't think anybody gives a damn how it performs nowadays. No timedemo support, of course.

  7. #17
    Join Date
    Jan 2012
    Location
    Moscow
    Posts
    56

    Default

    http://gamelab.mit.edu/games/a-slower-speed-of-light/ would make for a HELL of a benchmark, but again, no benchmark mode or timedemo support

  8. #18

    Default

    Quote Originally Posted by Shnatsel View Post
    There actually is a good demos pack but it's not very demanding and I can't figure out how to do a timedemo, there doesn't seem to be a way to do it without altering the code. There's no documented timedemo, only a GUI...
    If anybody is willing to help change that, it's probably best to start off by posting to http://www.ogre3d.org/forums

    I've checked out vegastrike and it looks ancient. I don't think anybody gives a damn how it performs nowadays. No timedemo support, of course.
    The other option is using APITrace - http://openbenchmarking.org/test/pts/apitrace - to reply a recorded GL dump demo, but that's not reflective of the entire game and at last try for some games there still was some performance issues in replaying the dumps, not to mention they end up being very huge.

  9. #19
    Join Date
    Jan 2012
    Location
    Moscow
    Posts
    56

    Default

    Okay, I have a question: why the hell are you still using MD5 for checking authencity of downloaded files which you then RUN?!
    MD5 was broken long ago and has already been used in hash collision attacks to push malformed Windows updates. Seeing you download ~1Gb Xonotic zipfile and check only the MD5 is daunting. At the very least you should check one of the SHA2 family functions, e.g. SHA512.
    Ideally you'd also add a detached digital signature distributed with the profile and checked after downloading the file.

    Which brings us to authenticating the test profiles and checking that they're not malformed to download and run an exploit instead of the test binaries. I hope they're at least downloaded over HTTPS?
    Last edited by Shnatsel; 07-10-2013 at 05:24 AM.

  10. #20
    Join Date
    Feb 2008
    Location
    Linuxland
    Posts
    4,734

    Default

    md5 is far from dangerous when combined with file size check and compression.

    Sure, you may be able to create a colliding file with a few weeks' computation. But is that colliding file going to be a valid zip/gzip/bzip2 file? And with the exact same size to the byte?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •