Maya Bike Bench: real world performance in Autodesk Maya

Discussion in 'Benchmark Mayhem' started by NormanBates, Oct 29, 2009.

  1. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
    Hello World

    some people asked for this, so here it is: a thread for comparing the results we had benchmarking Maya with the bike scene:
    http://rapidshare.com/files/249160829/bike.rar

    if you want to use it:
    * download zip
    * extract it to a local drive, it will create a project subdir tree
    * set 1280x1024 resolution
    * open maya
    * if you don't see it already, get the fps indicator: display > heads up display > frame rate
    * file > project > set > look for the directory that came out of the zip
    * file > open scene > bike.ma
    * you should see a bike; set viewport to smooth shaded
    * move the camera around (pan, zoom, rotate)
    * look at the fps indicator, and take note of the LOWEST fps number achieved (ok, if it's a clear outlier, please discard that one and get the lowest non-outlier)

    results so far (bike scene, untextured version, smooth shade, minimum fps):
    Code:
    kocha --------- 84 fps - Q8200@3.2GHz - 4GB - xp.64 - real Quadro FX4600 768 MB
    SCHOKO -------- 76 fps - T7700@2.4GHz - 4GB - w7.64 - HD2600M@FireGL - BUG SOLVED!!
    n4d444 -------- 70 fps - Q9550@2.8GHz - 4GB - xp.64 - real Quadro FX1700 - Autodesk Maya 2009 Stereo profile
    n4d444 -------- 70 fps - Q9550@3.6GHz - 8GB - xp.64 - GF8800GT @ Quadro FX3700 - maya profile
    n4d444 -------- 61 fps - Q9550@3.6GHz - 8GB - xp.64 - GF8600GT @ Quadro FX570 - maya profile
    Booim --------- 50 fps - Q9450@2.7GHz - 4GB - w7.64 - GF8800GT @ Q FX3700, maya profile
    khogan112 ----- 50 fps - E8400@3.6GHz - ??? - ????? - Quadro FX580
    ultrabitch ---- 49 fps - Q6600@3.0ghz - ??? - xp.64 - GF8800ultra @ Quadro - maya profile
    n4d444 -------- 44 fps - Q9550@2.8GHz - 4GB - xp.64 - real Quadro FX1700 - Autodesk Maya profile
    Maryus3D ------ 33 fps - q6600@2.4GHz - 8GB - w7.64 - GF8800GT @ Quadro FX3700 - maya profile
    Maryus3D ------ 31 fps - q6600@2.4GHz - 8GB - xp.64 - GF8800GT @ Quadro FX3700 - maya profile
    NormanBates --- 23 fps - Q6600@3.0GHz - 2GB - xp.32 - HD4670 unmodded (cat 9.10)
    khogan112 ----- 22+fps - E8400@3.6GHz - ??? - ????? - Quadro FX570
    khogan112 ----- 21 fps - E8400@3.6GHz - ??? - ????? - FirePro v5700
    fragmichnicht - 20 fps - Q6600@3.2Ghz - ??? - ????? - GF8800GT unmodded - maya profile
    CADCAT -------- 20 fps --- C2D@3.8Ghz - 4GB - xp.64 - HD4870 unmodded
    CADCAT -------- 20 fps --- C2D@3.8Ghz - 4GB - xp.64 - HD3870 unmodded
    CADCAT -------- 19 fps --- C2D@3.8Ghz - 4GB - xp.64 - FirePro v7700 (the real thing)
    CADCAT -------- 19 fps --- C2D@3.8Ghz - 4GB - xp.64 - HD3870 @ v7700
    Maryus3D ------ 19 fps - q6600@2.4GHz - 8GB - xp.64 - GF8800GT @ GeForce driver
    n4d444 -------- 19 fps - Q9550@2.8GHz - 4GB - xp.64 - real Quadro FX1700 - 3D App - Default Global Settings
    ultrabitch ---- 18 fps - Q6600@3.0ghz - ??? - linux - GF8800ultra
    NormanBates --- 18 fps - Q6600@3.0GHz - 2GB - xp.32 - HD4670 @ FirePro
    NormanBates --- 17 fps - Q6600@3.0GHz - 2GB - xp.32 - HD4670 unmodded (cat 9.5)
    khogan112 ----- 17 fps - E8400@3.0GHz - ??? - ????? - FirePro v5700
    Maryus3D ------ 16 fps - q6600@2.4GHz - 8GB - w7.64 - GF8800GT @ GeForce driver (new)
    NormanBates --- 16 fps - Q6600@3.0GHz - 2GB - xp.32 - HD3870 @ FirePro v7700
    Pete3D -------- 14 fps - Q6600@3.0GHz - 4GB - w7.64 - HD4870 @ FirePro v8700
    Maryus3D ------ 12 fps - q6600@2.4GHz - 8GB - w7.64 - GF8800GT @ GeForce driver (old)
    ultrabitch ---- 11 fps - Q6600@3.0ghz - ??? - wv.64 - GF8800ultra
    Styler -------- 10 fps ---- P4@3.0ghz - ??? - ????? - HD3850 @ FirePro v7700
    ultrabitch ----  9 fps --- C2D@2.2GHz - 3GB - w7.32 - HD2600M unmodded
    Mounty2010 ----  9 fps -A64 X2@2.4GHz - ??? - ????? - x1950pro @ FirePro v7600
    


    sister benchmarks:

    MayaCarBench
    http://forums.guru3d.com/showthread.php?p=3321496

    MaxCarBench:
    http://forums.guru3d.com/showthread.php?p=3338059
     
    Last edited: Jan 26, 2010
  2. n4d444

    n4d444 Active Member

    Messages:
    71
    Likes Received:
    0
    Graphics Card::
    8800GT@FX3700
    You should include these.

    [​IMG] [​IMG]

    :thumbup: for making Maya benching threads

    Don't take into account the first bad benches I did something wrong there. If I remember correctly I think the vsync was ON which made bad results. Take these screenshots into account.
    I'll redo some of the tests and report them to you on PM (when I get some free time).
     
    Last edited: Oct 29, 2009
  3. Maryus3D

    Maryus3D Active Member

    Messages:
    97
    Likes Received:
    0
    Graphics Card::
    Zotac GTX 285
    Mine too :D

    [​IMG]
     
  4. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
    ok, I can update all these results... but I won't work anymore on the textbench and island scene, we've got enough with these two (plus new ones... yes... I always like new ones...)

    edit: done

    maryus3D: your numbers on the standard GeForce driver are now WAY higher than they used to be; can you confirm that the same system, with comparable drivers, is giving you 19fps on xp.64 but only 12fps on w7.64?

    I'll add my results with standard radeon drivers too

    edit2: I run the test again, with three sets of drivers, on my HD4670:

    catalyst 9.10 (driver 8.661) unmodded -- 23.3 fps
    catalyst 9.05 (driver 8.612) unmodded -- 17.1 fps
    Firepro v5700 (driver 8.603) modded ---- 17.7 fps

    conclusion: this mod does very little in real world; having the latest driver is much more important
     
    Last edited: Oct 30, 2009

  5. Maryus3D

    Maryus3D Active Member

    Messages:
    97
    Likes Received:
    0
    Graphics Card::
    Zotac GTX 285
    Well OpenGL in windows 7 sucks donno why :(. It was the same system but i'v installed the latest GF driver 191. :)

    BTW i just repetend the bike in windows 7 and i have 16 fps. I don't know why it gave me 12 fps.
     
  6. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
    thanks, I added that result to the table, as "new", I guess the difference with "old" is the driver, which I guess you've updated at least once in the last few months

    it shows that xp.64 is 20% faster than w7.64 for maya viewport performance, with same hardware and same drivers, on a scene such as this one

    pretty conclusive, I guess
     
  7. Maryus3D

    Maryus3D Active Member

    Messages:
    97
    Likes Received:
    0
    Graphics Card::
    Zotac GTX 285
    Well vista is more slow then win7 :)). Very soon I will install OSX (hackitosh) as aqua-mac did. I'll report the results :D.
     
  8. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
    nice, keep us posted
     
  9. kocha

    kocha Member

    Messages:
    12
    Likes Received:
    0
    Graphics Card::
    NVidia Quadro FX4600
    Maybe there is a little bit of subjectivity in terms of taking note of the lowest fps, because fps is changing constantly. Why don't you make an animation, like in textured bike scene.

    Anyway... Q8200@3150 MHz, 4 MB, real Quadro FX4600 768 MB

    XP64, Maya 2010 64bit ....... 84.3 .... but sometimes can be even 95 :confused:
     
  10. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
    yes, I know; the problem is: if we change the benchmark, we have to discard all the previous results and people have to run it again, so I think it's better to leave it as it is, even though it is obvious that, as a benchmark, it could be improved; but it is a nice model, and serves its purpose

    for the MayaCarBench I did prepare an animation, and it is much easier to get and compare results

    thanks for the numbers, by the way; you're in the lead here, n4d444's faster processor rules on MayaCarBench
     
    Last edited: Oct 30, 2009

  11. kocha

    kocha Member

    Messages:
    12
    Likes Received:
    0
    Graphics Card::
    NVidia Quadro FX4600
    OT: Furry Ball Demo is out

    I know this is offtopic, but you people use Maya... :)

    Good news: Furry Ball GPU renderer demo is out....

    Bad news: supported OSes : Vista x64 and Windows7 x64 :puke2:

    Neutral news: Maya versions supported 2009 x64 and 2010 x64

    Code:
    http://furryball.aaa-studio.cz/
     
  12. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
  13. Maryus3D

    Maryus3D Active Member

    Messages:
    97
    Likes Received:
    0
    Graphics Card::
    Zotac GTX 285
    I relay want to see a patch script for Quadro drivers under windows 7 :(.
     
  14. CADCAT

    CADCAT Master Guru

    Messages:
    232
    Likes Received:
    0
    Graphics Card::
    Mobility HD5870 1GB GDDR5
    Hi Maryus3D I did your test with Maya 2010 with a real FireGL!

    System:

    Core2Duo @3,83Ghz (2MB Cache)
    4GB DDR2-800
    MSI P35 Platinum Combo
    ATI FireGL V7700
    500GB Samsung SATA II

    Windows XP Pro X64 SP2
    Maya 2010 X64
    FirePro 8.633 driver

    Result:

    When fast rotating the bike the lowest FPS I get is 18,9! So I assume Maya and FireGL/FirePro is not a good combination and maybe the existing FirePro Softmod is allready working fine :3eyes:

    Hope this helps, if you want more tests I can do it but only tomorrow (maybe also tuesday) as I don't have more time with the V7700 :(

    Greetings

    Edit:

    Same rig with MSI HD3870 OC (ATI reference design, looks exactly like V7700!) and 8.633 modded driver (GellmaR):

    19 FPS min.. (MSI card is OC version with 25Mhz higher core clock..)
     
    Last edited: Nov 2, 2009
  15. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
    Last edited: Nov 2, 2009

  16. CADCAT

    CADCAT Master Guru

    Messages:
    232
    Likes Received:
    0
    Graphics Card::
    Mobility HD5870 1GB GDDR5
    Ok now downloading car scene.. In the meantime:

    bike scene, same rig, same HD3870 but with Catalyst 9.10 - min 20.3 FPS..
     
  17. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
    so there you go: in maya, a standard HD3870 with the latest drivers (unmodded) is (just a bit) faster than the same card with older modded drivers, or even that the same card in its true FirePro version

    the real v7700 is 10 times more expensive than the equivalently performing HD4670 (which, by the way, can come with 2x the memory)

    ATI needs to find the magic behind that "maya profile" that the quadros have, but, even then, it will only matter in this benchmark, which is giving everybody >15fps; in MayaCarBench, wich is a much more demanding benchmark, not even that "maya profile" is helping nvidia, as it looks like any geforce will do just as well as the much more expensive quadros (we'd need a few more unmodded geforce tests over there, especially under xp)

    should we try to create an equivalent 3dsmax benchmark? it would be nice if it could contain exactly the same geometry, but I'm afraid max is performing so much better than maya that we'd be getting numers above 100fps and the results would be meaningless (as I always say, I want more performance when I'm struggling at 1fps... but I don't use max, so I don't know, maybe you scene has to be obscenely complex in order to crawl like that)
     
  18. CADCAT

    CADCAT Master Guru

    Messages:
    232
    Likes Received:
    0
    Graphics Card::
    Mobility HD5870 1GB GDDR5
    Did another benchmark now with HD4870 512MB Catalyst 9.10, min FPS = 20,3.. I think the ATI situation is clear now, maybe I can get me a Geforce card on next weekend..
     
  19. NormanBates

    NormanBates Master Guru

    Messages:
    376
    Likes Received:
    0
    Graphics Card::
    ATI HD3870 / ATI HD4670
    I added some new results from n4d444 and CADCAT
     
  20. Maryus3D

    Maryus3D Active Member

    Messages:
    97
    Likes Received:
    0
    Graphics Card::
    Zotac GTX 285
    Nice results CADCAT 10x for help :D.
    BTW i can't get FX 3700 GFX strings under OSX :(. It recognized as a Quadro but with geforce power. Donno were i do wrong. Anyway i'll continue the research until i know to fix the gfx strings :).
     

Share This Page