Cray Shasta supercomputer holds almost 300,000 AMD processor cores

Discussion in 'Frontpage news' started by Hilbert Hagedoorn, Feb 18, 2020.

  1. Hilbert Hagedoorn

    Hilbert Hagedoorn Don Vito Corleone Staff Member

    Messages:
    38,347
    Likes Received:
    6,961
    GPU:
    AMD | NVIDIA
    Embra and fantaskarsef like this.
  2. Undying

    Undying Ancient Guru

    Messages:
    13,000
    Likes Received:
    2,286
    GPU:
    Aorus RX580 XTR 8GB
    But can it run crysis?

    Haah, sry i had to. :D
     
    Maddness, 0blivious and anticupidon like this.
  3. Astyanax

    Astyanax Ancient Guru

    Messages:
    6,673
    Likes Received:
    2,116
    GPU:
    GTX 1080ti
    pretty sure its going to have 0 V100's in it, it was going to use v100's but

    oh, this is not the indiana university shay supercomputer.
     
  4. anticupidon

    anticupidon Ancient Guru

    Messages:
    4,988
    Likes Received:
    1,553
    GPU:
    Polaris/Vega/Navi
    This is a small ripple in the ocean of super computers and data centres.
    But it will escalate and transform into a wave.
    Better competition in the data centers.
     

  5. Mesab67

    Mesab67 Master Guru

    Messages:
    244
    Likes Received:
    84
    GPU:
    GTX 1080
    The entire basis of supercomputers is parallelism and thus, being able to split your workload over as many available cores (CPU & GPU) as possible. Would be good to have some of these experienced folks share some of their highly tuned workload-splitting skills with the outside world...there's many areas that could benefit.
    {edit: talking primarily about algorithm/scaling skills]
     
    Last edited: Feb 18, 2020
  6. 0blivious

    0blivious Ancient Guru

    Messages:
    2,872
    Likes Received:
    401
    GPU:
    5700XT/ 1070/ RX580
    CHESS
    POKER
    FIGHTER COMBAT
    GUERRILLA WARFARE
    DESERT WARFARE
    THEATERWIDE TACTICAL WARFARE
    CRYSIS

    GLOBAL THERMONUCLEAR WAR


    .
     
  7. Alessio1989

    Alessio1989 Ancient Guru

    Messages:
    1,810
    Likes Received:
    476
    GPU:
    .
    I do not see why not. Crysis can run on what today implements the Microsoft Basic Render driver with a simple rename trick...

    https://docs.microsoft.com/en-us/wi...irectx-warp#warp-architecture-and-performance

    It does support up to Direct3D10, I bet it doesn't take so much advantage of modern CPUs, at least I bet the d3d10warp hasn't been updated so much since Vista (at least according to Microsoft warp10 implements up to SSE 4.1).. Note also that d3d10warp.dll is the only warp implementation provided in Windows outside Windows SDK debug environment (in this last you can find the updated version of Warp for DirectX 12 too).
     
    Last edited: Feb 18, 2020
    Undying likes this.
  8. schmidtbag

    schmidtbag Ancient Guru

    Messages:
    5,068
    Likes Received:
    1,720
    GPU:
    HIS R9 290
    If they went with dual-socket 64-core systems, that would be 2268 servers. Considering it seems not every server has a GPU in it, they probably used U1 servers, which means they could fit about 8 in a single rack. That means they'd have about 284 racks. For a supercomputer, that's astonishingly small.

    I don't suppose you saw the LTT video where they ran Crysis on software rendering using Epyc? Because that actually managed to breathe new life into an old meme.
     
    Yogi likes this.
  9. Brasky

    Brasky Ancient Guru

    Messages:
    2,218
    Likes Received:
    185
    GPU:
    ASUS 1080 Strix
    we're not all equal and the US taxpayer bought this, therefore it will and should be used for US projects. But the beauty of this being in the hands of the Navy is that many DoD/Navy projects are oceanography and mapping the tides/currents going on which will happen to include a ton of civilian science projects. So there WILL be tons of residual data that universities will likely have access too.
     
  10. Yogi

    Yogi Master Guru

    Messages:
    249
    Likes Received:
    57
    GPU:
    Sapphire R9 290X Vapour X
    That's at least 20 million bucks worth of eypc goodness chugging down about a megawatt of power at full chooch. And thats just with conservative wikipedia based estimates on the CPU's alone.
     

  11. ruthan

    ruthan Master Guru

    Messages:
    365
    Likes Received:
    48
    GPU:
    G970/3.5G MSI
    Department of Defense.. nice to be in business of killing people.. i thing that with this they can make lots of frags:) I thing that whole simulation would be about how much Blackwater mercenaries to hire:(
    Do you remember on Iraq in 90s and info about how much scat missiles actually hit the target funny stats:)
     
  12. 386SX

    386SX Master Guru

    Messages:
    927
    Likes Received:
    918
    GPU:
    AMD Vega64 RedDevil
    Just another example of "things you are not able to truly understand if you haven't used it at least once in your life".

    Hi Skynet! :D
     
  13. tsunami231

    tsunami231 Ancient Guru

    Messages:
    10,451
    Likes Received:
    569
    GPU:
    EVGA 1070Ti Black
    I am sure alot people will laugh at the "skynet" comments but sooner or later it gona happen. "virus" that donald sutherland movie is another scenario I see happen where an alien ( they existant and are already here public just dont know or have proof) entity, see's humans as virus to planet and deem human must all die, which again involved machines.

    With all the money USA spends it all this and other stuff, they could easily move expenses around and pay off the nations debt. before we are more in debt to china? which from what I read it where we been getting loans? or so new i read about says reguardless of where it coming from we have 1 billion in debit last i looked which come from internet, which full of truths?!!

    Less what they mean by nations debit, the combine debit of all it citzens? which that case that will never be fixed they want us in debit. then we have people that have 100k and more in debit that just keep spend out side there means with the thought of hey i gona die soon they can get money from me if i dead I know few people like that.
     
    386SX likes this.
  14. Gomez Addams

    Gomez Addams Member Guru

    Messages:
    118
    Likes Received:
    73
    GPU:
    Titan RTX, 24GB
    They can have more than 8 in one rack. According to other releases, they use 1U boxes and put eight CPUs in each one. If they use the 64-core chip that means 4536 chips and 567 boxes. A standard rack is 42U high so they probably put 20 or so CPU boxes per rack and the rest of the rack is storage and networking. At twenty boxes per rack that means 28 racks are needed. Each V100 GPU will likely have two CPUs managing it, probably in a 2U box. Assuming 2U boxes, that will require three racks just for the GPUs if they are 1GPU per box.

    This all totals less than three dozen racks. In relative terms, for a Top-25 supercomputer this is microscopic.
     
  15. svan71

    svan71 Active Member

    Messages:
    62
    Likes Received:
    22
    GPU:
    GTX 1080
    your confusing DOD with Planed Parenthood bro.
     

  16. schmidtbag

    schmidtbag Ancient Guru

    Messages:
    5,068
    Likes Received:
    1,720
    GPU:
    HIS R9 290
    Ah whoops I forgot about the taller 42Us (it's been a long time since I've been in a mainframe). All good points though. And yeah, it's almost funny how small this supercomputer is. It should be relatively easy to maintain.
     
    Brasky likes this.
  17. Brasky

    Brasky Ancient Guru

    Messages:
    2,218
    Likes Received:
    185
    GPU:
    ASUS 1080 Strix
    I'm glad someone was able to do that math. Definitely sounds like a pretty small footprint compared to the ones that need an entire facility built to house the SC.
     
  18. JamesSneed

    JamesSneed Master Guru

    Messages:
    839
    Likes Received:
    312
    GPU:
    GTX 1070
    Parallelism isn't so much a people skill issue albeit Im sure in some cases that's true. It's mostly down to some tasks are terrible at going parallel and then the extra costs as it costs more to implement parallelism . Each time you go parallel you have to have a master thread that sits above all the parallel threads so there is some inherent overhead. Sometimes it not only does not improve performance you can actually degrade performance by going parallel due to this overhead. These supercomputers and even various GPU tasks like mining already have what you can call given parallelism which are very easy to code. The things I think you want are the found parallelism where you have to put a lot of thought into can I do these things together or can I split these things up into parallel subtasks. This really takes great programmers that have deep knowledge of the software that is to be tweaked to use parallelism.
     
  19. D3M1G0D

    D3M1G0D Ancient Guru

    Messages:
    2,123
    Likes Received:
    1,358
    GPU:
    2 x GeForce 1080 Ti
    Well, seeing as how the 3990X can run Crysis without a GPU, the answer is an emphatic YES! :D
     
    Undying likes this.
  20. Gomez Addams

    Gomez Addams Member Guru

    Messages:
    118
    Likes Received:
    73
    GPU:
    Titan RTX, 24GB
    The calculations are pretty simple. Here are the numbers :
    290,304 cores divided by 64 gives the number chips = 4536.
    That number divided by 8 gives the number of boxes = 567.

    From there is some guessing about how the racks are organized. In the ones I have read about, they typically have one CPU box manage one storage box which will contain hundreds of TBs of storage, if not PBs, and a very high performance interconnection, like about PCI v8 speeds, to extrapolate a bit.

    Here is the article about the Shasta architecture : https://www.anandtech.com/show/13616/managing-16-rome-cpus-in-1u-crays-shasta-direct-liquid-cooling. If they have gone away from 8 CPUs per 1U box then the number of boxes will change, obviously, but I don't think they have.
     
    Brasky likes this.

Share This Page