An Introduction to HBM - High Bandwidth Memory Article

Discussion in 'Frontpage news' started by Hilbert Hagedoorn, May 18, 2015.

  1. Hilbert Hagedoorn

    Hilbert Hagedoorn Don Vito Corleone Staff Member

    Messages:
    46,320
    Likes Received:
    14,102
    GPU:
    AMD | NVIDIA
  2. Hilbert Hagedoorn

    Hilbert Hagedoorn Don Vito Corleone Staff Member

    Messages:
    46,320
    Likes Received:
    14,102
    GPU:
    AMD | NVIDIA
  3. Denial

    Denial Ancient Guru

    Messages:
    14,089
    Likes Received:
    3,920
    GPU:
    EVGA RTX 3080
    Oh shiet. Good thing you bumped this, I didn't notice it yesterday. I love articles like this.
     
  4. dean469

    dean469 Member Guru

    Messages:
    125
    Likes Received:
    10
    GPU:
    XFX RX480GTR @1385
    Great article HH. Very interesting. Hope this can help AMD pull themselves out of the hole. Can't wait to see the numbers.
     

  5. Embra

    Embra Maha Guru

    Messages:
    1,494
    Likes Received:
    757
    GPU:
    Red Devil 6950 XT
    Thank you Hilbert, good stuff! :)
     
  6. vbetts

    vbetts Don Vincenzo Staff Member

    Messages:
    15,142
    Likes Received:
    1,742
    GPU:
    GTX 1080 Ti
    Awesome article! =]

    Only concern I have is the limitation of only 4gb for now. Since DX12 will bring stacked memory, Crossfire solutions will love HBM memory. =]
     
  7. chispy

    chispy Ancient Guru

    Messages:
    9,624
    Likes Received:
    2,139
    GPU:
    MSI RTX 4090 on H2O
    Excellent article Hilbert , thank you.
     
  8. Denial

    Denial Ancient Guru

    Messages:
    14,089
    Likes Received:
    3,920
    GPU:
    EVGA RTX 3080
    Idk, I feel like it's going to be more complex then DX12 = stacked memory. It will probably depend on the game, the implementation, if it will be fully stacked or just some resources, etc.

    But yeah overall it should be a net benefit.
     
  9. Noisiv

    Noisiv Ancient Guru

    Messages:
    8,230
    Likes Received:
    1,493
    GPU:
    2070 Super
    Cooling will be a *** (female-dog)

    AMD is all about 4k lately. So I would expect 8GB version.
     
  10. fellix

    fellix Master Guru

    Messages:
    222
    Likes Received:
    50
    GPU:
    MSI RTX 4080
    With D3D12 exposing streaming assets, like virtualized textures, future games and apps shouldn't need to preload everything in the video memory and--in theory--GPUs won't need gobs of local memory, just a small amount of really fast pool (HBM). We shall see.

    PCI-E 4.0 is also on the horizon...
     

  11. BedantP

    BedantP Master Guru

    Messages:
    220
    Likes Received:
    0
    GPU:
    1660Ti
    So....... Pascal will have HBM2? Shut up and take my father's money!
     
  12. Fender178

    Fender178 Ancient Guru

    Messages:
    4,196
    Likes Received:
    213
    GPU:
    GTX 1070 | GTX 1060
    To me since it being the first time using HBM and it is the first generation of the technology there was a chance of a limitation like this. However I thought the limitations would be at least no more than 8gb. But Couldn't AMD stack two groups of 4 1gb chips to get 8GB and they could make 8gb cards that way? Or I am I missing something that wouldn't work like that.
     
  13. DiceAir

    DiceAir Maha Guru

    Messages:
    1,368
    Likes Received:
    15
    GPU:
    Galax 980 ti HOF
    I'm excited to see the advancements to this new technology. Eager to see the new cards perform.
     
  14. vbetts

    vbetts Don Vincenzo Staff Member

    Messages:
    15,142
    Likes Received:
    1,742
    GPU:
    GTX 1080 Ti
    Also very interested to see how they incorporate HBM in their APU's. Pack maybe 2gb of HBM on die, and use system memory that's slower for cache?
     
  15. Lane

    Lane Ancient Guru

    Messages:
    6,361
    Likes Received:
    3
    GPU:
    2x HD7970 - EK Waterblock
    The data who need to be stored / accessed faster, will go the HBM, the large data pool, can be stored on the Dram. Like shown on the slide page 2, you have a complete versatile memory system.

    With HSA and other system like that, remember that the cpu and gpu can access every pool memory of the system. ( basically the CPU could store data directly in the gpu HBM memory stack and the gpu could directly treat thoses data, in the other way, the gpu could store the data in the system memory and the cpu could access thoses data directly ).

    This is even more important when we speak about HPC, with multiples blades of cpu / gpu's and high amount of them.
     
    Last edited: May 19, 2015

  16. H83

    H83 Ancient Guru

    Messages:
    4,801
    Likes Received:
    2,310
    GPU:
    XFX Black 6950XT
    Just a quick question, isn´t HBM going to create an heat problem in the GPUs? With all the chips stacked on top of each other, isn´t this going to trap heat inside them, leading to higher temps or lower clocks, or i´m seing this the wrong way?

    Anyway, cool stuff. Can´t wait to see AMD´s next GPU with this "super" memory inside.
     
  17. vbetts

    vbetts Don Vincenzo Staff Member

    Messages:
    15,142
    Likes Received:
    1,742
    GPU:
    GTX 1080 Ti
    Looking at other situations where items are on the same die, putting it all together will actually help with heat as it does with SoC's such as Snapdragon or Exynos(One of the benefits of having it on a single die). The memory also runs at a lower speed, and even uses less voltage so heat should not be an issue.

    Height wise, the Dram stacks are just blown up so you can see what design behind it. I guess in reality, the height and gap difference is next to nothing.
     
  18. Robbo9999

    Robbo9999 Ancient Guru

    Messages:
    1,782
    Likes Received:
    414
    GPU:
    RTX 3080
    From the article:
    "For those wondering, will the HBM DRAM blocks be much higher (in physical size) then say a GPU ? E.g. isn't the HBM DRAM package like a skyscraper and the GPU or CPU the size of a house ? We asked AMD, and the answer was no, the difference looks blown up in the screenshots and diagrams, but the real-world difference is not big enough to make a substantial or relevant enough difference. Also mind you that both the GPU and DRAM packages will get materials around them. Thus concerns like heat conduction versus coolers are not a relevant issue, according to AMD."

    I was one of those people wondering how they would manage the different heights of DRAM and GPU core, but they're gonna have packaging material around those components to make it all the same height by the sound of it. If that's the case then I hope that material has good conductivity properties otherwise GPU cooling of the core could be compromised. I have no idea what material they'll use, maybe they'll even use a metal cap like intel, and we know the heat problems associated with the use of the metal cap and poor quality interface material between the chip and the metal cap. Fingers crossed they don't compromise in this area & cooling performance is not affected!
     
  19. Reardan

    Reardan Master Guru

    Messages:
    606
    Likes Received:
    200
    GPU:
    GTX 3080
    It will be covered by an IHS.
     
  20. Singleton99

    Singleton99 Maha Guru

    Messages:
    1,068
    Likes Received:
    114
    GPU:
    Gigabyte 3080 12gb
    Thanks for this article , help me understand the HBM much more clearly.
    Looking forwards to AMD release of these products ,and will be jumping on board as soon as there available .
     

Share This Page