topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Thursday December 12, 2024, 5:41 pm
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: Not CPU, not GPU, but …DPU?  (Read 3421 times)

40hz

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 11,859
    • View Profile
    • Donate to Member
Not CPU, not GPU, but …DPU?
« on: October 04, 2020, 01:24 PM »
Found this video pretty interesting.

When I think back to my days in enterprise IT I can almost cry thinking about how much easier my life and work would have been with this hardware technology at hand. Oh yeah.



As an aside, this guy’s web channel is pretty cool if you’re a hardware geek. This TinyMiniMicro project of his is very similar to something I’ve been implementing for my home setup over the last few years:



I guess I miss my server room days after all. ;)

Shades

  • Member
  • Joined in 2006
  • **
  • Posts: 2,939
    • View Profile
    • Donate to Member
Re: Not CPU, not GPU, but …DPU?
« Reply #1 on: October 05, 2020, 11:13 AM »
These DPUs will be the nail in the coffin of x86/x64 processors in server land. Especially in data-centers, which have scaling capacity.

Very brief summary for those that did not see the video:
A DPU acts like a small computer, heavily optimized for processing speed and networking, put onto a PCI-E card. Conceptually, they are not that different than these devices.

But because of extensive hardware optimizations, these DPU's are vastly more powerful than the example I linked to.

Thanks for the video.  :up:

nickodemos

  • Supporting Member
  • Joined in 2009
  • **
  • Posts: 145
    • View Profile
    • Donate to Member
Re: Not CPU, not GPU, but …DPU?
« Reply #2 on: October 05, 2020, 05:40 PM »
The video was a bit beyond me. I grasped it but still not fully understanding it.

Can you give me a bit more information how it will kill the 86/64 bit processors.

Shades

  • Member
  • Joined in 2006
  • **
  • Posts: 2,939
    • View Profile
    • Donate to Member
Re: Not CPU, not GPU, but …DPU?
« Reply #3 on: October 05, 2020, 08:36 PM »
ARM processors can be as complicated or as simple as you want them to make. x86/x64 Processors are complicated, period. You can see ARM architecture as a specialist, while the x86/x64 architecture is more of a generalist.

For both there is a big playing field. However, in data-centers with lots of customers that pay for computing time/resources, it is handy to have the right amount of servers active at any given moment. Energy and cooling costs are quite high. So if a server in a rack can easily be turned on/off/standby with the varying demands, that helps a lot. Doing this with x86/x64 is harder than with ARM. Practically all brands/models of smartphones come with ARM, not x86/x64, because of this.

The ARM-based DPU mentioned in the video are now so fast and powerful, that these can host a hypervisor (a requirement for virtual machines) on itself, making it even easier to activate/de-activate servers as needed at any given moment. Apparently there are already DPUs with 200Gbit/sec network transfer speeds (200 times faster than the average home network). That makes it viable as network storage. Couple that with nVME drives and you will hardly notice a difference between local and network storage anymore.

Network storage boxes can be simpler (not necessarily cheaper) and very fast with an ARM chip that is designed for that particular purpose. A generalist CPU that could match the ARM chip would be expensive to purchase and run.

Linux is already available for the ARM architecture and even Microsoft is busy with preparing Windows to run on ARM (WinRT was their most recent (failed) attempt) and Apple will finish the transition to the ARM architecture (all their hardware and software) within 2 years. That is their plan anyway. Generalist chips are nice for desktops that have many different use-cases. But with everything moving to "the Cloud", specialist hardware in data-centers (and much simpler hardware with the customer) is far more efficient. If only for the reduction in energy-consumption alone.



Note:
As I understood it, all currently available renewable energy sources on this planet do not produce enough energy (over a 24-hour period) to keep the internet and all it's data-centers on this planet running (over a 24-hour period). Not that renewable energy sources produce a little amount of energy, the internet as a whole and it's data-centers consume much more energy than you expect. Streaming video is very costly factor. Not directly in the electricity bill of a consumer, but the hardware needed to keep up with customers 1080p/4k/8k video demands 24 hours a day needs lots of energy.

Whatever can be gained in energy efficiency counts for a lot. And yes, producing a movie DVD (including case, booklet, print, transport to different continent etc.) is cheaper energy wise, than having it online available 24-hours a day. How wrong or illogical it may sound, the convenience granted by the current internet infrastructure is far more problematic than most people realize. 

tomos

  • Charter Member
  • Joined in 2006
  • ***
  • Posts: 11,964
    • View Profile
    • Donate to Member
Re: Not CPU, not GPU, but …DPU?
« Reply #4 on: October 06, 2020, 04:24 AM »
the convenience granted by the current internet infrastructure is far more problematic than most people realize. 
Worthy of a blog post. Thanks for the overview :up:
Tom

brotherS

  • Master of Good Ideas
  • Honorary Member
  • Joined in 2005
  • **
  • Posts: 2,261
    • View Profile
    • Donate to Member
Re: Not CPU, not GPU, but …DPU?
« Reply #5 on: October 06, 2020, 05:37 AM »
the convenience granted by the current internet infrastructure is far more problematic than most people realize.
Worthy of a blog post. Thanks for the overview :up:
I agree. With both of that. :)

And I'm somehow reminded of Lo and Behold: Reveries of the Connected World (2016), Werner Herzog's exploration of the Internet and the connected world. https://www.imdb.com/title/tt5275828/