Introduction

With the launch of the 5th Gen AMD EPYC processors (codenamed Turin), immense memory bandwidth and computational resources are accessible even within a personal workstation environment. The EPYC 9175F, in particular, offers a unique blend of massive L3 cache and high clock speeds, making it an ideal choice for LLM inference – especially for running 1T-parameter MoE models locally on the CPU.

In this post, I detail the configuration of the HPCT WCE51-GP, a high-performance workstation from HPCT (High Performance Computing Technologies) built around this specific Turin processor.

Background: Building vs. Buying

Initially, I considered a DIY approach using standalone EPYC 9005-compatible motherboards, such as the ASRock Rack GENOAD12M3-2Q. However, the EPYC 9005 series presents significant challenges: TDPs exceeding 300W and the thermal/power management required for 12 channels of DDR5 memory are notoriously difficult to manage in a custom build.

Given the investment – roughly 520,000 JPY for the CPU alone and another 740,000 JPY for a full 768GB RAM stack – reliability is paramount. I decided that a professional workstation package, integrating a proven chassis, high-wattage power supply, and optimized cooling system, was the more rational choice. This led me to the HPCT WCE51-GP, which is built on a Supermicro platform.

Technical Specifications of the HPCT WCE51-GP

This system packs server-grade scalability and reliability into a full-tower chassis while maintaining a single-socket EPYC configuration.

CPU and Memory

The heart of the system is the AMD EPYC 9175F. To fully leverage the 12-channel memory architecture of the Turin generation, I opted for 768GB of DDR5-6400 ECC RDIMM, populating all 12 slots. This configuration is specifically designed to eliminate memory bandwidth bottlenecks during LLM decoding phases.

Expansion and I/O

The motherboard provides ample room for future expansion, including multi-GPU setups:

  • 3 x PCIe 5.0 x16 Slots
  • 2 x PCIe 5.0 x8 Slots

For storage, the system includes 8 x SATA3 ports and three MCIO interfaces (PCIe 5.0 x8), allowing for a flexible NVMe SSD array. The M.2 slots support up to 22110 form factors, making it easy to use enterprise-grade SSDs with Power Loss Protection (PLP).

Networking and Management

Networking is handled by dual 10GBase-T ports (Broadcom BCM57416). Being a Supermicro-based system, it also includes a dedicated IPMI LAN port for remote management. Tools like Supermicro Server Manager (SSM) and SuperDoctor 5 provide granular hardware monitoring from the OS level, which is a critical feature for a system running persistent server tasks.

Conclusion and Future Outlook

The HPCT WCE51-GP serves as the perfect foundation for extracting the maximum performance from the EPYC 9175F. The combination of stable 12-channel memory operation and a robust power supply (750W - 1500W) is essential for long-running inference tasks.

My next steps involve finalizing the order and setting up an Ubuntu 24.04 environment to run massive MoE models like Kimi-K2.5. By choosing a pre-integrated workstation over a DIY build, I am minimizing risk while gaining full access to the cutting-edge Turin architecture.

Specs Overview

ItemSpecification
ModelHPCT WCE51-GP
ChassisFull-Tower (244 x 567 x 523 mm)
CPUAMD EPYC 9175F (Turin)
RAM768GB DDR5-6400 ECC RDIMM (12 slots)
Networking10GbE x2 + IPMI x1
I/OPCIe 5.0 x16 (x3), PCIe 5.0 x8 (x2), MCIO (PCIe 5.0 x8) x3
PSU750W - 1500W
OSLinux x86_64