AIME A8000 - Deep Learning Server

If you are looking for a server specialized in maximum deep learning training, inference performance and for the highest demands in HPC computing, the AIME A8000 multi-GPU 4U rack server takes on the task of delivering.

The AIME A8000 is based on the ASUS ESC8000A-E11 barebone which is powered by two AMD EPYC™ Milan processors, each with up to 64 cores. Totaling a CPU performance of up to 256 parallel computable CPU threads.

Its GPU-optimized design with high air flow cooling allows the use of eight high-end double-slot GPUs like the NVIDIA A100, RTX 6000 Ada, RTX A5000 / A6000, RTX 3090 Turbo, Tesla or Quadro GPU models.

Definable GPU Configuration

Choose the desired configuration among the most powerfull NVIDIA GPUs for Deep Learning:

Up to 8x NVIDIA A100

The NVIDIA A100 is the flagship of the NVIDIA Ampere processor generation and the current successor to the legendary NVIDIA Tesla accelerator cards. The NVIDIA A100 is based on the GA-100 processor in 7nm manufacturing with 6912 CUDA cores, 432 third-generation Tensor cores and 40 or 80 GB HBM2 memory with the highest data transfer rates. A single NVIDIA A100 GPU already breaks the peta-TOPS performance barrier. Eight accelerators of this type add up to more than 2000 teraFLOPS fp32 performance.

Up to 8x NVIDIA RTX 6000 Ada

The RTX ™ 6000 Ada is built on the latest NVIDIA GPU architecture: Ada Lovelace. It is the direct succesor of the RTX A6000 and the Quadro RTX 6000. The RTX 6000 Ada combines 568 fourth-generation Tensor Cores, and 18.176 next-gen CUDA® cores with 48GB of graphics memory for unprecedented rendering, AI, graphics, and compute performance.

Up to 8x NVIDIA RTX A6000

The NVIDIA RTX A6000 is the Ampere-based successor to the NVIDIA Quadro series. It features the same GPU processor (GA-102) as the RTX 3090, but all cores of the GA-102 processor enabled. It outperforms the RTX 3090 with its 10752 CUDA and 336 Gen 3 Tensor cores. Equipped with 48 GB GDDR6 ECC, twice the amount of GPU memory compared to the predecessor of the Quadro RTX 6000 and the RTX 3090. The NVIDIA RTX A6000 is currently the second fastest NVIDIA GPU available, beaten only by the NVIDIA A100. It is best suited for memory demanding tasks.

Up to 8x NVIDIA RTX A5000

With its 8,192 CUDA and 256 Tensor cores of the 3rd generation, the NVIDIA RTX A5000 is less powerful than a RTX 3090. However, with its 230 watts of power consumption and 24 GB of memory, it is a very efficient accelerator card and especially for inference tasks a very interesting option.

All NVIDIA GPUs are supported by NVIDIA’s CUDA-X AI SDK, including cuDNN, TensorRT which power nearly all popular deep learning frameworks.

Dual EPYC CPU Performance

The high-end AMD EPYC CPU designed for servers delivers up to 64 cores with a total of 128 threads per CPU with an unbeaten price performance ratio.

The available 2x 128 PCI 4.0 lanes of the AMD EPYC CPU allow highest interconnect and data transfer rates between the CPU and the GPUs and ensures that all GPUs are connected with full x16 PCI 4.0 bandwidth.

A large amount of available CPU cores can improve the performance dramatically in case the CPU is used for preprocessing and delivering of data to optimaly feed the GPUs with workloads.

Up to 16 TB High-Speed SSD Storage

Deep Learning is most often linked to high amount of data to be processed and stored. A high throughput and fast access times to the data are essential for fast turn around times.

The AIME A8000 can be configured with up to two exchangeable U.2 NVMe triple level cell (TLC) SSDs with a capacity of up to 8 TB each, which adds up to a total capacity of 16 TB of fastest SSD storage.

Since each of the SSDs is directly connected to the CPU and the main memory via PCI 4.0 lanes, they achieve consistently high read and write rates of 3000 MB/s.

As usual in the server sector, the SSDs have an MTBF of 2,000,000 hours and a 5-year manufacturer's guarantee.

High Connectivity and Management Interface

Additionally to the standard 2x 1 Gbit/s and 1x 10 Gbit/s SFP+ LAN ports the A8000 is fitted with up to 2x 100 Gbit/s (GBE) network adapter for highest interconnect to NAS resources and big data collections. Also for data interchange in a distributed computing setup the highest available LAN connectivity is a must have.

The AIME A8000 is completely remote manageable through IPMI/BMC (AST2600) which makes a successful integration of the AIME A8000 into larger server clusters possible.

Optimized for Multi GPU Server Applications

The AIME A8000 offers energy efficiency with redundant Titanium grade power supplies, which enable long time fail-safe operation.

Its thermal control technology provides more efficient power consumption for large-scale environments.

All setup, configured and tuned for perfect Multi GPU performance by AIME.

The A8000 comes with preinstalled Linux OS configured with latest drivers and frameworks like Tensorflow, Keras, PyTorch and Mxnet. Ready after boot up to start right away to accelerate your deep learning applications.