When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
Specifications:
Case: 6U Rack with glass front door and two side doors all lock
Motherboard: X99-8D4 ZSUS LGA-2011 socket 4x RAM slots PCIe 3.0 x16 x1
CPU: Intel LGA2011-3 Xeon E5 2699 V4 2.2GHZ Turbo 3.6GHZ 22-Core 44 Threads 55Mb L3Cache CPU w/ 6 copper pipe heatsink x1 fan
RAM: 128GB - DDR4 2133MHZ LRDIMM ECC RAM
Storage: Samsung 970 PRO NVMe M.2 512GB V-NAND
PSU: Corsair CX750M PSU 750W 80+%
GPU: NVIDIA Tesla Referral P100 16GB GDDR5 GPU
Open Studio Chassis ATX form x2 fans
Running Ubuntu Server 22
ssh and vnc installed for easy access
GPU stack
LMStudio
Stable Diffusion
This runs Llama 3 8b Q4 at 35 tokens/second its fast.
Run your own AI models without cost for tokens or hosting servers. Machines like this rent for $1,050 a month at google cloud $1.5xx per hour for P100 GPU.
Priced to sell Great holiday gift
Documentation