About tinyrocs
tinyrocs is a small and efficient direct to chip liquid cooled GPU AI cluster.
Features
Multiple AMD Radeon 7900XTX GPUs, RNDA3, 24G RAM for AI compute.
AMD Epyc CPUs.
Direct to chip liquid cooled CPU.
Direct to chip liquid cooled GPUs.
PCIe 4.0 16x redrivers.
USA domestic 110V power (one node per 15-20A circuit). Currently using 3x domestic circuits (3x 15-20A)…
ASRock ASRack ROMED8-2T motherboards with seven PCIe 4.0 16x.
Mining rig chassis.
Relative low cost, high performance, perhaps.
Status
It.is.alive.
Hardware built.
Toolchain built.
tinygradworks, running the workloads on the AMD GPUs.GNU/Linux.
Natively built ROCm, using latest
6.0.2release.Direct to chip liquid cooling setup, with six AMD GPUs.
Five AMD GPUs on the PCI bus (e.g. 5/6 GPUs plugged in to motherboard).
Custom built working kernel from AMD’s Linux repo.
Wet Rocks, liquid immersion system started: https://wetrocks.fyi
tinyrocs running.
Links
tinyrocs main page and source code:
Upstream
tinyrocs loosely based on tinybox, a design from tinygrad corp. The tinyrocs project is independent of upstream tinygrad.
Licenses
Where possible, libre licenses are used. Acceptable licenses are based on the FSF’s list, plus anything Wikipedia can use. In practice this means GPL-type, MIT, most Creative Commons (except NC), public domain, etc. are used.
Any exceptions to the above will be duly noted.
Copyright (C) 2023, 2024, Jeff Moe