About tinyrocs

tinyrocs is a small and efficient direct to chip liquid cooled GPU AI cluster.

tinyrocs photo


  • Multiple AMD Radeon 7900XTX GPUs, RNDA3, 24G RAM for AI compute.

  • AMD Epyc CPUs.

  • Direct to chip liquid cooled CPU.

  • Direct to chip liquid cooled GPUs.

  • PCIe 4.0 16x redrivers.

  • USA domestic 110V power (one node per 15-20A circuit). Currently using 3x domestic circuits (3x 15-20A)…

  • ASRock ASRack ROMED8-2T motherboards with seven PCIe 4.0 16x.

  • Mining rig chassis.

  • Relative low cost, high performance, perhaps.



  • Hardware built.

  • Toolchain built.

  • tinygrad works, running the workloads on the AMD GPUs.

  • GNU/Linux.

  • Natively built ROCm, using latest 6.0.2 release.

  • Direct to chip liquid cooling setup, with six AMD GPUs.

  • Five AMD GPUs on the PCI bus (e.g. 5/6 GPUs plugged in to motherboard).

  • Custom built working kernel from AMD’s Linux repo.

  • Wet Rocks, liquid immersion system started: https://wetrocks.fyi

tinyrocs photo

tinyrocs running.


tinyrocs loosely based on tinybox, a design from tinygrad corp. The tinyrocs project is independent of upstream tinygrad.


Where possible, libre licenses are used. Acceptable licenses are based on the FSF’s list, plus anything Wikipedia can use. In practice this means GPL-type, MIT, most Creative Commons (except NC), public domain, etc. are used.

Any exceptions to the above will be duly noted.

Copyright (C) 2023, 2024, Jeff Moe


Jeff Moe <moe@parrot.codes>
Loveland, Colorado