Apple approved an Nvidia eGPU driver — your Mac Mini can now run massive AI models

For years, running a serious AI model locally on a Mac meant hitting a hard wall. Apple Silicon’s integrated memory worked beautifully for smaller tasks, but the moment a model grew beyond what unified memory could hold — think 27 billion parameters or larger — you were paying for cloud compute or buying a second machine. A new Apple-approved driver from Tiny Corp, the company founded by programmer George Hotz, just removed that wall.

The driver is called TinyGPU, and it does something that has been technically impossible on Apple Silicon since the M1 chip launched in 2020: it lets an external Nvidia or AMD graphics card connect to a Mac over a standard Thunderbolt or USB4 cable and actually do AI work. Apple officially signed and notarized the driver, meaning users no longer have to disable System Integrity Protection — the security barrier that previously made unofficial eGPU setups risky and unstable.

What this means in practice is significant. A Mac Mini M4, which retails from $699, can now be paired with an external GPU enclosure housing a card like the AMD Radeon RX 7900 XTX and run a 27-billion-parameter AI model at 18.5 tokens per second — a level of performance that would previously have required dedicated hardware costing several times as much. An RTX 4090 setup delivers around 45 to 50 tokens per second on Llama models at standard compression levels, according to community benchmarks.

You May Also LikeMacBook Pro featuring M2 Pro and M2 Max, with more game-changing performance and the longest battery life ever in a Mac

There are real limits to acknowledge. The TinyGPU driver is exclusively for AI compute workloads — it does not accelerate graphics output, and it won’t run games or speed up video editing. AMD cards work with a relatively straightforward setup process, but Nvidia cards require running Docker Desktop, which adds friction that casual users may find off-putting. Thunderbolt 4’s bandwidth ceiling also means external GPUs never reach the speeds they would achieve sitting inside a desktop, so buyers shouldn’t expect to match a native workstation. And while the driver is Apple-approved, it was developed by a third party, not Apple itself — broader GPU ecosystem support remains unconfirmed.

The timing is notable for a different reason. Apple quietly discontinued the Mac Pro this month, removing the product page from its website with no replacement announced. The Mac Pro was the only modular, high-end desktop Apple made. By approving TinyGPU, Apple appears to be signaling that serious compute workloads on macOS should flow through external hardware, not a tower that costs ten times as much as a Mac Mini.

Supported hardware requires macOS 12.1 or later, a Thunderbolt 3, Thunderbolt 4, or USB4 port, and an AMD card from the RDNA3 generation onward or an Nvidia card from the Ampere series. TinyGPU is available now through Tiny Corp’s documentation and GitHub repository.

More Like This

The Suncatcher’s Gambit: Inside Google’s Plan to Win the AI Future

Advantech Taps Qualcomm’s Snapdragon X Elite for New Line of Industrial AI Solutions

DEATH STRANDING DIRECTOR’S CUT Mac Preorders Now Live

SuperX Unveils XN9160-B200 AI Server, Leveraging NVIDIA Blackwell GPU to Deliver Supercomputer-Class Performance

These Tech Giants Just Triggered the Biggest Market Revolution Since the Internet – What You Need to Know

Have you heard? Apple unveils iPhone 15 Pro and iPhone 15 Pro Max!