Tiiny AI unveils pocket AI supercomputer

Tiiny AI has unveiled the Tiiny AI Pocket Lab, the world's smallest AI 'super-computer'.

The company said, in a statement, that the pocket-sized device can run up to a full 120-billion-parameter large language model entirely on-device without cloud connectivity, servers, or high-end GPUs, and that it operates within a 65W power envelope for energy-efficient personal intelligence.

Tiiny AI cited Grand View Research, estimating the global LLM market at $7.4 billion in 2025 and projecting $35.4 billion by 2030.

Tiiny AI said the Pocket Lab relies on two core technologies, TurboSparse and PowerInfer, to make large-parameter models viable on a compact device; PowerInfer is described as an open-source heterogeneous inference engine with more than 8,000 GitHub stars.

The company gave specifications including an ARMv9.2 12-core CPU, a custom heterogeneous module delivering ≈190 TOPS, 80GB LPDDR5X memory, and a 1TB SSD. It listed power and size details as 30W TDP, 65W typical system power, and dimensions of 14.2 × 8 × 2.53 cm at approximately 300g.

“Cloud AI has brought remarkable progress, but it also created dependency, vulnerability, and sustainability challenges," said Samar Bhoj, GTM Director of Tiiny AI.

Bhoj added: "With Tiiny AI Pocket Lab, we believe intelligence shouldn’t belong to data centers, but to people. This is the first step toward making advanced AI truly accessible, private, and personal, by bringing the power of large models from the cloud to every individual device.”

The Tiiny AI Pocket Lab was verified by Guinness World Records as"The Smallest MiniPC (100B LLM Locally)."

The Recap

• Tiiny AI unveiled a pocket-sized on-device AI supercomputer.
• Device runs up to 120-billion-parameter LLMs fully on-device.
• One-click open-source model deployment; CES release scheduled in January.