Distiller One: Offline AI Outperforms GPT 3.5 🚀

This is the Distiller One, a 3 billion parameter AI model device that’s better than GPT 3.5 and runs on offline hardware. The screen uses e-ink, so it only consumes 5 watts, and it has a microphone to accept speech-to-text inputs.

The startup building Distiller One, Pamir AI, is based in San Francisco and is being incubated at Founders, Inc. Pamir AI hasn’t made this device commercially available yet, they’re still in R&D, but according to one of the founders of Pamir AI, a big part of the inspiration for this product was the dream of being able to play AI-generated dungeons and dragons while camping. Pamir AI is aiming for it to be able to handle more than 10 tokens per second running on a custom board.