| |
Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
Needle2 is a 14MB open-source language model designed for resource-constrained devices like budget phones, smartwatches, and IoT devices, specializing in tool calling and device control without requiring GPUs or extensive memory. The model achieves this efficiency by focusing narrowly on mapping user requests to predefined device functions rather than general knowledge, using only 45M parameters while maintaining accuracy comparable to larger models. It includes features like structured output extraction, confidence-based edge-cloud collaboration for complex requests, and lossless 2-bit compression to fit within tight memory constraints.
Read Full Article →
← More Tech news