Far Labs, Evolving Edge Launch AI Inference Marketplaces on Spare PCs as Data Center Costs Climb
Updated
Updated · IEEE Spectrum · Sep 1
Far Labs, Evolving Edge Launch AI Inference Marketplaces on Spare PCs as Data Center Costs Climb
1 articles · Updated · IEEE Spectrum · Sep 1
Summary
Far Labs plans to launch Far AI within weeks, while Evolving Edge is already in open beta, letting people rent out idle laptops, gaming PCs and home servers for AI inference.
AI inference demand is rising as companies seek cheaper alternatives to large data centers, especially for smaller fine-tuned open-source models that do not need frontier-scale hardware.
Both startups say they split workloads across many devices and lock them down with open-source or least-privilege software, aiming to address hosts’ security and privacy concerns.
Far Labs says the distributed approach can deliver latency of 100 milliseconds or less and keep running even if many nodes fail, while avoiding the capital costs of centralized facilities.
The pitch also taps backlash against new data centers’ power, water and community impacts, arguing existing local compute can create income for device owners instead.