Perplexity has announced the launch of Hybrid Compute, a new feature that enables users to divide tasks between cloud-based AI models and local models running on their computer. This innovation is designed to keep sensitive information safe and secure on the user's machine. Since debuting Perplexity Computer in February, the platform has expanded to include several products, such as Personal Computer for Mac.
The Hybrid Compute tool suggests various use cases where it would be beneficial, including a lawyer preparing a brief that compares their case to existing case law while keeping client data confidential. Additionally, Perplexity is positioning Hybrid Compute as a cost-saving solution for users by offloading some work from pricier frontier models to local models.
According to Jon Staff, who oversees Perplexity's Mac products, the new feature is integrated directly into the Mac app. Before delegating tasks, the system checks for sensitive content and ensures the user wants to share data with the cloud. A new privacy classifier automatically suggests files and information that should be kept on the computer.
Users have control over which models handle their tasks, with options including Gemma E4B and two variants of Qwen's 35-billion parameter 3.6 model. The company plans to offer more local models in the future. Installing a local model does not require opening the Mac's terminal, as the app handles the installation process.
Once Hybrid Compute is underway, users can view a visualization of their local CPU, GPU, and memory usage, along with a sidebar showing token consumption. Users are not charged for tokens generated by local models on their personal machine. After the system generates an output, users can provide follow-up instructions or queue tasks using an iPhone.
Staff noted that while a fully cloud-based system may produce better outputs in terms of raw artifact creation, some users prioritize data privacy and cost. Hybrid Compute allows users to decide where they are on the sliding scale between these factors, depending on the type of work they want to do.
Currently, Hybrid Compute is available only on Apple Silicon Macs running macOS 15, with a recommended minimum of 32GB of unified memory. The feature is accessible to Pro and Max subscribers, as well as enterprise customers.
Cet article a été rédigé avec l'assistance de l'IA.
News Factory APP - actualités agentiques pour booster votre SEO et AEO.