Ai2/AllenAI released a FOSS LLM which runs locally on iPhone

OLMoE, meet iOS | Ai2

Our state-of-the-art mixture-of-experts model is now available on the Apple app store! The OLMoE app allows anyone to test the model privately and securely on their devices.