When you purchase through links on our site, we may earn an affiliate commission.Heres how it works.
Big name AI may get all the headlines, but behind the scenes theres another revolution going on.
My tests revealed three surprisingly good chatbots.
Something that’s all the more remarkable with the meager resources of my Android phone.
I was genuinely shocked by how satisfying they are to use.
Local AI
This chatbot has an interesting take on adding AI to a phone.
For instance the Fast setting is extremely quick.
Hopefully that will be fixed soon by the developers.
Download Local AI on the Play Store here.
Beyond that, things run very slowly indeed.
The model size vs speed equation is a constant constraint of these apps.
The fact is current smartphones, apart from very high end models, are not built for processing AI.
The result is most of the responses will be quite slow even using tiny models such as Gemma 2.
Download Private AI on the Play Store here.
PocketPal
One of the big surprises was howgoodthis free Android app is.
So the fast speed is a surprising bonus.
This includes different cache parameters, and also using flash attention for faster processing.
One feature I particularly liked is the ability to add a different system prompt to each model individually.
Download PocketPal on the Play Store here.
More from Tom’s Guide
