Speech to text, Voice typing is cool.
F-droid lists opensource apps that support Whisper and Vosk models.
Futo voice is not opensource, but is source available.
It’s good for English. For my mother tongue, Malayalam, the support seems to be underdeveloped currently.
Handy seems to be good for Windows, but have not used it much.
Then for Translations:
https://f-droid.org/packages/dev.davidv.translator/
Using Mozilla’s translation Models. A good enough offline and Open source alternative to GTranslate.
Are there other cool uses of offline ML/AI that you know?
Machine Learning (and even Large Language Models) do have genuine use cases they excel at and are probably more efficient at.
One good example is protein folding. ML transformed biomedical research by basically solving the protein folding problem in minutes on a GPU instead of essentially trying to brute force a solution that was millions to tens of millions times more complex. I’m glossing over details, but it’s mind blowing how much better (especially when you consider resource usage) how much better ML is in this case. Think $1 and minutes vs $100000+ and years… for a single protein.
The problem is using LLMs and Generative AI for things they seem good at but actually aren’t.