If GPT (decoder-only transformer) models are text predictors, then why keyboard apps on PCs/phones don’t have GPTs as text predictor options? They can be more accurate than the widely used N-gram models.
If GPT (decoder-only transformer) models are text predictors, then why keyboard apps on PCs/phones don’t have GPTs as text predictor options? They can be more accurate than the widely used N-gram models.
Probably power. It takes a lot to power the text predictors. Adding it to every single phone would probably mean a huge uptick in resource usage.
I’m just guessing though.
You’re absolutely correct. Battery and RAM usage too hard to manage for now, phone makers will probably wait until the tech gets further before experimenting with this publicly