If GPT (decoder-only transformer) models are text predictors, then why keyboard apps on PCs/phones don’t have GPTs as text predictor options? They can be more accurate than the widely used N-gram models.
If GPT (decoder-only transformer) models are text predictors, then why keyboard apps on PCs/phones don’t have GPTs as text predictor options? They can be more accurate than the widely used N-gram models.
They’re not text predictors; they’re text transformers. So, more for translating a text from French to English, or providing you a summary of what a large input text is trying to say.
They can do prediction, but not well, and not without a lot of extra computation, as they’re really trying to summarize everything you’ve said, including the bit you haven’t written yet.