If GPT (decoder-only transformer) models are text predictors, then why keyboard apps on PCs/phones don’t have GPTs as text predictor options? They can be more accurate than the widely used N-gram models.
If GPT (decoder-only transformer) models are text predictors, then why keyboard apps on PCs/phones don’t have GPTs as text predictor options? They can be more accurate than the widely used N-gram models.
Have you heard about futo keyboard? It embeds a small LLM model for this very task. It also has an option to retrain based on user data.