Apple recently announced a new feature for upcoming versions of iOS and macOS that provides predictive text recommendations as users type. This is one of the first transformer-based models that Apple will ship, highlighting their focus on polish and perfection. However, there are still unanswered questions about the feature, such as the underlying model, its architecture, and the training data used. The feature completes individual words and occasionally suggests more than one word at a time in instances where the upcoming words are obvious. The predictive text model appears to be stored in a specific location on the macOS operating system. It is smaller in size compared to popular language models like GPT-2, which allows for quick and frequent predictions without draining device battery. While the model may not be great at generating full sentences, it performs well in suggesting the next word or two.
https://jackcook.com/2023/09/08/predictive-text.html