Researchers published details about new MM1 model
Ahead of the announcement of iOS 18, which is expected to be packed with AI features, Apple researchers published a paper highlighting how they’re training a new large language model (LLMs).Called MM1, this LLM can integrate text and visual information as one. The paper was submitted last week and offers an interesting look at the importance of various architectural components and data choices. The researchers say they were able to “demonstrate that for large-scale multimodal pre-training using a careful mix of…