- Starter AI
- Posts
- Is GPT-5 in the works?, Microsoft’s MoRA technique, From OpenAI to Anthropic
Is GPT-5 in the works?, Microsoft’s MoRA technique, From OpenAI to Anthropic
A lot is happening at OpenAI.
Sthefania
May 29, 2024
Hello, Starters!
OpenAI has taken the spotlight for the past few weeks. This isn't unexpected, as we're talking about one of the biggest AI companies at the moment. Although some of the news hasn't been entirely positive, they still have a card to play.
Here’s what you’ll find today:
OpenAI is training its next frontier model
Microsoft and Beihang University present MoRA
Jan Leike turns to Anthropic
AI headphones sync with your gaze
Get ready for Apple's WWDC
And more.
OpenAI has been the subject of much discussion recently, and not all of it has been good. Yet, the company is redirecting this attention to another topic with the announcement of the beginning of training for its next frontier model. Not much insight has been disclosed, so it is yet to be known if this model is going to be GPT-5 or something even more advanced.
On the other hand, the company also announced the formation of a "Safety and Security Committee" after the disbandment of its "Superalignment" team. This committee will oversee their projects and operations, assessing risk management and responsible AI development. It is led by a group of current OpenAI members, such as Bret Taylor, Adam D'Angelo, Nicole Seligman, and last but not least, Sam Altman.
A group of researchers from Microsoft and Beihang University have created a new technique for fine-tuning LLMs that is more cost-effective. MoRA improves traditional methods by focusing on updating only the necessary subset of parameters instead of all the model parameters.
MoRA, a type of "parameter-efficient fine-tuning," addresses the limitations developers often encounter with the LoRA (low-rank adaptation) approach by using square matrices to enhance the model's learning capabilities. Also, a special compression/decompression function allows MoRA to work with different model sizes.
👋 Jan Leike turns to Anthropic (2 min)
Jan Leike, a former member of OpenAI's superalignment team, made headlines recently, primarily due to his criticism of the company's leadership. He noted that he no longer agreed with how they handled priorities. Leike has now joined Anthropic.
The news was shared by Leike himself through a post on X, where he announced his intention to continue his work monitoring the safety and security of AI, while also calling for new members to join his journey. This marks a significant step for Anthropic, a longstanding contender against OpenAI... As for taking the lead, it remains to be seen.
🎧A team from the University of Washington developed a system called "Target Speech Hearing" that leverages AI to allow a user wearing headphones to sync with the person they're looking at while talking. The system then "enrols" the person who's speaking and cancels every other sound, focusing solely on their voice, even if the headphone-wearing user moves.
🍎Apple's upcoming WWDC has officially been scheduled. The company announced that the keynote will start at 10 a.m. PDT and will be live-streamed on its website. After months of anticipation, we're finally going to learn about Apple's AI plans, which are expected to include practical features.
⚡️Quick links
What did you think of today's newsletter? |