• Starter AI
  • Posts
  • GPT-4o’s Fine-tuning, Google’s bioacoustic model, Nvidia’s Nemotron4 4B Instruct

GPT-4o’s Fine-tuning, Google’s bioacoustic model, Nvidia’s Nemotron4 4B Instruct

Take your application to the next level.

Author

Sthefania
August 21, 2024

Hello, Starters!

Innovation in the AI era always comes from the hands of developers, who play a key role in the industry, so it's unsurprising that every day, even more companies keep putting the right tools at their disposal.

Here’s what you’ll find today:

  • You can now fine-tune GPT4-o

  • Google Research presents HeAR

  • Nvidia’s on-device model for gaming

  • OpenAI announces collaboration with Condé Nast

  • Microsoft’s latest Phi models

  • And more.

Sky's the limit now for developers as OpenAI has finally launched a fine-tuning feature for GPT-4o. This will allow the customization of the model for an infinite list of use cases, ensuring users full ownership of their data and promoting the surge of innovative applications by offering 1M training tokens per day for free next month.

Fine-tuning is available in all paid tiers and includes a fine-tuning option for GPT-4o mini, which will also have free training tokens. As an example of the breakthroughs developers can create with GPT-4o at hand, OpenAI shares the Genie AI software engineering assistant from Cosine, which recently achieved great results in the SWE-bench benchmark.

Google Research's latest model showcases how AI can transform the health field. HeAR (Health Acoustic Representations) is a bioacoustic foundation model, trained on 300 million pieces of audio data, which can provide revealing insights into patients' well-being through audio analysis. Through this approach, over time, a sound can lead to a diagnosis.

HeAR also includes a cough model, which has been trained on 100 million cough sounds. As the model is available for custom research, companies like India's Salcit Technologies have used it to develop an application for early tuberculosis detection.

Developed with a focus on gaming, Nvidia has presented Nemotron-4 4B Instruct, an on-device small language model that's part of the company's ACE suite. Nemotron harnesses retrieval-augmented generation and function-calling to improve the performance of game characters.

Mecha BREAK, a game developed by Amazing Seasun Games, is currently using the model, showcasing how Nemotron enhances role-playing, creating dynamic gameplay that allows seamless interactions between characters and players.

🤝OpenAI has revealed that Condé Nast is joining their list of partnerships, allowing content from leading publications to appear in ChatGPT, and now in their SearchGPT prototype. Through this alliance, which includes brands like Vogue, Wired, The New Yorker, and more, OpenAI continues to forge a path for AI in journalism.

🤖Microsoft introduced new versions of their Phi models to their family. Phi 3.5 is multimodal, with an open licence, and comes in mini, MoE, and Vision versions with 3.82B, 41.9B, and 4.15B parameters each. They've improved in tasks like reasoning, and image and video analysis, surpassing leading models like Gemini 1.5 or Meta's Llama 3.1 in certain benchmarks.

What did you think of today's newsletter?

Login or Subscribe to participate in polls.

Thank you for reading!