![Original on Transparent_edited.png](https://static.wixstatic.com/media/992e83_ca4cafe890ff4fa79657769283a877d8~mv2.png/v1/fill/w_80,h_80,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/Original%20on%20Transparent_edited.png)
Bits With Brains
Curated AI News for Decision-Makers
What Every Senior Decision-Maker Needs to Know About AI and its Impact
Here We Go! The Training and Launch of GPT-5
1/31/24
Editorial team at Bits with Brains
Sources at OpenAI indicate that it has begun the full training run of their next major language model, GPT-5.
![](https://static.wixstatic.com/media/992e83_1725536a4f214e8a8a8e6868120c40a1~mv2.jpg/v1/fill/w_579,h_312,al_c,q_80,usm_0.66_1.00_0.01,enc_avif,quality_auto/Image-place-holder.jpg)
This signifies the scaling up of OpenAI's compute resources to train the largest version of the model possible. Typically, OpenAI trains smaller versions first to gather insights and reduce cost, but comments from their president, Greg Brockman, and other employees indicate they have now moved beyond this phase.
While full details are not public, OpenAI’s Sam Altman suggests GPT-5 will be about 10x larger than GPT-4 in terms of parameters. It is likely to have significantly more layers, a larger embedding dimension for a more nuanced understanding of words and contexts, and additional mixture-of-experts layers that allow for more specialized reasoning.
The launch also signifies that OpenAI's safety review process is ramping up. They have closed applications for red team researchers who will rigorously test GPT-5 and prepare tools to analyze model outputs. This thorough safety review is expected to take about 6 months once initial training is complete.
Capabilities and Performance Improvements
GPT-5 is expected to show dramatic gains in key areas like mathematical reasoning, coding tasks, and providing reliable responses. By sampling the model thousands of times on a question and selecting the highest-rated answer, early OpenAI research indicates that performance can double on academic tests.
Other areas of focus include faster response times, seamless voice interactions, and multi-modal abilities like processing images, audio, and video. The goal is for GPT-5 to serve as a responsive and intelligent assistant across many modalities.
There also appears to be a strong emphasis on improving GPT-5's reasoning and transparency. It looks like it may explain its reasoning in natural language, allow external checking of logic, and rate its own confidence in conclusions drawn. This could greatly increase trust and reliability.
Potential Release Timeline
OpenAI's Greg Brockman estimates GPT-5 initial training will likely complete from March to September 2024. Factoring in an extensive safety review of 6 or so months puts full release around November 2024.
This targets releasing shortly after the 2024 U.S. elections, avoiding any controversies around potential misuse during election campaigns.
It also spaces out GPT-5 from competitor releases like Anthropic's Claude 3, aiming for maximum impact.
Safety Considerations
OpenAI is taking substantial steps to ensure GPT-5 is safe, beneficial, and robust before release. Their safety review involves extensive testing by an independent "red team" of researchers looking for potential harm.
They are also focused on improving transparency, by having GPT-5 show its reasoning in natural language. This allows judgement of whether conclusions logically follow. Confidence ratings will also help identify areas where the model is uncertain or speculative.
Reportedly, legal safeguards and terms of use will be implemented to prevent malicious uses like impersonation, fraud, spreading misinformation, and more. The goal is for GPT-5 to be safely usable in real-world applications.
Use Cases
The launch of GPT-5 training may signal a new level of capability for generative AI. While full details remain unclear prior to release, measurable gains are expected in areas like mathematical reasoning, coding, voice interactions and of course, transparency.
For executives and senior decision-makers, this translates to new possibilities for use cases compared to those of today's GPT-4. With stronger logical reasoning and multi-modal abilities, GPT-5 could help accelerate key business functions - from analyzing financial models, to reviewing contracts, generating reports, and software development.
Its ability to explain conclusions could also increase trust in recommendations for strategic decisions. And seamless voice abilities open conversational interfaces for various workflows. Of course, the extent of these gains depends on the final model parameters and data training distribution. But the safety review process, while lengthening release timelines, will help ensure responsible rollout.
Overall GPT-5 has the potential to be a transformative productivity tool across many industries. The key for executives is continuing to track developments, and strategizing where generative AI could augment human strengths.
However, decision-makers should not wait for the release of GPT-5. Pilot projects with today's models can also inform future integration. By laying the groundwork now, organizations can fully leverage GPT-5’s upcoming launch.
Sources:
[1] https://youtu.be/Zc03IYnnuIA?si=4cp-wrBVcvdeE_8f
[2] https://www.theverge.com/2023/4/14/23683084/openai-gpt-5-rumors-training-sam-altman
[3] https://singularityhub.com/2023/11/15/openai-ceo-sam-altman-says-his-company-is-now-building-gpt-5/
[4] https://www.mainstreetitsolutions.com/gpt-5-the-game-changer-for-businesses-what-you-need-to-know/
[5] https://www.reddit.com/r/OpenAI/comments/183p4rw/what_bold_predictions_do_you_have_for_gpt5/
[6] https://www.gizchina.com/2023/11/15/openai-ceo-confirms-that-it-is-developing-gpt-5/
Sources