Since the launch of ChatGPT there have been many voices of doom about security and how the AI platform could assist cyber criminals but the creators, OpenAI disagree. The company has just released GPT-4 which they claim is more creative and collaborative than ever before. It can generate, edit, and iterate with users on creative and technical writing tasks, such as composing songs, writing screenplays, or learning a user’s writing style.
Following the research path from GPT, GPT-2, and GPT-3, their deep learning approach leverages more data and more computation to create increasingly sophisticated and capable language models. OpenAI have spent 6 months making GPT-4 safer and more aligned. GPT-4 is 82% less likely to respond to requests for disallowed content and 40% more likely to produce factual responses than GPT-3.5.
The company claims that they have incorporated more human feedback, including feedback submitted by ChatGPT users, to improve GPT-4’s behaviour. “We also worked with over 50 experts for early feedback in domains including AI safety and security. We’ve applied lessons from real-world use of our previous models into GPT-4’s safety research and monitoring system. Like ChatGPT, we’ll be updating and improving GPT-4 at a regular cadence as more people use it.
GPT-4-assisted safety research
“GPT-4’s advanced reasoning and instruction-following capabilities expedited our safety work. We used GPT-4 to help create training data for model fine-tuning and iterate on classifiers across training, evaluations, and monitoring. GPT-4 was trained on Microsoft Azure AI supercomputers. Azure’s AI-optimised infrastructure also allows us to deliver GPT-4 to users around the world.
Limitations
“GPT-4 still has many known limitations that we are working to address, such as social biases, hallucinations, and adversarial prompts. We encourage and facilitate transparency, user education, and wider AI literacy as society adopts these models. We also aim to expand the avenues of input people have in shaping our models.”
GPT-4 is available on ChatGPT Plus and as an API for developers to build applications and services.
