Meta’s free GPT-3 replica exposes the business benefits of AI transparency
For once, what’s good for Zuck is good for society
Mutual benefits
Meta’s researchers acknowledge that OPT has major shortcomings.
They note that the system doesn’t work well with declarative instructions or point-blank interrogatives.
It also has a tendency to generate toxic language and reinforce harmful stereotypes — even when fed relatively innocuous prompts.
“In summary, we still believe this technology is premature for commercial deployment,” they wrote in theirstudy paper,
Input from the broader research community could accelerate this maturation — which may not help Meta alone.
The move will hopefully show that businesses and society both benefit from transparency.
You can get the OPT open-source code and small-scale pre-trained modelshere. To try the full 175-billion parameter version, you need to request accesshere,
Story byThomas Macaulay
Thomas is a senior reporter at TNW. He covers European tech, with a focus on AI, cybersecurity, and government policy.Thomas is a senior reporter at TNW. He covers European tech, with a focus on AI, cybersecurity, and government policy.
Get the TNW newsletter
Get the most important tech news in your inbox each week.