To be fair to OpenAI, it allowed the testing in the first place. But it shows how much rides on what a company chooses to share.
A trained AI model is essentially a very large file of numbers, often costing more than $100 million to produce, and whoever has a copy has the model. Handing copies to outsiders is a security risk. Until recently, that left testers with an awkward choice, which Google DeepMind has described well: either the testers hand over their questions, so the company sees the exam in advance, or the company hands over its model.
In August, DeepMind showed a way around that. Working with Singapore’s AI Safety Institute and three other outside groups, it ran what it called the world’s first double-blind test of an AI model, on the same principle as a double-blind drug trial. The test ran on sealed computer hardware, so the outside testers never saw the model and Google never saw their questions. Google says each side…
