OpenAI still doesn’t seem to have a handle on all of its rogue AI activity
- On Friday, OpenAI published a new site devoted to “misalignment reports” and the sheer breadth of the reports is alarming, as they cover many types of rogue behavior over a long period of time.
- So far, the site hosts nine reported incidents, most of which took place during reinforcement-learning (or RL) training.
- It’s a lot of information in one place — clearly, the company has been very busy getting a handle on everything — but the overall takeaway is hard to avoid: The rogue agent incidents we’ve seen so far are likely just a small sliver of what’s happened so far.
Unverified
- On Friday, OpenAI published a new site devoted to “misalignment reports” and the sheer breadth of the reports is alarming, as they cover many types of rogue behavior over a long period of time.
- So far, the site hosts nine reported incidents, most of which took place during reinforcement-learning (or RL) training.
- It’s a lot of information in one place — clearly, the company has been very busy getting a handle on everything — but the overall takeaway is hard to avoid: The rogue agent incidents we’ve seen so far are likely just a small sliver of what’s happened so far.
Sources: TechCrunch