8 FrontierMath was funded by OpenAI, but the communication about this connection was non-transparent. The mathematicians creating the problems were not informed about the funding, and contractors working on the dataset were also unaware. Epoch AI admits to the lack of transparency and commits to being more upfront in the future. OpenAI has access to a large fraction of the problems and solutions, despite claims to the contrary. Questions arise about the integrity of using this data for capabilities advancement, leading to concerns about potential conflicts of interest and implications for AI progress. The need for clear agreements regarding data usage and transparency is highlighted.
https://www.lesswrong.com/posts/cu2E8wgmbdZbqeWqb/meemi-s-shortform