Audiogram with Mystery AI Hype Theater 3000 logo, title “Defining AGI: Oops! All Eugenics” and subhead “A new ‘AGI definition’ replicates existing issues with trying to rank intelligence” Alex: I got a beef with their general knowledge thing. And about their, like, their social science and their history categories. Emily: Yes. I was so mad at the categories here. There’s European history, US history, and world history. And art history. Alex: Yes, yeah. So European, US, and world history. And I’m just like, oh, so we’re talking about white history here. Got it. Emily: Yeah. And the thing that explains all of it, I think, is the test that they propose. So beneath each of these, they say, so for the US history one that we were just looking at: “Test, a score of five on the AP US history test is sufficient for the 1%, subject to memorization and robustness checks.” So basically they have said, how could we test general knowledge? Oh, hey, let's go grab the US system of Advanced Placement tests, and we’ll just use that. And that’ll show whether or not our system has this 1% towards the AGI score. Alex: Yeah. Of course it’s very US and Europe centric. And of course it does well on this, because there’s, guess what? There's AP history study guides available online. Like, no kidding it does well on this. You’re training on tests, you know.