1. Does she have trouble multiplying numbers beyond 2-3 digits if she’s not allowed to write out the steps?
2. If you ask her a question whose answer she doesn’t know, does she sometimes make something up?
3. Is she incapable of matching the heights of human intellect, not able yet to independently advance the frontiers of science and technology without outside assistance?
4. If asked to draw a photorealistic image of a person, do the resulting anatomical proportions or fine details sometimes look off on a close inspection?
5. Does her code sometimes contain bugs?
6. Does she start to forget exact details of what she’s already read after the first 10 million tokens?
7. Does she sometimes claim to be conscious?
8. Can she impress Terrence Tao enough that he would want to work with her, yet still fail to bring enough original insights to a conversation with Ed Witten about quantum mechanics for him to be impressed?
