I told it to use common sense to one of the questions he asked and it answered fine
using common sense answer the following logic problem:
if cindy is alive at noon and alive at 5 pm is she alive at 3 pm?
Based on common sense, if Cindy is alive at noon and alive at 5 pm, it's reasonable to assume that she is alive at 3 pm. This is because there is no information provided that suggests she would have died or become incapacitated between those two times. It's possible that she could have experienced an event that would cause her death or incapacity during the three-hour period, but based solely on the information given in the problem, it's safe to assume that she is still alive at 3 pm.
Great interview. Pinker's responses are well thought-out and accurate. He admits not expecting LLMs to get this good at so many things so quickly, illustrates their failure modes with simple examples than anyone can grasp, and expects these models to get significantly better (i.e., make fewer mistakes) over time.
I'm not doing justice to the interview with this short comment.
Go read it!