Ask HN: How can an AI/ML model distinguish between normal vs. sarcastic opinion?

  • I'm tossing some random sentences at GPT-3.

    "I love pizza." - Not sarcastic

    "I love my boss." - Possibly not sarcastic, depending on context.

    "This meal you have served me looks absolutely fucking delicious." - Sarcastic

    "This will be fun." - Could be sarcastic, but also genuine. (AI knows how to give non-answers lol)

    As a human, can you tell? I think it's the same. Both humans and AI have trouble without the context. GPT-3 is trained on more words than you and I have ever read. It's quite global, but leans American.

    In the guidelines, we're encouraged to control the AI's tone. You don't tell it to "respond to this email". You tell it to "respond politely to this email." Otherwise angry emails will get angry responses.

  • idk it sounds like a good research problem.

    Maybe you could get partway there with a tone and object-property analysis which detects contrasting tones next to each other. e.g. in the latter example, referencing a disgusting food and saying it’s delicious. especially if the tone is exaggerated, e.g. “[person] seems like a real-life Romeo” (probably sarcastic) vs “[person] seems like he’d be nice” (probably real); “I’m sure everyone will love [controversial proposal]” vs “[controversial proposal] has its flaws, but I still think it’s better than the alternatives”.

    Of course considering how many real people fail to detect sarcasm or say things unironically, it will never be 100%. But generally something is sarcastic when it is ridiculous and obviously false, so obvious that you don’t really need much logic or understanding to see, and you can just infer by the phrasing.

  • It can't because sarcasm often relies on global context not available in the input, and there hasn't been any good research.

  • Current SoTA: Not possible

    Potential solutions would require long term conversational context/memory.

  • Doesn't Poe's law make this basically impossible?