Learnings from employing ChatGPT as a ML Engineer for a day

  • I'm a physician with a software background, another physician at my work used ChatGPT to write a compelling appeal for a patient when insurance denied coverage. I've started to use it to automatically dictate procedural reports. I provide an example report and tell it to modify the report as needed (e.g. "right iliac bone biopsy report with 11G needle"). Beats tabbing (or F2ing) through autotext fields.

    These examples make me think, "ChatGPT for form completion" is the killer app as it applies to law, real estate, medicine, etc.

  • What a frightening conclusion.

    >Can ChatGPT be used to improve an AI system? Yes.

    >Would we hire it as our next standalone ML engineer? No.

    > Let’s wait until GPT4.

    The arms race for AI that can erase the human from cognitive work is really here.

  • We need models that can read long texts like a bunch of scientific papers, a book, or the whole git repo of an app. And we need models that can do iterative changes - diff models, they can be trained of course on git commits.

  • Question on the ML side of this post: How are these "parameterizations" used? Is this really just feature engineering with a new name? Are they including this information when training the model?

    In the article, they mention using the new labels to build a "more balanced" dataset -- is this a realistic possibility in practice when most teams still have a dearth of data?

  • It's too bad they didn't get a chance to try it with Bing's chatbot. Based on what I've seen, the ability for it to reach into an index (or to the internet) to grab specific information creates a qualitative change in its ability.

  • Whats the deal lately with turning verbs into nouns? Learnings, asks - come to mind, but I periodically hear others. It’s not drippy anymore to simply say lessons and questions, bros don’t find them lit?

  • Curious to learn more about prompt engineering takeaways here. Was feeding more context (or chapters of textbooks, bits of papers, documentation) helpful? It does seem like layering information and being very precise helps a lot. Eerily like with interns

  • I use it every day at the f500 I work at. I have gotten my team to adopt it, and it has increased productivity from those who were already productive.

    The people who weren't already good can't figure out how to use it properly.

    I also see a bunch of people online, most?, using it incorrectly, writing prompts that would give bad info. Maybe they're doing it on purpose?

    To those who have everything, more will be given.