Show HN: Review GitHub PRs with AI/LLMs

  • At the time of writing, the first sample image on that page is this:

    https://coderabbit.ai/assets/section-1-f9a48066.png

    which recommends adding a "maxIterations" counter to the "for len(executedComponents) ..." loop here:

    https://github.com/fluxninja/aperture/blob/26e00ea818c7c28da...

    HOWEVER

    - the review has failed to notice the logic using "numExecutedBefore" (around line 377) that already prevents the specific bug it is suggesting a fix for

    - the suggested change decrements "maxIterations" inside the "for ... range circuit.components {" loop which means it isn't counting iterations, it's counting components

    This kind of suggestion is particularly nasty because it's unlikely that the test suite populates enough components to hit "maxIterations" - so an inattentive reader could accept it, get a green build, and then deploy a production bug!

  • It looks pretty promising, but I think one of the problems with AI checked PRs is that it gives pretty plausible sounding answers that aren't really correct, which is why StackOverflow has banned them off the platform.The line-by-line checking could help though.