Some approaches we’ve used:
- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.
- RAG where only relevant parts are included in the context.
- Use an LLM with a larger context window (like Gemini pro)
Some approaches we’ve used:
- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.
- RAG where only relevant parts are included in the context.
- Use an LLM with a larger context window (like Gemini pro)