Show HN: Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/O

by ij23on 7/27/2023, 1:31:35 AM with 7 comments
  • by d4rkp4tternon 7/27/2023, 12:30:47 PM

    Great start! Are you planning to add to following:

    Retries w exponential backoff, Caching, Streaming output, Function-calling support

  • by uripeled2on 7/27/2023, 9:00:59 PM

    Take a look at llm-client a similar library that also support chat, async and more llm providers https://github.com/uripeled2/llm-client-sdk

  • by kaushik92on 7/27/2023, 4:38:07 PM

    This is amazing. Really needed something like this to standardize all my different AI APIs!

    On a side note - I love how quickly your team is shipping! Do keep it going!

  • by neha_non 7/27/2023, 6:10:04 AM

    This is much needed. For someone looking to quickly implement, having a simple interface goes a long way.

  • by ydingon 7/27/2023, 7:25:06 AM

    Very cool Ishaan!

  • by hardware2winon 7/27/2023, 12:23:36 PM

    >completion(..., azure=True)

    Why like this?

  • by detente18on 7/27/2023, 4:03:43 AM

    [dead]