Data Preparation
+ +| Library | Description | Link | +|--------------|------------------------------------------------------------------------------------------------------|-------| +| Data Prep Kit | Data Prep Kit accelerates unstructured data preparation for LLM app developers. Developers can use Data Prep Kit to cleanse, transform, and enrich use case-specific unstructured data to pre-train LLMs, fine-tune LLMs, instruct-tune LLMs, or build RAG applications. | [Link](https://github.com/data-prep-kit/data-prep-kit) | +Multi API Access
| Library | Description | Link | @@ -78,6 +88,8 @@ This repository contains a curated list of 120+ LLM libraries category wise. |--------------|------------------------------------------------------------------------------------------------------|-------| | mem0 | The Memory layer for your AI apps. | [Link](https://github.com/mem0ai/mem0) | | Memoripy | An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications. | [Link](https://github.com/caspianmoon/memoripy) | +| Letta (MemGPT) | An open-source framework for building stateful LLM applications with advanced reasoning capabilities and transparent long-term memory | [Link](https://github.com/letta-ai/letta) | +| Memobase | A user profile-based memory system designed to bring long-term user memory to your Generative AI applications. | [Link](https://github.com/memodb-io/memobase) |Interface
@@ -172,9 +184,12 @@ This repository contains a curated list of 120+ LLM libraries category wise. | CrewAI | Framework for orchestrating role-playing, autonomous AI agents. | [Link](https://github.com/crewAIInc/crewAI) | | LangGraph | Build resilient language agents as graphs. | [Link](https://github.com/langchain-ai/langgraph) | | Agno | Build AI Agents with memory, knowledge, tools, and reasoning. Chat with them using a beautiful Agent UI. | [Link](https://github.com/agno-agi/agno) | +| Agents SDK | Build agentic apps using LLMs with context, tools, hand off to other specialized agents. | [Link](https://platform.openai.com/docs/guides/agents-sdk) | | AutoGen | An open-source framework for building AI agent systems. | [Link](https://github.com/microsoft/autogen) | | Smolagents | Library to build powerful agents in a few lines of code. | [Link](https://github.com/huggingface/smolagents) | | Pydantic AI | Python agent framework to build production grade applications with Generative AI. | [Link](https://ai.pydantic.dev/) | +| CAMEL | Open-source multi-agent framework with various toolkits and use-cases available. | [Link](https://github.com/camel-ai/camel) | +| BeeAI | Build production-ready multi-agent systems in Python. | [Link](https://github.com/i-am-bee/beeai-framework/tree/main/python) | | gradio-tools | A Python library for converting Gradio apps into tools that can be leveraged by an LLM-based agent to complete its task. | [Link](https://github.com/freddyaboulton/gradio-tools) | | Composio | Production Ready Toolset for AI Agents. | [Link](https://github.com/ComposioHQ/composio) | | Atomic Agents | Building AI agents, atomically. | [Link](https://github.com/BrainBlend-AI/atomic-agents) | @@ -213,6 +228,8 @@ This repository contains a curated list of 120+ LLM libraries category wise. | AgentEvals | Evaluators and utilities for evaluating the performance of your agents. | [Link](https://github.com/langchain-ai/agentevals) | | LLMBox | A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation. | [Link](https://github.com/RUCAIBox/LLMBox) | | Opik | An open-source end-to-end LLM Development Platform which also includes LLM evaluation. | [Link](https://github.com/comet-ml/opik) | +| PydanticAI Evals | A powerful evaluation framework designed to help you systematically evaluate the performance of LLM applications. | [Link](https://ai.pydantic.dev/evals/) | +| UQLM | A Python package for generation-time, zero-resource LLM hallucination using state-of-the-art uncertainty quantification techniques. | [Link](https://github.com/cvs-health/uqlm) | @@ -220,6 +237,7 @@ This repository contains a curated list of 120+ LLM libraries category wise. | Library | Description | Link | |----------------------|-------------------------------------------------------------------------------------------------|-------| +| MLflow | An open-source end-to-end MLOps/LLMOps Platform for tracking, evaluating, and monitoring LLM applications. | [Link](https://github.com/mlflow/mlflow) | | Opik | An open-source end-to-end LLM Development Platform which also includes LLM monitoring. | [Link](https://github.com/comet-ml/opik) | | LangSmith | Provides tools for logging, monitoring, and improving your LLM applications. | [Link](https://github.com/langchain-ai/langsmith-sdk) | | Weights & Biases (W&B) | W&B provides features for tracking LLM performance. | [Link](https://github.com/wandb) | @@ -265,6 +283,7 @@ This repository contains a curated list of 120+ LLM libraries category wise. | AuditNLG | AuditNLG is an open-source library that can help reduce the risks associated with using generative AI systems for language. | [Link](https://github.com/salesforce/AuditNLG) | | NeMo Guardrails | NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems. | [Link](https://github.com/NVIDIA/NeMo-Guardrails) | | Garak | LLM vulnerability scanner | [Link](https://github.com/NVIDIA/garak) | +| DeepTeam | The LLM Red Teaming Framework | [Link](https://github.com/confident-ai/deepteam)| ## LLM Embedding Models