Welcome to the documentation of AgentLego!¶
AgentLego is an open-source library of versatile tool APIs to extend and enhance large language model (LLM) based agents, with the following highlight features:
Rich set of tools for multimodal extensions of LLM agents including visual perception, image generation and editing, speech processing and visual-language reasoning, etc.
Flexible tool interface that allows users to easily extend custom tools with arbitrary types of arguments and outputs.
Easy integration with LLM-based agent frameworks like LangChain, Transformers Agents and Lagent.
Support tool serving and remote accessing, which is especially useful for tools with heavy ML models (e.g. ViT) or special environment requirements (e.g. GPU and CUDA).
Getting Started
Modules
Tool APIs
- AudioImageToImage
- AudioTextToImage
- AudioToImage
- Calculator
- CannyTextToImage
- DepthTextToImage
- GoogleSearch
- HumanBodyPose
- HumanFaceLandmark
- ImageDescription
- ImageExpansion
- ImageStylization
- ImageToCanny
- ImageToDepth
- ImageToScribble
- OCR
- ObjectDetection
- ObjectRemove
- ObjectReplace
- PoseToImage
- ScribbleTextToImage
- SegmentAnything
- SegmentObject
- SemanticSegmentation
- SpeechToText
- TextToBbox
- TextToImage
- TextToSpeech
- ThermalToImage
- Translation
- VQA