Llm Async

Getting Started

  • Installation
    • Using Poetry (Recommended)
    • Using pip
  • Quickstart

Usage

  • Usage
    • Basic Chat Completion
      • OpenAI
      • OpenRouter
      • Google Gemini
    • Streaming
    • Tool Usage
    • Agent and Tool Decorator
      • Decorated Tools
      • Agent Options
    • Structured Outputs
    • OpenAI Responses API with Prompt Caching
      • Interactive REPL Example (HTTP/2 + Prompt Cache + Tool Calls)
    • xAI Responses Endpoint
    • Advanced Usage
      • Custom Base URL
      • HTTP/2
      • Direct API Requests

API Reference

  • Agent API Reference
    • Agent
      • Agent
        • Agent.acomplete()
    • Tool Decorator
      • tool()
  • Models API Reference
    • Message
      • Message.content
      • Message.original
      • Message.reasoning
      • Message.reasoning_details
      • Message.role
      • Message.stop_reason
      • Message.tool_calls
    • message_to_dict()
    • normalize_messages()
    • validate_messages()
    • Response
      • Response.main_response
      • Response.original
      • Response.provider_name
      • Response.stream
      • Response.stream_content()
      • Response.stream_generator
    • StreamChunk
      • StreamChunk.content
      • StreamChunk.original
    • ToolCall
      • ToolCall.from_responses_api_function_call()
      • ToolCall.function
      • ToolCall.function_call_output()
      • ToolCall.id
      • ToolCall.input
      • ToolCall.name
      • ToolCall.to_responses_api_message()
      • ToolCall.type
    • ResponseSchema
      • ResponseSchema.coerce()
      • ResponseSchema.for_google()
      • ResponseSchema.for_openai()
      • ResponseSchema.for_openai_responses()
      • ResponseSchema.for_openrouter()
      • ResponseSchema.mime_type
      • ResponseSchema.name
      • ResponseSchema.schema
      • ResponseSchema.strict
    • Event
      • Event.payload
      • Event.timestamp
      • Event.topic
    • Tool
      • Tool
        • Tool.description
        • Tool.input_schema
        • Tool.name
        • Tool.parameters
  • Providers API Reference
    • Base Provider
      • BaseProvider
        • BaseProvider.BASE_URL
        • BaseProvider.acomplete()
        • BaseProvider.execute_tool()
        • BaseProvider.name()
        • BaseProvider.request()
    • OpenAI Provider
      • OpenAIProvider
        • OpenAIProvider.BASE_URL
        • OpenAIProvider.execute_tool()
    • OpenAI Responses Provider
      • OpenAIResponsesProvider
        • OpenAIResponsesProvider.BASE_URL
        • OpenAIResponsesProvider.acomplete()
        • OpenAIResponsesProvider.execute_tool()
    • Claude Provider
      • ClaudeProvider
        • ClaudeProvider.BASE_URL
        • ClaudeProvider.execute_tool()
    • Google Provider
      • GoogleProvider
        • GoogleProvider.execute_tool()
    • OpenRouter Provider
      • OpenRouterProvider
        • OpenRouterProvider.BASE_URL

Project

  • Development
    • Setup
    • Running Tests
    • Linting and Formatting
    • Building
    • Building the Docs
    • Roadmap
  • Contributing
    • License
    • Authors
Llm Async
  • Usage
  • View page source

Usage

  • Basic Chat Completion
  • Streaming
  • Tool Usage
  • Agent and Tool Decorator
  • Structured Outputs
  • OpenAI Responses API with Prompt Caching
  • xAI Responses Endpoint
  • Advanced Usage
Previous Next

© Copyright 2026, Johanderson.

Built with Sphinx using a theme provided by Read the Docs.