Development

Setup

git clone https://github.com/sonic182/llm-async.git
cd llm-async
poetry install

Running Tests

poetry run pytest -p no:sugar

Running a single test:

poetry run pytest -k "test_name"

Linting and Formatting

poetry run ruff check llm_async tests
poetry run ruff format llm_async tests

Building

poetry build

Building the Docs

poetry run sphinx-build -b html docs/source docs/build/html

Roadmap

• Support for additional providers (e.g., Grok, Anthropic direct API)

• More advanced tool features

• Response caching and retry mechanisms