Today we release CodeSpeak 0.3.2. Please find the full release notes at the end of this post.

The key feature in this release is automated test coverage improvement. TL;DR: you can run codespeak coverage and CodeSpeak will run your tests, measure coverage, and add tests to bring it as high as possible.

Why test coverage matters

It wouldn't be much of an exaggeration to say that AI code generation is as good as the test suite that verifies the changes. The power of coding agents is more than just generating correct code from scratch (sometimes), the much more impressive thing they do is finding and correcting their own mistakes. And the better the test suite, the more bugs it can catch, and therefore the better the results that AI code generators can deliver.

While CodeSpeak is not a chat-based tool, it of course uses the best agentic code generating technology under the hood, and therefore benefits from good tests as much as any other agentic coding tool.

How to use codespeak coverage

See the full tutorial: Improve Test Coverage.

The tutorial uses our clone of microsoft/MarkItDown to demonstrate how codespeak coverage takes a project from 84% to 100% coverage in 2 iterations, adding 4 tests automatically.

The Road Ahead

This early version of codespeak coverage is the first step on our journey of perfecting test suites with CodeSpeak. Generating reliable code is crucial for our mission, and we'll keep improving the toolchain to add more capabilities in this area.

A few things we are planning to do in the future:

• support more languages (the current version only supports Python),
• branch coverage and other more sophisticated metrics,
• mutation testing,
• better CI/in-cloud support for test improvements.