Cutting Through the AI Testing Hype: A Reality Check for AI-Generated Unit Tests
AI can write unit tests in seconds. It’s fast, it’s cheap, the job is done, it sounds perfect. Whether that test is actually testing anything, or just performing the idea of testing, is a different matter.
René Schwietzke, Managing Director and co-founder of Xceptance, will look at the vague promises and check if they hold up when he takes the stage at JUG Saxony Day 2026 in Radebeul.
"AI-Generated Unit Tests: Cutting Through the Hype – Is It Actually Helping, or Just Making Us Faster at Being Wrong?"
Putting AI-Generated Unit Tests to the Test
René will put AI-Generated Unit Tests to the Test – live on the stage of Saxony's biggest IT community conference. Real code, tested two ways:
A simple linear map rather than the usual implementation – testing AI's understanding off the beaten path.
A step up from a basic LinkedHashMap, testing more sophisticated eviction and state handling.
Both will have two versions, one rough and uncommented, the other one clean and properly documented, to see if AI actually understands the code better when it's well explained, or just takes its best guess either way. In addition, AI is asked to write both from scratch.
The results from a handful of popular AI tools will be compared against solid, well-written, handcrafted unit tests. All backed up with some nice statistics.
Join René's Talk & Meet Us in Radebeul
Join René's talk at the 13th JUG Saxony Day on Friday 25th of September from 11:50 to 12:50 in the "Dresden" room.