What A Time To Be Alive
Choose language: English

Glossary

Self-improving AI

Self-improving AI is AI that helps make itself or the software around it better, for example by designing experiments and improving code. The idea is that progress could speed up as a result.

Self-improving AI is AI that takes part in improving AI. It can start small: a model devises an experiment to improve another model, or it writes code that makes a system faster. The idea behind it is a feedback loop. If AI gets better at making AI, the next generation can improve faster still. This is also known as recursive self-improvement.

How does it work?

AI research consists of a number of recurring steps: working out what you are trying, carrying it out, reading the outcome and learning from it. Each step can be handed partly to AI. A model can come up with hypotheses, set up experiments, write and test code, and use the results for the next round. The young company PhAI Labs built such a team of AI agents, which comes up with research ideas, tests them and keeps track of what worked. The system learns from that record: after two rounds its hypotheses were better (link).

This concerns pieces of the process, not yet the whole. Humans still decide a lot: which question is worth asking, and what happens with the outcome.

Why it matters

Self-improvement is one of the ideas behind the road to the singularity: AI that improves itself could speed up progress. That is why it is important to measure how far AI has got with this.

On the TasteVal test from P-Zero Research, Claude Opus 5.5 designed better AI experiments than the best of 24 experienced AI researchers, using less than half the computing time (link). The test measures only part of the research: the question itself is already fixed. There are also examples from practice. The Chinese company Unitree is working on Rehearsal: AI reads research itself, writes robot code, tests it in a simulated world and then puts it on real robots (link). Steps like these show where development stands now and what the next steps are.

Articles about Self-improving AI