When to use it
Reach for the Topic Critique Agent when the AI-assigned topics don’t match your expectations. Typical questions it handles:- “Why isn’t topic X assigned to these rows?”
- “How can I improve the AI score on this column?”
- “Why do so many rows have no topic?”
- “The topics overlap — can you fix them?”
- “Help me improve the topic descriptions.”
The Topic Critique Agent is only available to users with edit permission on the project. Report-only viewers can’t invoke it, because it can modify the topic collection.
How to invoke it
There’s no separate tab — you use it through Insight Agent. Open Insight Agent from the project overview, the Insight Agent tab, or a report, and ask a topic-assignment question. Insight Agent hands the conversation off to the Topic Critique Agent automatically when the question is about assignment quality or the topic collection. If your project has more than one TTA column, mention which column you want reviewed in your prompt — for example, “Critique the topic assignment on the ‘Overall Feedback’ column.”
What the agent does
The Topic Critique Agent works in phases and always explains its reasoning before proposing a change:- Analyzes the topic collection — detects overlapping or ambiguous descriptions, labels or categories that contradict the description, and descriptions that are too narrow or too broad.
- Checks manual reviews — looks at how consistently reviewed rows have been labeled and how much review coverage exists.
- Grounds findings in real rows — pulls concrete example rows and topic statistics so its diagnosis is tied to your actual data.
- Proposes changes — presents a prioritized list of recommendations (usually description refinements first, then structural changes like merges or splits, then manual-review suggestions).
- Optionally tests before applying — for description or label changes, it can run the proposed edits on a small subset of rows so you can see the effect before committing.
- Edits the topic collection — only after you confirm. All edits from a single conversation are grouped into one entry in the version history, so they can be reverted together.
Understanding the AI score
A common reason to call the Topic Critique Agent is to raise a column’s AI score. The score reflects how confident the AI is in its own topic assignments across the whole column — it isn’t a comparison against manually reviewed rows. That means:- Reviewing more rows on its own does not raise the AI score. Manual reviews are useful for sanity-checking assignments and spotting ambiguous topics, but they don’t change what the model predicts on unreviewed rows.
- Improving topic descriptions almost always does. A low score usually indicates overlapping, ambiguous, or poorly worded descriptions — exactly what the Topic Critique Agent is built to find and fix.
Reviewing changes the agent made
Every edit the Topic Critique Agent applies is recorded in the topic assignment version history, alongside your manual edits and AI reassignments. Agent edits are marked with a distinct sparkles badge on each affected topic, so you can quickly tell which changes came from the agent. To review or revert them:- Open the column’s Topic Assignment page.
- Click History in the top-right corner.
- Pick the timestamp just before the agent’s changes.
- Topics that were edited by the agent are highlighted with the sparkles badge; topics changed by manual or other AI edits use the standard “changed” badge.
- Use Restore to roll the topic collection back to that point if you want to undo the agent’s changes.
Tips for better critiques
- Be specific about the column and the problem. “Why is ‘Delivery Speed’ rarely assigned even though customers mention it a lot?” is much easier for the agent to act on than “the topics look wrong.”
- Let it plan before it edits. The agent is designed to explain its diagnosis first — read the reasoning before confirming an edit.
- Use subset tests for risky changes. For big description rewrites or category restructures, ask the agent to validate on a subset before applying.
- Follow up with a full run. After confirming edits, kick off a full AI reassignment so every row benefits from the new topic collection.