Point-and-talk feedback for coding agents
Point at anything on your screen while you talk, and your agent gets both: what you said, and exactly what you were pointing at.
Posted by Antipaywall
The problem
Telling an agent what is wrong with a screen is slow. You end up describing where something is ("the second card, under the heading, the button on the right") when you could just point at it. Dictation helps with the talking, but the agent still cannot see what you mean.
What to build
A tool that lets you point at anything on your screen while you talk, and hands the agent both: what you said, and exactly what you were pointing at when you said it. That means the element, its place in the code if it can be found, and a screenshot.
A strong entry
Works with the agent people already use, without leaving it. Handles a long, rambling review, not one comment at a time. Turns "this, and this, and also that" into separate, precise notes the agent can act on. If it builds on one of the projects listed below, it says what it adds.
Already out there
Found by a GitHub search when this idea was posted. We have not reviewed them. Builders may fork one of these or start fresh.
Going to build it?
Ideas show what people want. They carry no money and no prize of their own: an entry that builds one competes for the main prizes like any other.
Join as a builder