AI visibility · Answer

Does ChatGPT give the same answer every time you ask?

Often the answer holds and the sources move. Asked the same factual question three times in one minute, ChatGPT gave the correct answer every time and cited seven different domains, only one of which appeared in all three. Asked an open-ended question about the same subject, one of three calls contradicted the other two on the underlying fact. A single call measures one call.

The evidence

The fact was stable. The sourcing was not.

Three identical calls for a product release date returned the correct date three times. Across those same three answers, six of the seven cited domains appeared in some calls and not others. A brand auditing its citation share from one call would have been reading noise.

Change the question shape and the fact moves too.

The same model, asked an open-ended question about the same subject in the same half hour, stated in one of three calls that the product had already released — in the wrong year, in the past tense. The other two calls were correct. Nothing changed but the wording of the question.

A second engine did not do this.

Perplexity, asked both question shapes three times each, returned the correct fact on all six calls and the same ten cited domains in the same order on all three of one shape. This is the fourth separate measurement in which that split has appeared.

Three calls is the floor, not the ideal.

Every finding here exists because the question was asked three times rather than once. Three is enough to separate instability from disagreement. It is not enough to quote a stability rate as a property of a platform, and we do not.

What would have to be true for this to be wrong

If your category's answers are generated without retrieval, there is no citation set to be unstable and this does not apply to you. Check by watching input token counts: an answer built from retrieved pages runs into the thousands of input tokens, one answered from the model's own parameters runs in the hundreds. If most of your questions come back in the hundreds, you have a different problem — there is no surface to compete for.

Three calls per platform per question shape, October 24, 2026, US-scoped, web search enabled. ChatGPT gpt-4.1-mini-2025-04-14, Perplexity sonar, via DataForSEO. Model output quoted verbatim in the study. Platform-default budget tier, not the tier a consumer is served.
Every row behind this answer is published in the standing study at cultmath.com/research/games/gta, which is re-run on a schedule and corrected in place, dated.
Published 2026-10-24 by Ipalibo Da-Wariboko, CULT+MATH LLC. Where a number could not be sourced, this page says so and gives none.

This is one of six decisions covered in the ai visibility decision brief — each with the evidence behind it, who owns it, who it is contested with, and what would have to be true for the answer to flip.

See the brief →