Thanks for asking, NuclearPM. It was not actually a question. In informal English a question mark can follow a plain statement, where then it indicates a non-specific uncertainty. In the case above, the sentence could be interpreted generally as: “I didn’t say they were... and I'm not sure what gave impression I did" or "I didn't say they were... I think you misinterpreted."
I would argue against the siblings and say, yes, it's a question; it's a shortening and softening of the rhetorical "But then I didn't say they were, did I?"
Is that a question?