StopReason!=Stop not made obious
H
Herbert Dürr
When the answer being created exceeds the limit of output tokens then it is not made clear, that something is missing. The FinishReason in this case is most probably "length". A user who relies on this answer isn't made aware, that some important aspects may be missing. Make this clear and suggest a followup prompt of e.g. "continue" to get the complete answer.
H
Herbert Dürr
A simple example is to translate a 20K token text. The result then is typically incomplete.