sjM>dZddlmZddlZdZdZdZdZdd ZddZ dS)uCheap content-sanity checks for the truncated-response continuation path. Issue #86581: a model in a degenerate repetition loop can spend its ENTIRE output budget echoing one fragment. The ``finish_reason=length`` continuation path in ``conversation_loop.py`` would then retry with a "continue, don't repeat" nudge — stitching a pathological fragment into the final response with no content-sanity check. In the incident behind #86581 a single turn produced a 60,698-char response delivered as 31 Discord messages. These helpers detect repetition-dominated fragments BEFORE the continuation nudge is appended so the turn can abort with a clear user-facing error (mirroring the existing ``_thinking_exhausted`` guard) instead of flooding. The detection is deliberately conservative: only LONG verbatim repeats (60+ chars) whose occurrences cover a majority of the fragment trip the guard, so ordinary truncated responses (a sentence cut mid-word, a heading repeated, code with similar-looking lines) are never blocked. ) annotationsNi<g?textstrreturnboolct|tsdSt|}|tkrdSt ||rdSt }t ttj |tz|z }i}t||z dzD]6}||||z}| |ddz}||krdS|||<7dS)uSTrue when ``text`` is dominated by verbatim repeated fragments. A truncated response is "repetition-dominated" when a single 60+ char substring appears often enough that its occurrences cover at least half of the fragment. That shape is the signature of a model repetition loop (issue #86581), and continuing such a fragment is pointless — the continuation nudge would just stitch more repeated text into the final response. Returns False for non-string / empty / short inputs (fail-open: never blocks a continuation the guard cannot confidently judge). FTr) isinstancerlenMIN_FRAGMENT_LENGTH_line_repetition_dominated_REPEAT_WINDOWmax_MIN_REPEAT_COUNTmathceil_DOMINANCE_RATIOrangeget)rnwindowneededcountsikeycs :/home/agent/.hermes/hermes-agent/agent/repetition_guard.pyis_repetition_dominatedr +s dC u D A u "$**tF"DIa2B.BV.K$L$L M MFF 1v:> " "1q6z>" JJsA   " ;;44s 5rintc*i}|D]5}|}|s||ddz||<6|D]1\}}|tkr!|t |z|t zkrdS2dS)zHTrue when a single normalized line covers half the fragment via repeats.rr TF) splitlinesstripritemsrr r)rrrlinenormrs rrrTsF!!//zz||  zz$**Q.t <<>>a ! ! !a#d))mq;K7K&K&K44 5r!)rrrr )rrrr"rr ) __doc__ __future__rrrrrrr rr!rr,s~(#""""" &&&&R      r!