xjUdZddlZddlmZddlmZdZdZejZ eZ de d<d e d dfd Z d e d ee fd ZddZdS)u|Builder-declared stable prefixes for Anthropic prompt caching (#81867). Skill, webhook, and cron builders concatenate a large static scaffold (activation note + expanded skill body) with a small volatile invocation tail (ticket payload, timestamps, run context) into one user-message string. Only the builder knows the exact byte where the volatile tail begins, so it registers the stable prefix here at construction time; the cache planner consults the registry to place a cache breakpoint at that boundary instead of caching the whole message as one atomic block. This deliberately avoids re-parsing scaffold marker strings out of the message at request time: markers can legitimately appear inside skill bodies or inside event payloads (e.g. a helpdesk ticket quoting an agent transcript), and any delimiter-search heuristic then either shrinks the cached prefix or — worse — silently absorbs volatile bytes into it, reintroducing the per-invocation cache miss this exists to fix. The registry is process-local by design. A freshly fired webhook/cron invocation is always built and sent by the same process, which is the only window where the split pays off. Any miss (restart, eviction, historic message) falls back to the pre-existing whole-message policy. Split-shape lifetime: the split is applied only while the skill message is one of the plan's marked endpoints (the last few cacheable messages). Once later turns rotate it out of that window it ships as a single string block again, which changes the block boundary once and re-ingests the prefix from that message onward exactly one time in a long-lived session. Webhook/cron invocations — the workload this exists for — send the skill turn as the newest message every time, so they always hit the split shape; the one-time re-ingest only affects long interactive sessions and nets out far below the per-invocation full rewrite this removes. N) OrderedDict)Optional i@zOrderedDict[str, None] _prefixesprefixreturnc|sdSt5dt|<t|tttkr8tdtttk8ttdkrt ttttkrctdttdkr0t ttttkcddddS#1swxYwYdS)zARecord ``prefix`` as the stable scaffold of a just-built message.NF)last) _lockr move_to_endlen _MAX_ENTRIESpopitemsummap _MAX_CHARS)rs ?/home/agent/.hermes/hermes-agent/agent/prompt_cache_boundary.pyregister_stable_prefixr8sE  ** &f%%%)nn|++   5  ) ) ))nn|++)nnq  SS))<)<%=%= %J%J   5  ) ) ))nnq  SS))<)<%=%= %J%J ******************sD%D>>EEcontentcJt5d}tD][}t|t|kr9||r$| t|t|kr|}\|t||cdddS#1swxYwYdS)aLongest registered prefix that is a *proper* prefix of ``content``. Proper (``len(content) > len(prefix)``) so the split never produces an empty volatile text block, which Anthropic rejects on the wire. A hit refreshes the entry's LRU position: a scaffold fired every minute by cron must not be evicted by a burst of one-off skill invocations, which would silently drop it back to whole-message caching. N)r rr startswithr )rbestrs rfind_stable_prefixrEs   " " "F7||c&kk))g.@.@.H.H)<3v;;T#:#:!D    ! !$ ' ' '                  sBBBBcxt5tddddS#1swxYwYdS)zTest isolation helper.N)r rclearrclear_stable_prefixesr[s| s /33)rN)__doc__ threading collectionsrtypingrrrLockr r__annotations__strrrrrrrr'sB######    &1kmm #333 *3 *4 * * * * ,r