sj^edZddlmZddlmZmZddlmZmZm Z m Z m Z m Z ee e e efge e effZee gefZd#d Zd$d Zd%dZd&dZd'dZd&dZddd(dZeGddZGd d!Zd"S))aSession-scoped typed-browser routing for cua-driver. The public model surface remains the single ``computer_use`` tool. This module owns the stateful adapter between its namespaced ``cua_browser_*`` actions and cua-driver's raw ``get_browser_state`` / ``browser_*`` tools. The adapter is deliberately stricter than the transport: * native binding must be exact before mutation; * the driver session id is injected by the adapter, never accepted from the model; * refs are usable only from the latest snapshot in this Hermes session; * every mutation invalidates refs and requires a fresh state read; and * changing from trusted input to ``dom_event`` is always explicit. Browser preparation remains a separate approved action. Existing-profile attachment is delegated to cua-driver's daemon authorization coordinator; ordinary Hermes tool approval never substitutes for protected consent. ) annotations) dataclassfield)AnyCallableDictIterableOptionalSetvaluerreturn Optional[int]ct|trdS t|}n#ttf$rYdSwxYw|dkr|ndS)Nr) isinstanceboolint TypeError ValueError)r parseds D/home/agent/.hermes/hermes-agent/tools/computer_use/browser_route.py _positive_intrsd%tU z "ttaZZ66T)s )>>outDict[str, Any]cN|d}|d}i}t|tr||nt|tr|r||d<t|tr|||d}|d}t|t rg}t |D]\}}t|tr|sd} t|t r6|t|kr#t||tr||} ||| d|r||d<|d d ur| d d |S) zAReturn structured data without discarding refusals or MCP images.structuredContentdatamessageimagesimage_mime_types)r mime_type _mcp_imagesisErrorT) getrdictupdatestrlist enumeratelenappend setdefault) r structuredrpayloadr mime_typespreserved_imagesindeximager!s r _tool_payloadr3)s,--J 776??D G$"t D#  "4"! *d###z""" WWX  F+,,J&$6%f-- M MLE5eS))  I:t,, .C OO++z%0#66,'u-  # #U$K$K L L L L  6%5GM " wwyT!!9d+++ Nr.Dict[str, Set[str]]c id fd }||d||d|d}t|tr||dS) a6Normalize semantic-v2 action refs to ``ref -> actions``. cua-driver has emitted both mapping and list representations while the semantic snapshot contract evolved. Accept both without weakening the capability rule: a ref with no declared action remains readable only. cua-driver >= 0.17 splits the semantic_v2 payload: action-bearing refs live in the ``refs`` array while ``content_refs`` carries every node with empty action lists. Merge both sources (plus the legacy snapshot.refs forms) so click/pointer/type refs stay usable. rawrr Nonect|tr|}n$t|tr d|D}ndS|D]\}}t|tr-|dp|}|d}n|}d}t|t r|scd|pgD}|t |z|<dS)Nc3K|]}d|fV dSN).0items r z+_ref_map..absorb..\s&44d|444444r4refactionsc<h|]}t|t|Sr<)rr')r=actions r z+_ref_map..absorb..hs7! 638O8Or4)rr%itemsr(r$r'set)r7entrieskeyr r@rA action_set normalizeds rabsorbz_ref_map..absorbXs c4  ;>99;;GG T " " 44444GG F! F FJC%&& ii&&-#))I..c3'' s &-mJ )nnS#%%88:EJsOO F Fr4refs content_refssnapshot)r7rr r8)r$rr%)r.rKrNrJs @r_ref_maprOJs')JFFFFFF2 F7;;v   F7;;~ & &'''{{:&&H(D!!%x||F##$$$ r4 Optional[str]c|d}t|tr|r|S|d}t|tr.|d}t|tr|r|SdS)N continuationrNr$rr'r%)r.directrNnesteds r _continuationrVys [[ ( (F&#6 {{:&&H(D!!n-- fc " " v M 4r4Set[str]c.t}|dpgD]n}t|ts|dp|d}t|tr|r||o|S)Ntabstab_idid)rFr$rr%r'add)r.resulttabrZs r_tab_idsr_suuF{{6""(b#t$$  ""3cggdmm fc " " v  JJv    Mr4c|d}t|tr|S|d}t|tr0t|dtr|dSdS)NcoderefusalrS)r.rarbs r _refusal_codercsy ;;v  D$ kk)$$G'4  Z F0C0CS%I%Iv 4r4Fnative_fallbackrar'rrerextrac Ldd||d}|rd|d<|||S)NFrefused)okstatusrarTnative_fallback_required)r&)rarrerfr.s r_refusalrlsH G 3.2*+ NN5 Nr4ceZdZUdZdZded<dZded<dZded<ee Z d ed <dZ ded <dZ ded <d Z ded<eeZded<dZded<d Zded<ddZddZdS)BrowserRouteStatez8Capabilities minted for one explicit cua-driver session.Nrpid window_idrP target_id)default_factoryrWtab_idsrZbinding_qualityFrmutation_allowedr5rLrRverification_requiredr r8cF|jd|_dSr;)rLclearrRselfs r clear_refszBrowserRouteState.clear_refss"  r4cd|_d|_d|_|jd|_d|_d|_|d|_ dS)NF) rorprqrsrxrZrtrur{rvrys rrxzBrowserRouteState.clears`  # % %*"""r4)r r8)__name__ __module__ __qualname____doc__ro__annotations__rprqrrFrsrZrtrur%rLrRrvr{rxr<r4rrnrns BBC#I#####I####c222G2222 F    %)O))))""""" %d ; ; ;D;;;;"&L&&&&"'''''!!!! + + + + + +r4rnc eZdZdZd4d Zd5dZd6dZdddddddddd7d Zddddd!d"d8d(Zdd)d9d-Z d:d1Z ddd2d;d3Z dS)<CuaTypedBrowserRoutez=Exact-bind typed-browser adapter for a single driver session. session_idr' call_tool ToolCallerhas_tool ToolProber r8cV||_||_||_t|_dSr;) _session_id _call_tool _has_toolrnstate)rzrrrs r__init__zCuaTypedBrowserRoute.__init__s+&#!&(( r4nameargsrczt|}|j|d<t|||S)Nsession)r%rr3r)rzrrr.s r_callzCuaTypedBrowserRoute._calls8t**"- T__T7;;<<>$   4 ' j4 j j j     r4N semantic_v2F)rorprZsnapshot_formatquery scope_refrRinclude_screenshotrorrprZrPrrrrRrrcB|d} | | S|dup|du} | rt|} t|} |j| | t dddS| | d} |rd| d<|d| }|d d kr7t|}|d d d|d <|d krd|d<|S|d}|d}|ddu}t|tr|st dddS| |j_ | |j_ ||j_ t||j_t|tr|nd|j_||j_d|j_d|d<d|d<d|d<|r|dsd|d<|dk|d<|dks|sd|d<|S|jj }|r|jjdkrt dddS|p |jj}t|tr|st d d!S||jjvrt d"d#S| ||jjkrt d$d%S|||jjvrt d&d'S|||d(}|r||d)<|r||d*<|r||d+<|rd|d<|du}|s|j|d|}|d d,vs|d-dur=|jd|j_|d d |St/|}|r |jj|n ||j_t3||j_||j_d |j_d|d.<t5|jj|d/<|S)0z4Bind an exact native window or snapshot a bound tab.get_browser_stateNbrowser_exact_target_requiredzHTyped browser binding requires an exact positive pid and window_id pair.Trd)rorprrjriFnative_fallback_availablebrowser_requires_setupsetup_requiredrqrtrubrowser_binding_unprovenzFBrowser bind returned no opaque target capability; use native control.snapshot_requiredfresh_browser_state next_stepzBinding only, no page content. Call cua_browser_state again WITHOUT pid or window_id (optionally with tab_id, query, snapshot_format, include_screenshot) to take the snapshot this binding requires before any mutation.hintr"screenshot_deferredexact exact_bindingrkbrowser_exact_binding_requiredzABind the exact native pid/window_id before reading a browser tab.browser_tab_requiredz3Choose an opaque tab_id returned by the exact bind.browser_tab_unboundAThe requested tab_id was not minted by this session's exact bind.browser_continuation_stalezLThe continuation is not current for this session/tab; take a fresh snapshot.browser_ref_stalez@scope_ref must come from this session's latest browser snapshot.)rqrZrrrrRNrir# fresh_state refs_current)rrrrxrlrr$rcr,rr'rorprqr_rsrtrurvrZrRrLr{rOr&rVr*)rzrorprZrrrrRrmissingbinding_request exact_pid exact_window bind_argsr.rarqqualityru selected_tabr continuing discovereds robservezCuaTypedBrowserRoute.observes $$%899  NT/BYd-B C %c**I(33L J      L$83^$( !)))I" 726 ./jj!4i@@G{{8$$,,$W--""4///7;3433304G,- K00Ikk"344G&{{+=>>$F i-- Y .\$( 'DJN#/DJ #,DJ !)'!2!2DJ 4>w4L4L)VRVDJ &*:DJ '04DJ ,,0G' (#8GK = FO " 6'++m*D*D 626-.'.''9GO $'!!)9!6:23NJ(  DJ6'AA0S $  2!2 ,,, L &E  tz1 1 1%S   #  8O(O(O,^   Ydjo%E%E#R  #".    "!DM  * )D   0#/D  .)-D% &!-  $ J ! ! # # #**0$77 ;;x 4 4 I8N8NRV8V8V J ! ! # # #/3DJ ,   tU + + +Ng&&  ) JO " ": . . . .(DJO"/"8"8 ( +0 (!% "%djo"6"6r4standard)rp profile_name allow_launchgrant_existing_profilepermission_mode profile_moderrrrc|d}||St|} | tddS|dkrpt|} | tddS|dkr|std d S|j| | d did } |d| S|d vrtddS|stddSd|i} |dkr,t |tr|stddS|| d<| d| d} t|} | | | d<|j|d| S)z@Run explicit setup through the driver's authoritative mode gate.browser_prepareNbrowser_pid_requiredz(browser_prepare requires a positive pid.existing_profilerzNExisting-profile attachment requires an exact positive pid and window_id pair.bounded$browser_existing_profile_not_granteda Attaching to an existing browser profile requires the one-time opt-in `computer_use.grant_existing_profile: true` in config.yaml. Hermes cannot grant this at runtime, and an approval bypass does not substitute for it. Use profile_mode=isolated_new to browse without it.kind)rorpstrategy> isolated_newisolated_namedbrowser_profile_mode_invalidz6Use isolated_new, isolated_named, or existing_profile.browser_launch_not_approvedz@Driver-owned isolated setup requires explicit allow_launch=true.moderbrowser_profile_name_requiredz1isolated_named requires a non-empty profile name.rT)rorprofilerp)rrrlrrxrrr') rzrorprrrrrrrrrrs rpreparezCuaTypedBrowserRoute.prepares$$%677  N!#&&  &(R  - - -(33L#3d)++4J+:N J      )#%78$$D ::/66 6 A A A.H  -R $*<"8 + + +lC00   3G+GFO    %Y//  # ,D  zz+T222r4)allow_without_snapshottoolr.tuple[Optional[str], Optional[Dict[str, Any]]]c||}|d|fS|jjr|jjdks |jjsdt dddfS|p |jj}t|tr|sdt ddfS||jj vrdt dd fS|jj r|sdt d d fS|dfS) Nrbrowser_mutation_unprovenzzTyped browser mutation requires status=ok, binding_quality=exact, and mutation_allowed=true; use native control otherwise.TrdrzChoose a bound tab_id first.rrbrowser_verification_requiredzTake a fresh cua_browser_state snapshot before another browser mutation: call cua_browser_state WITHOUT pid or window_id. Re-sending pid/window_id re-binds instead of snapshotting, which mints new tab_ids and leaves this mutation refused.) rrrqrtrurlrZrr'rsrv)rzrrZrrrs r_require_mutationz&CuaTypedBrowserRoute._require_mutations<$$T**  =  $ z)W44:.5+M $  2!2 ,,, L &(F  tz1 1 1%S  : + 4J /$ T!!r4r@rArWct|tr||jjvrt ddS|jj|}|r%||st ddSdS)Nrz=Use a current ref from the latest cua_browser_state snapshot.browser_action_unavailablez>The current ref does not declare the requested browser action.)rr'rrLrl intersection)rzr@rAdeclareds r _require_refz!CuaTypedBrowserRoute._require_refs #s## s$*/'A'A#O :?3'  80099 ,P tr4)rZrc*t|pi}|dko|ddk}||||\}}||S| |jjJ|d}|dv} |d} | | st d |d S| pd } | d vrt d dS| dkr|st ddSt } |dkr|rddh} nK|dkrhd} n@|dkr%|r#|d} | dkrddhndh} n|dkrhd} n |dkrddh} | r||| }||S|d}|||hd}||S|jj|d <||d!<|s1||j_|j d"|j_ | ||}t|}|d#d"up|d$d%vp|du}| r| |d&<| dkrd"|d'<|rBd"|d(<|r)|d)vr%|j d"|j_ |d*kr d"|d+<d"|d(<|S|rd"|d,<|Sd"|d-<d.|d/<|S)0z;Invoke one typed browser tool against current capabilities.browser_dialogrCinspect)rrZrNr@> browser_clickbrowser_pointer input_routebrowser_input_route_unsupportedz= does not expose a trust-route choice in the live 0.9 schema.trusted>r dom_eventbrowser_input_route_invalidz8Use input_route=trusted or explicitly request dom_event.rbrowser_dom_event_ref_requiredz:The dom_event trust class requires a current semantic ref.rclickpointer browser_type>edittypeinputrscrollbrowser_set_input_files>filesuploadset_input_filesbrowser_downloaddownload)rAdestination_ref>dragdroprrqrZTr#rjr input_trusttrust_downgrade_explicitr>rbrowser_binding_ambiguousbrowser_input_trust_unavailable%trust_change_requires_explicit_choicefresh_dialog_statervrr) r%r$rrrqrlrFrrZr{rvrrc)rzrrZr call_argsdialog_inspectrrbr@supports_trust_choicerequested_routerouterequired_actionspointer_action invalid_refrinvalid_destinationr.rarhs rmutatezCuaTypedBrowserRoute.mutates$$ $ $ Mx)@)@I)M !% 6 6#1!7! !  g  N'DJ,@,L,LLmmE"" $(L L#-- 66  &/D &1VVV  ,9 0 0 0-J  K   0L  &)UU ? " "s " '3   ^ # #888   & & &3 &&]]844N)78)C)C9%%)  . . .EEE   ' ' ' *G4   #++C9I+JJK&""#--(9::  &"&"3"3)D)D)D#4## #.**!%!5 +* ( 4!-DJ  J ! ! # # #/3DJ ,**T9--W%% KK " "d * {{8$$L8 4  ! ;%*GM " ##6:23  37G/ 0 8$+## %%'''37 0888CG?@7;34N  ,0G( )N ,0'(4 r4)rr'rrrrr r8)rr'rrr r)rr'r r)rorrprrZrPrr'rrPrrPrRrPrrr r)rorrprrr'rrPrrrrrr'r r)rr'rZrPrrr r)r@rrArWr r)rr'rZrPrrr r) r}r~rrrrrrrrrr r<r4rrrs1GG ) ) ) )====     $,##'&*#(XXXXXX|&*"',)R3R3R3R3R3R3r(- '"'"'"'"'"'"R.!%)- oooooooor4rN)r rr r)rrr r)r.rr r5)r.rr rP)r.rr rW) rar'rr'rerrfrr r)r __future__r dataclassesrrtypingrrrr r r r'rrrrr3rOrVr_rcrlrnrr<r4rrs(#"""""((((((((????????????????sDcN+T#s(^; < cUD[ ! ****B,,,,^    " & +++++++ +