sj>JdZddlmZddlmZmZddlmZmZedGddZ dAd Z d d d d d d d d d dd d d d dBdZ d d d d dCd!Z d"d"d"d d#dDd)Z d"d"d*dEd-ZdFd/ZdGd1Zd2ZdGd3ZdGd4Zd d5dHd7ZdId8ZdJd9ZdKd:ZdGd;ZdLd<Zd d=dMd>ZdNdOd@Zd S)PuProvider/model inventory context — shared substrate for the dashboard ``/api/model/options``, the TUI ``model.options``/``model.save_key`` JSON-RPC handlers, and the interactive picker. Before this module the three call-sites each duplicated: 1. The 17-LOC config-slice that pulls ``model.{default,name,provider,base_url}``, ``providers:``, and ``custom_providers:`` out of ``load_config()``; 2. The call into ``list_authenticated_providers`` with the resulting kwargs; 3. (TUI only) a 45-LOC post-pass that merges authenticated rows with unconfigured ``CANONICAL_PROVIDERS`` rows and emits ``authenticated``/ ``auth_type``/``key_env``/``warning`` hints for the picker UI. Consolidating those three steps into one entry point eliminates two bugs the duplicates were hiding: - The dashboard read ``cfg.get("custom_providers")`` directly, missing the v12+ keyed ``providers:`` form (which the TUI handled via ``get_compatible_custom_providers``). - The TUI's canonical-merge keyed on ``is_user_defined`` to decide ordering. Section 3 of ``list_authenticated_providers`` sets ``is_user_defined=True`` even for canonical slugs that appear in the ``providers:`` config dict, which silently demoted them to the tail of the picker. ``_reorder_canonical`` keys on slug membership instead. Substrate facts (verified May 2026): - ``list_authenticated_providers`` already populates each row's ``models`` from the curated catalog (same source as the picker). Do NOT call ``provider_model_ids()`` per row to "freshen" — that bypasses curation and pulls in non-agentic models (Nous /models returns ~400 IDs including TTS, embeddings, rerankers, image/video generators). ) annotations) dataclassreplace)AnyOptionalT)frozencfeZdZUdZded<ded<ded<ded<ded <d Zded <d d d d ddZd S) ConfigContextzSnapshot of the model + provider config every inventory caller needs. Built once via ``load_picker_context()``; the TUI overlays live agent state via ``with_overrides()`` before passing through. strcurrent_provider current_modelcurrent_base_urldictuser_providerslistcustom_providersNexcluded_providersr r r Optional[str]return'ConfigContext'cRi}|r||d<|r||d<|r||d<|r t|fi|n|S)uReturn a copy with truthy overrides applied. Truthy-only because the TUI reads agent attributes that may be empty strings before an agent is spawned — empties must NOT clobber the disk-config values. r r r)r)selfr r rkws 8/home/agent/.hermes/hermes-agent/hermes_cli/inventory.pywith_overrideszConfigContext.with_overrides9sa  6%5B! "  0"/B   6%5B! "&(2wt""r"""d2)r rr rrrrr)__name__ __module__ __qualname____doc____annotations__rrrrr r +s ##### +/'+*. 33333333rr rc |ddlm}m}|}|di}t |t r]|d|ddpd}|ddpd}|ddpd}n|rt |nd}d}d}|d }|d id pg}t|||t |t r|ni||t |tr|ng S) uLoad the disk-config snapshot every consumer needs. Replaces the inline 17-LOC config-slice that ``web_server.py`` and ``tui_gateway/server.py`` (×2 sites) used to do. r)get_compatible_custom_providers load_configmodeldefaultnameproviderbase_url providers model_catalogr)r r rrrr) hermes_cli.configr%r&get isinstancerr r r) r%r&cfg model_cfgr r rrawexcludeds rload_picker_contextr6Ps\ ONNNNNNN +--C$$I)T""! ivr1J1JKKQr $==R88>B$==R88>B+4;I  ''+  Cww++//0DEEKH )#)(d33;ss88=='1(D'A'AI88r    rFN) explicit_onlyinclude_unconfigured picker_hintscanonical_orderpricing capabilitiesfeaturedforce_fresh_nous_tierrefreshprobe_custom_providersprobe_current_custom_provider for_picker max_modelsctxr7boolr8r9r:r;r<r=r>r?r@rArBrC int | Nonerc ddlm}||j|j|j|j|j|| | | | | |jpg }t|j}||gd|Dz}|r2t||}t|t||dz} ddl m }n#t$rd}YnwxYw|t|D]K}|d r4d |d pgDLr|D]}|d r|d d }||s:|d pg}fd|D}t%|t%|kr||d <t%||d<|r*t|dt||Dz}|rt'||rt)|}|rt+|||rt-||rt/|t1|||j|jdS)u Build the ``{providers, model, provider}`` shape every consumer needs from a single substrate call. Flags: - ``explicit_only``: keep only providers the user explicitly configured (current provider, providers from config, or providers backed by provider-specific env vars). This hides ambient / auto-seeded credentials from desktop chat pickers. - ``include_unconfigured``: append ``CANONICAL_PROVIDERS`` rows that ``list_authenticated_providers`` didn't emit (TUI uses this to show the full provider universe in the picker). - ``picker_hints``: add ``authenticated``/``auth_type``/``key_env``/ ``warning`` per row (TUI ``ModelPickerDialog`` shape). - ``canonical_order``: reorder canonical-slug rows to ``CANONICAL_PROVIDERS`` declaration order; truly-custom rows go last (TUI display order). - ``pricing``: enrich each row with formatted per-model pricing and, for Nous, ``free_tier``/``unavailable_models`` so the GUI picker can show $/Mtok columns and gate paid models on free accounts — mirroring the ``hermes model`` CLI picker. Adds network calls (pricing fetch + Nous tier check); only set for interactive pickers. - ``capabilities``: add a per-row ``capabilities`` map ``{model: {fast, reasoning}}`` so pickers can gate the model-options controls (fast toggle / reasoning) to what each model actually supports, instead of offering knobs the backend would reject. - ``featured``: add a per-row ``featured_models`` list — the newest few models per lab (by models.dev release_date, ranked within the row's own models; see ``_FEATURED_PER_LAB``) for aggregator providers that serve dozens of models across many labs. Pickers default their visible set to these; the rest of ``models`` stays reachable via search / show-all. Empty for single-lab providers (callers fall back to top-N). Derived live from models.dev — no allowlist. - ``force_fresh_nous_tier``: bypass the short Nous free-tier cache when selecting Portal-recommended Nous models and applying tier gating. Keep this false for UI picker opens; explicit auth/model flows can opt in when they need freshly-purchased credits to show up immediately. - ``refresh``: bust the per-provider model-id disk cache so every row re-fetches its live catalog. Set only for an explicit user-triggered "refresh models" action; normal picker opens leave it false to stay snappy on the 1h cache. - ``probe_custom_providers``: allow saved custom/provider endpoints to run live ``/models`` discovery while building the payload. GUI picker opens should leave this false unless the user explicitly refreshes; the row can still render its configured model immediately, and slow/offline local endpoints no longer block the dialog. - ``probe_current_custom_provider``: when ``probe_custom_providers`` is false, still live-probe the current custom endpoint. This keeps normal GUI/TUI picker opens fast while making the active custom provider's model list match the classic CLI picker. - ``for_picker``: interactive-picker visibility. Keeps providers whose credential pool exists but is entirely rate-limited (exhausted) in the list. Rate limits are per-model, so a different model under the same provider may still work; hiding the provider strands the user. Set for any surface a human is choosing from, not for programmatic resolution. r)list_authenticated_providers) r rr rrr>rCr?r@rArBrNcg|]=}t|dddk;|>Sslugr*moar r0lower.0rs r z(build_models_payload..sEWWW!s1553D3D/E/E/K/K/M/MQV/V/VA/V/V/VrT current_only)is_routing_aggregatoris_user_definedc3>K|]}|VdSNrN)rPms r z'build_models_payload..s*"P"P17799"P"P"P"P"P"PrmodelsrKr*c@g|]}|v|Sr#rY)rPrZ user_modelss rrRz(build_models_payload..s+PPP!17799K3O3OA3O3O3Or total_modelscg|]=}t|dddk;|>SrJrMrOs rrRz(build_models_payload..sKxxx1PSTUTYTYZ`bdTeTePfPfPlPlPnPnrwPwPwQPwPwPwrr>)r-r'r+)hermes_cli.model_switchrHr rr rrr_moa_provider_row_filter_explicit_provider_rowsr_append_unconfigured_rowshermes_cli.providersrU Exceptionsetr0updatelen_apply_picker_hints_reorder_canonical_apply_pricing_apply_capabilities_apply_featured_apply_custom_aliases)rDr7r8r9r:r;r<r=r>r?r@rArBrCrHrowsmoa_row_is_routing_aggregatorrowrKoriginalfilteredr^s @rbuild_models_payloadrwrsPEDDDDD ' '--')-35&C17R   D  455GyWWtWWWW  -dC88 Dzz5 #D    &XXXXXXX &&&!%&) #  Q QCww()) Q"""P"Pswwx7H7H7NB"P"P"PPPP  8 8 877,--wwvr**.-d33778,,2PPPPxPPPx==3x==00$,CM*-h--C'yDzzxx(A$(L(Lxxxx"D!!!(!$''Jt3HIIII"D!!!$"(  sB!! B0/B0)r7r8r?c t|}t|t|t|ddddd|||  S)aBuild the shared API-server/dashboard/TUI model-options payload. This wraps ``build_models_payload`` with the stable picker shape and the safe custom-provider probe policy used for normal GUI/TUI opens: - normal open: probe only the current custom provider so offline saved endpoints do not block the picker - explicit refresh: probe every custom provider while busting the model cache so live catalogs repopulate fully T) r7r8r9r:r;r<r=r?r@rA)rErw)rDr7r8r?s rbuild_model_options_payloadrysZ"7mmG  =))!"677&*1k    rr*)r r rrCr r r r list[dict]ct|||}t|ddd|d}d|DS)ucProvider rows for any auxiliary-task picker (vision, compression, …). THE entry point for every aux picker — present and future. Call this instead of ``list_authenticated_providers()`` directly. Aux pickers kept re-deriving their own kwargs and each one silently dropped a different slice of the user's configuration. Two independent contributor PRs landed against the same two call sites for exactly this: #52642 (user ``providers:`` / ``custom_providers:`` entries never appeared) and #66624 (providers with an exhausted credential pool were hidden). Both were per-site kwarg patches, so the next aux picker would have reintroduced the same gap. Routing through one function makes the correct behaviour the default that a new caller cannot forget: - user-defined ``providers:`` and saved ``custom_providers:`` entries - ``model_catalog.excluded_providers`` honoured, matching ``/model`` - exhausted-credential-pool providers stay visible (``for_picker``) - the active custom endpoint is probed, offline saved ones are not, so the picker never blocks on a dead local server The virtual ``moa`` row is excluded: auxiliary tasks must not run the MoA reference fan-out, and ``auxiliary_client`` unwraps a ``moa`` provider to its aggregator slot anyway (see ``_resolve_auto``), so offering it here would be a choice silently rewritten behind the user's back. Mirrors the same filter in ``hermes_cli/moa_cmd.py``. Rows are the standard ``list_authenticated_providers`` shape. Pair with :func:`format_aux_picker_entries` to render them. rTF)rBr@rArCr-cg|]P}t|dpddkN|QSrJ)r r0striprNrOs rrRz)build_aux_picker_rows..psQ Q Q Q!s155==#6B77==??EEGG5PPAPPPr)r6rrw)r r rrCrDrqs rbuild_aux_picker_rowsr~@stH    . .)#) /  C  $&*       D R Qt Q Q QQr)r rrq list[tuple[str, str, list[str]]]c g}t|pd}tt|pd}|D]}t|dpd}|dp|}|dp#t |dpg} | rd| dnd} ||kr|r|sdnd} |||| | t|dpgf|S) u#Render aux-picker rows as ``(slug, label, models)`` menu entries. Owns the label text and the ``← current`` marker so every aux picker presents providers identically. Callers add their own leading/trailing entries (``auto``, ``Custom endpoint``, ``Back``) around this list. A custom endpoint set via a raw ``base_url`` is "current" only through that URL — never through a provider slug — so when ``current_base_url`` is set no provider row is marked, matching the pre-existing behaviour of both call sites. r*rKr)r_r\u — z modelsu ← current)r r}rNrEr0rjappendr) rqr rentries current_slug has_base_urlrtrKr)total model_hintmarkers rformat_aux_picker_entriesrssa"13G'-2..4466<<>>L,23399;;<>D'$()@$A$A  %%% $III%55e<<==&%%E  Q3?"33E::FF """!FFF"Q&**-A"B"BQ*/E+&&Q9?K9P9P5PE12DKK"NG####s0 "B## B21B2 C!! C0/C0c ddlm}n#t$rd}YnwxYw|D]}t|dpd}|dpg}i}t|D]\}}d|vr|dddnd}|si}n^d} |-|||p |d |} | rt| d dnd} | |g || |ft|d krg|d <g} | D]A} t| d d} | d| dt DBdt|Dt| fd|d <dS)u@Attach a ``featured_models`` shortlist to each aggregator provider row. Aggregator providers (nous, openrouter) serve dozens of models across many labs, so a flat "top-N" default would drop whole labs from the picker. Instead we surface the ``_FEATURED_PER_LAB`` newest models per lab (the vendor segment of a ``vendor/model`` id), ranked by models.dev ``release_date`` among that row's OWN models — never against the current date, so the choice is stable as models age. Same-date ties (and labs whose models lack a date) fall back to the row's curated order, which is already flagship-first, so a lab keeps its headliners rather than an arbitrary slice. Derived live from the models.dev catalog already loaded on this path (same source as pricing/capabilities) — there is no hand-maintained allowlist to keep in sync. Non-aggregator providers (a single lab, local endpoints, custom proxies) get an empty list and callers fall back to their existing top-N behaviour; splitting one lab into a shortlist would just hide models. r)get_model_infoNrKr*r\/r release_datefeatured_modelsc$|d|d fS)Nrrr#)es rz!_apply_featured...sAaD1Q4%=rT)keyreversec3"K|] \}}}|V dSrXr#)rP_pos_dater's rr[z"_apply_featured../s)WW&8dE5EWWWWWWrci|]\}}|| Sr#r#)rPirZs r z#_apply_featured..1s444$!QA444rc|SrXr#)rZorders rrz!_apply_featured..2s arr)rrrgr r0r}rN enumeratesplitgetattr setdefaultrrjvaluessortedextend_FEATURED_PER_LAB)rqrrtrKr\by_labposr'labdateinfor=rrankedrs @rrorosF$3333333 !J!J3776??(b))//117799""(b9;#F++ B BJC,/5LL%++c1%%a((bC D)%~dE22Ynn\SX6Y6Y<@Hwt^R888b   c2 & & - -sD%.@ A A A A v;;??%'C! "  }} X XGG)@)@$OOOF OOWWFCUDUCU`` identity (via ``canonical_custom_identity``), while catalog rows carry the bare config key as ``slug``. GUI pickers compare the two to decide which row is active; exact equality never matches for custom providers (#87035). Exposing ``aliases`` — every current and legacy spelling from :func:`hermes_cli.providers.custom_provider_aliases` — lets the frontend do a membership check instead. r)custom_provider_aliasesrVr)r*rKaliasesN)rfrr0rr rg)rqrrts rrprp5s=<<<<<  ww())   #''++,,c#''&"2E2E.F.FC NN     H   sAB B BrSrTcpddlm}ddlm}m}d|D}|jpd}t|jpd }g} |D]R} | j |vr|r| j |kr?| j |kr| | j } | r| j nd} | r| j r | j dnd} | dkr| rd| dnd }| | j | | j | jd d |r|gng|rd ndd d | | |d | | j | | j | j| j |kd gdddT| S)aBuild fallback rows for canonical providers missing from ``rows``. Most missing canonical providers become empty setup skeletons. The one exception is the *current* configured provider: if config.yaml still points at it but credentials are presently unavailable, keep a visible row carrying the saved model so GUI pickers don't silently snap to some other provider. rPROVIDER_REGISTRY)CANONICAL_PROVIDERS_PROVIDER_LABELScBh|]}|dSrKrYrOs r z,_append_unconfigured_rows..bs& , , ,!AfIOO   , , ,rr*api_keyz6Configured provider missing usable credentials; paste z- to reactivate. Showing the saved model only.ziConfigured provider is not authenticated; run `hermes model` to reactivate. Showing the saved model only.TFrzconfigured-current) rKr) is_currentrVr\r_source authenticated auth_typekey_envwarning canonical)rKr)rrVr\r_r)hermes_cli.authrrrrr rNr r r}rKr0rapi_key_env_varsrlabel)rqrDrTrrrseencur cur_modelextrasrr2rrrs rrereRsI211111GGGGGGGG , ,t , , ,D   %2 , , . .CC%+,,2244IF$. .  :     % %   EJ,,..#55  :     $ $#'' 33C),; )I0$Q''  ))g)000000  MM!J,00U[II"&',-6>ykkB)2$9AA2%*!*&&        (,,UZEE#j..00C7#( !%    Mrcddlm}t|jpd}g}|D]}t|dd}|sM|dr||x|r||kr|||dkr$tr||t|r||||r|||S)a'Keep only rows backed by explicit user configuration. ``list_authenticated_providers`` intentionally discovers ambient / auto- seeded credentials (for example GitHub CLI -> Copilot). Desktop chat model pickers want the narrower subset the user explicitly configured for Hermes. r)!is_provider_explicitly_configuredr*rKrVrL) rrr r r}rNr0r"_raw_config_has_enabled_moa_preset_provider_is_keyless)rqrDrrkeptrtrKs rrdrdsgBAAAAAs+1r2288::@@BBLD37762&&''--//5577   77$ % %  KK      DL00 KK     5== 233 ! C     % %  KK     , ,T 2 2  KK    Krc ddlm}||}t|duot |ddS#t $rYdSwxYw)zfanout aggregator max_tokensreference_modelsreference_max_tokensreference_temperatureaggregator_temperaturec3 K|]}|vV dSrXr#)rPrrLs rr[z5_raw_config_has_enabled_moa_preset..s'11cscz111111r) r/rrgr1rr0itemsr r}anyrE)rr4rr)preset legacy_keysrLs @rrrsz555555o uu c4 u ''%..C c4 uggi  G'4  #MMOO  LD&tzr??((** fd++ ttzz)T** tt uK 1111[111 1 1 Td3779d;S;S6T6TTs  ""c~ddlm}|D]}d|vr|ddko|d }| |d<|r|drT||d}|r|jnd }|r|jr |jdnd }||d <||d <|d kr|rd |dnd|d|d<dS)a0Add ``authenticated``/``auth_type``/``key_env``/``warning`` per row. Mutates ``rows`` in-place. Rows already from ``list_authenticated_providers`` are marked ``authenticated=True``; the unconfigured skeleton rows from ``_append_unconfigured_rows`` get the picker's setup-hint shape. rrrrrr\rVrKrr*rrzpaste z to activatez!run `hermes model` to configure ()rN)rrr0rr)rqrrt is_skeletonr2rrs rrkrks8211111   c ! !  ggh'';6Pswwx?P?P;P #.O cgg&788  ##CK00%(7CMMi  , C  # #  %K II%%'% +W * * * *AYAAA I+  rcddlm}dt|Dtfd|Dfd}fd|D}||zS)uCanonical slugs in ``CANONICAL_PROVIDERS`` declaration order; truly-custom rows last. Keys on slug membership, NOT ``is_user_defined`` — section 3 of ``list_authenticated_providers`` sets ``is_user_defined=True`` on rows from the ``providers:`` config dict even when the slug is canonical. Keying on the flag would silently demote canonical providers configured via the new keyed schema. r)rc$i|] \}}|j|Sr#r)rPrrs rrz&_reorder_canonical..)s B B B41aQVQ B B Brc30K|]}|dv |VdS)rKNr#rPrQrs rr[z%_reorder_canonical..+s1//qAfI......//rc |dS)NrKr#)rQrs rrz$_reorder_canonical..,seAfI&rrc(g|]}|dv |Srr#rs rrRz&_reorder_canonical...s' 8 8 8A6%!7!7a!7!7!7r)rrrr)rqrcanonrrs @rrlrls655555 B B9-@#A#A B B BE ////D/// & & & &   E9 8 8 8 8 8 8F 6>rrac ,ddlm}m}m}m}m}d}|D]}t |dd} |dpg} | sR || pi} n#t$ri} YnwxYw| svi} | D] } | | }|s|dd}|dd}|d d}|dkr ||nd}|dkr ||nd}|r ||nd}|d ko |d kp|dk}||||d }| d krW|sU||||d }|3|\}}}||d<|dkr|||d<|dkr|||d<|| | <| r| |d<| d kri | ||}t||d<|r$|t| | d\}}||d<ng|d<#t$rd|d<g|d<YwxYwdS)uEnrich each provider row with per-model pricing + Nous tier gating. Mutates ``rows`` in-place. For every row whose provider supports live pricing (openrouter / nous / novita) adds:: row["pricing"] = {model_id: {"input": "$3.00", "output": "$15.00", "cache": "$0.30" | None, "free": bool}} For Nous additionally adds:: row["free_tier"] = bool # current account is free-tier row["unavailable_models"] = [...] # paid models a free user can't pick Prices are pre-formatted via ``_format_price_per_mtok`` so the GUI just renders strings — identical formatting to the CLI picker. All failures are swallowed (best-effort): a row simply gets no ``pricing`` key. r)_format_price_per_mtokcheck_nous_free_tiercompute_sale_discountget_pricing_for_providerpartition_nous_models_by_tierNrKr*r\prompt completioninput_cache_readfree)inputoutputcacher rrudiscount_percent was_input was_outputr;) force_fresh free_tierT)runavailable_modelsF) rrrrrrr r0rNrgrEr)rqr>rrrrrnous_free_tierrtrKr\ raw_pricing formattedmidpinp_rawout_raw cache_rawinpoutris_freersalerwas_prompt_raw was_out_raw _selectable unavailables rrmrm2s~,&*NI/I/37762&&''--//""(b   22488>BKK   KKK   %' % #% #C$$A eeHb))GeeL"--G0"55I5<]]((111C5<]]((111C9BL**9555EVmD)C#)G Ev~~g~,,WaeeJ&7&7#DHA$nk0@E,-%++-C-C*..k*#b((.D.D'//l+#IcNN  '&C N 6>> /!)%9%9$9&&&N$(#7#7K !3/L/LV kT000,K1>>>>>"";;==#4#4U#;#;#ArBBcggi,,113344 4'+1r88::eC$KK!"m    ttsA+B!/1B!! B/.B/)rr )rDr r7rEr8rEr9rEr:rEr;rEr<rEr=rEr>rEr?rEr@rErArErBrErCrFrr) rDr r7rEr8rEr?rErr) r r r r rr rCrFrrz)rqrzr r rr rr)rKr )rqrzrr)rqrzrDr rTrErrz)rqrzrDr rrz)rKr rrE)rrE)rqrzrrz)rqrzr>rErr)r*)r r rr%)r! __future__r dataclassesrrtypingrrr r6rwryr~rrrnrrorprerdrrrkrlrmrcr#rrr.sB#"""""********  $!3!3!3!3!3!3!3!3HJ !&!"'#'*/!ggggggZ !& L! 0R0R0R0R0R0Rl D4A#A#A#A#P8J8J8J8JvB CCCCCCL&&&&R)U)U)U)UX# # # # L0#(j/j/j/j/j/j/Zr