mjp<(ddlmZddlZddlmZddlZddlmZmZddl m Z m Z m Z m Z mZmZmZmZmZmZmZmZddlmZmZmZmZmZd!d Zd"d#dZGddeZd$dZd$dZ d$dZ!d$dZ"d$dZ#d%dZ$d$dZ%d$dZ&d$dZ'd$dZ(d$dZ)d$dZ*d$d Z+dS)&) annotationsN)Path)apply_migrationsget_schema_version) add_demo_migros_receiptaccept_grocery_product_matchreject_grocery_product_matchcreate_manual_grocery_mappingrefresh_grocery_mapping_priceget_grocery_optimizer_dashboardrun_grocery_optimization$generate_grocery_optimization_reportget_grocery_provider_strategybuild_rappn_link_outpreview_manual_grocery_mappingconfirm_manual_grocery_mapping) search_and_store_product_matchessearch_open_prices_spike CoopProviderGroceryProductProviderGroceryProviderResultreturnsqlite3.Connectionctjd}tj|_t |t |dksJ|S)Nz:memory:1)sqlite3connectRow row_factoryrr)conns /tests/unit/test_grocery_matching_learning_v2.pydbr"sG ?: & &D{DT d # #r ) ) ) ) KMilch 1Lr1r dictc 8t|dd||dddddgS) N 2026-05-19Migros1Llz1.50/lz1.50)raw_product_name quantity_textunitunit_price_texttotal_price_text) purchase_date store_name receipt_iditems)r)r rawr3s r! seed_receiptr6"s_ "4|PXeoNQdhruJRhnyoyoxp q q qqr#c*eZdZdfd ZdddZxZS)StaticProviderretailerstrresultslist[GroceryProviderResult]rNonectd||_d|ddd|_||_dS)NcdS)N_urls r!z)StaticProvider.__init__..(sbr#fetcherzhttps:// -z .example/)super__init__r9lowerreplacebase_url_results)selfr9r; __class__s r!rJzStaticProvider.__init__'s^ 111  P8>>#3#3#;#;C#E#EPPP  r#Nde-CHTQr rquery str | Nonelocale use_cachebool max_resultsintmax_age_seconds list[dict]cT|xjdz c_d|jd|DS)Nc6g|]}|SrA)as_dict).0rs r! z2StaticProvider.search_products../s AAA AAAr#) request_countrN)rOr rTr9rVrWrYr[s r!search_productszStaticProvider.search_products-s5 aAAT]Prix Garantie Milch 1LCHF 1.201.20/lrArBs r!rDzktest_accept_match_creates_preferred_mapping_and_next_receipt_reuses_without_provider_call..5s 2Hr#rEr4rproduct_item_idF providersincluded_product_item_idsrWmatchesmatch_idpasst user_notestatusacceptedtarget_retailerCoopr2cZddDtdS)Nc3K|]}|VdS)NrA)ra_s r! z~test_accept_match_creates_preferred_mapping_and_next_receipt_reuses_without_provider_call....<sooQqoooooor#rAzprovider must not be called)throwAssertionErrorrBs r!rDzktest_accept_match_creates_preferred_mapping_and_next_receipt_reuses_without_provider_call..<s'oo"ooo6K6KN[xLyLy6z6zr#Trorpprefer_known_mappingsrWprovider_callsknown_mapping_hitsr^source known_mappingselected_retailersrpsummaryreplaceable_product_count)r"r6rrrr ) r firstproviderfoundrwsecond fail_providerreusedruns r!Ytest_accept_match_creates_preferred_mapping_and_next_receipt_reuses_without_provider_callr2s  44D $ / / /E%H%HIIIH ,T4H:jopwjxyzj{}NkOjP\a b b bE+D% 2B12Ej2Q]deeeH H  + + + + % && 0 0 0 0 $4 0 0 0F )z)z{{{M -dD]Opvw~pABqCDUqVpWosCDDDF " #q ( ( ( ( & '1 , , , , ) Q  )_ < < < < "46(gmnugvwxgy{LhMgN O O OC y>5 6! ; ; ; ; ; ;r#crt}t|}td}t|d|g|dddgd}t ||d dd d }|d dksJt|d}t|d|g|dddgdd}t d|d DsJt |ddg|dddg}|dddksJd|dddvsJdS)NcdS)NzrArBs r!rDzLtest_rejected_match_is_persisted_and_not_recommended_again..Hs 2r#rEr%r4rrmFrnrqrrfalschrtrvrejectedrzrkTrc3HK|]}|ddkVdS)rv suggestedN)getrams r!r~zMtest_rejected_match_is_persisted_and_not_recommended_again..Os1II!quuX+-IIIIIIr#ryrrrr$optimized_listsrejected_products)r"r6rrr allr )r receiptrrrrrrs r!:test_rejected_match_is_persisted_and_not_recommended_againrEs 44D4  G%%@@@H ,T4H:jqryjz{|j}PkQjR^c d d dE+D% 2B12Ej2Q]efffH H  + + + + $4 0 0 0F -dDXJkqrykz{|k}PlQkRjnz~F IIvi7HIII I III I "46(gmnugvwxgy{LhMgN O O OC y>5 6! ; ; ; ; ./23FG G G G G G Gr#c8t}t|}t||dddddddddd d d d }|ddksJ|dd ksJ|dJt|ddg|dddg}|dddksJ|dt ||d}|ddksJt|ddg|dddg}|dd ksJdS)Nr4rrmDennerDenner Milch 1Lhttps://www.denner.ch/milchr*r+ manual_match1.101.10/lzmanuell notiert) rmrxtarget_product_nametarget_product_url target_brandtarget_package_size target_unit match_typecandidate_price_textcandidate_unit_price_textrurvrwrlast_price_checked_atr%rrraTINSERT INTO grocery_product_details_cache(detail_id,retailer,product_url,product_name,price_text,unit_price_text,package_size,ingredients_text,nutrition_json,fetched_at,cache_status,source_hash) VALUES ('d1','Denner','https://www.denner.ch/milch','Denner Milch 1L','1.10','1.10/l','1L',NULL,'{}','2026-05-19T10:00:00+00:00','cached','hash') mapping_idz2026-05-19T10:00:00+00:00optimized_total_text)r"r6r r executer )r rmapping run_before refreshed run_afters r!Etest_manual_mapping_can_be_saved_and_used_after_sourced_cache_refreshrUs 44D4  G+D''BRSTBUVgBh{CYj\ksIM[^kyPVrzFWXXXG 8  * * * * < N 2 2 2 2 * + 3 3 3)$(pwxqABCqDEVqWpXYYYJ i !< = B B B BLLhiii-dGL4IJJI , -1L L L L L(t ovw~oABpCDUpVoWXXXI + , 6 6 6 6 6 6r#c t}t|}dD]Y}tjt5t ||ddddd|dddn #1swxYwYZtjt5t ||ddddddd ddddS#1swxYwYdS) N)zjavascript:alert(1)zhttp://127.1/xzhttp://[::1]/xzhttp://169.254.169.254/latestzhttp://172.31.0.1/xzhttp://localhost/xr4rrmryBad)rmrxrrzhttps://coop.example/bad evil_match)rmrxrrr)r"r6pytestraises ValueErrorr )r r unsafe_urls r!5test_manual_mapping_rejects_unsafe_url_and_match_typeres 44D4  G`zz ]: & & z z )$@PQR@STe@fx~UZoy z z z z z z z z z z z z z z z z z z z z " "__%dGGfehltfehlerfrischveraltet)r"r6r r )r rrdashitems r!7test_dashboard_surfaces_known_mappings_and_cache_statusros 44D4  G+D''BRSTBUVgBh{AWf{WdrIOPPPG *4 0 0D  A w ' *D  !! $\ 2gl6K K K K K  !! $^ 48a a a a a a ar#tmp_pathrc t}t|}t||dddddddd t|d dg|dddg }t ||d |d z |dz }t |d}|ddusJd|vsJd|vsJd|vsJd|vsJd|vsJd|vsJd|vsJd|vsJd|vsJd|vsJdS)Nr4rrmryrrrrrr%rrun_idzruntime-reportsrepo) reports_dir repo_root report_path runtime_onlyTz Bon-AuswahlzAnalysierte ProduktezAkzeptierte AlternativenzAbgelehnte AlternativenzUnsichere ProduktezNicht gefundene Produkteu.Geschätzte Ersparnis nur aus sicheren MatcheszBekannte Mappingszkeine medizinische Empfehlung)r"r6r r rr read_text)rr rrreporttexts r!Gtest_report_contains_known_mappings_sources_and_disclaimer_runtime_onlyrys 44D4  G!$8H8KL]8^pvM\qMZhEFFFF "46(gnovgwxygz|MhNgO P P PC 1$H S[^oSo|DGM|MNNNF }% & & 0 0 2 2D . !T ) ) ) ) D !T ) ) ) ) % - - - - $ , , , , 4 ' ' ' ' % - - - - ;t C C C C $ & & & & '4 / / / / *d 2 2 2 2 2 2r#c t}t|}tdtddddddg}t |d|g|ddd gd }|d dd dksJ|d ddsJt ||d ddd }|d dksJ|ddksJt ||d dd}|d dksJdS)NryzCoop Milch ohne Preiszhttps://coop.example/no-pricez0.50)r9 product_name product_url price_textr/ confidencer%r4rrmFrnrqrv needs_reviewrr)save_as_preferredrrr)r"r6r8rrrr )r rrrrwrs r!.s9hhAq}(GQx[K-Ghhhhhhr#)r"r6r8rrr any)r rcooprdennerr found_agains r!;test_rejected_exact_match_does_not_suppress_other_retailersrs 44D4  G &WfuQ^dv~O\N]jp$q$q$q#r s sD ,T4D6fmnufvwxfy{LgMfNZ_ ` ` `E uY'7'::'FGGG H'.s1]]s:R\?\?\?\?\?\?\]]r#provider_matrix official_apiFzLink-Outrecommendationrappnmode link_out_onlyc3K|]}d|vV dS)zPreise erfindenNrArars r!r~zPtest_provider_strategy_documents_rappn_linkout_and_llm_limits..s(YYT D(YYYYYYr# llm_policy forbiddenc3K|]}d|vV dS)zProduktnamen normalisierenNrArs r!r~zPtest_provider_strategy_documents_rappn_linkout_and_llm_limits..s(bb+t3bbbbbbr#allowedr$ manual_sourcemanual/rappn_user_checkedz api.rappnurl)rnextrr)strategyrlinks r!=test_provider_strategy_documents_rappn_linkout_and_llm_limitsrs;,..H ]]): ;]]] ] ]E  E ) ) ) ) /0 0 0J(7BSTZB[4[4[4[ [ G V $ 7 7 7 7 YYXl5KK5XYYY Y YYY Y bb@VW`@abbb b bbb b  + +D .*U[J\J\JbJbcjJkJkr#)rTrF candidatesr source_urlz/7rcan_count_as_secure_savingFno_pricerrendswithresult candidaters @r!.test_open_prices_without_price_is_never_securer&sugkn.o.oIKV~WkwEJbKbKLLMNG %G=k=k=k=k l l lF|$Q'I \ " + +D 1 111 1 \ " * * * 1 2e ; ; ; ; ?3 3 3 3 3 3 3r#c ddddddddd d d id d idgitdfd}|dd}|ddksJ|ddksJ|ddsJ|ddusJ|dsJdS)Nr4z1.25r r(rrr*r r z Open Shoprz 2026-05-18)rpricerrrrrcHtdSrrrs r!rDzRtest_open_prices_with_price_still_candidate_with_source_and_date..rr#)barcoderFrrr price_daterz/8rF attributionr!r#s @r!@test_open_prices_with_price_still_candidate_with_source_and_dater.sF|qvIPfjikikzDFQyR^dfr]sttuvG %e=k=k=k=k l l lF|$Q'I \ "f , , , , \ "l 2 2 2 2 \ " + +D 1 111 1 1 2e ; ; ; ; ] ### ###r#ct}t|}|ddd}t||dddddd d d d d  }|ddusJ|ddusJt||}|dd ksJ|dd ksJ|d|f}d|DddgksJt |ddg|g}|dddksJ|dddksJdS)Nr4rrmrrrrrr*r+r(rumanuell geprüft) rmrxrrrrrrtarget_price_datetarget_price_sourcerurequires_confirmTrr0r1z[SELECT action FROM grocery_mapping_audit_events WHERE product_item_id=? ORDER BY created_atcg|] }|d S)actionrArs r!rcz[test_manual_price_preview_confirm_audit_and_secure_saving_when_complete..s , , ,cCM , , ,r#manual_mapping_previewmapping_insertedr%rrrr^estimated_savings_textz0.40)r"r6rrrfetchallr )r ritem_idpreviewrauditsrs r!Gtest_manual_price_preview_confirm_audit_and_secure_saving_when_completer<s 44D4  Ggq!"34G,T7\d{La~U[wUYgj~J`{GYZZZG % &$ . . . . / 0D 8 8 8 8,T7;;G & '< 7 7 7 7 ( )-H H H H H \\w{BzDEENNPPF , ,V , , ,1IK]0^ ^ ^ ^ ^ "48*iphq r r rC y>5 6! ; ; ; ; y>2 3v = = = = = =r#c ^t}t|}|ddd}t||ddddd }|d d usJt||}d |d vsJt |ddg|g}|dddksJ|dddksJdS)Nr4rrmrrrrr)rmrxrrrrrFrquality_flags_jsonr%rrrr7z0.00)r"r6rrr )r rr9r:rrs r!Etest_manual_price_without_date_source_is_review_only_no_secure_savingr?s 44D4  Ggq!"34G,T7\d{La~U[w@@@G / 0E 9 9 9 9,T7;;G W%9: : : : : "48*iphq r r rC y>5 6! ; ; ; ; y>2 3v = = = = = =r#)rr)r$r%)r rrr&)rr=)rrrr=), __future__rrpathlibrr!jarvis_finance.storage.migrationsrr)jarvis_finance.services.grocery_optimizerrrr r r r r rrrrr/jarvis_finance.services.grocery_price_providersrrrrrr"r6r8rrrrrrrrrr&r.r<r?rAr#r!rEs"""""" RRRRRRRR                            ttttttttttttttqqqqq B B B B B+ B B B<<<<& H H H H 7 7 7 7 ____bbbb3333( , , , , i i i i * * * *4444$$$$>>>>" > > > > > >r#