+ i-LRt^RIt^RIHtHt^RIHtHtHtHtH t ^RI H t ^RI H t /R^bR^bR^bR ^bR ^bR ^bR ^bR ^bR^bR^bR^bR^bR^bR^bR^bR^ bR^ bR^ R^ R^ R^ R^ R^ R^ /CtRRltR R!ltR"R#lt0R.mtR$R%ltR&R'ltR/R(R)lltR*R+ltR,R-ltR#)0aWebSearch module for last30days skill. NOTE: WebSearch uses the assistant's built-in web search tool, which runs inside the host environment. Unlike Reddit/X which use external APIs, web search results are obtained by the assistant directly and passed to this module for normalization and scoring. The typical flow is: 1. The assistant invokes its web search tool with the topic 2. The assistant passes results to parse_websearch_results() 3. Results are normalized into WebSearchItem objects N)datetime timedelta)AnyDictListOptionalTuple)urlparse)schemajanjanuaryfebfebruarymarmarchapraprilmayjunjunejuljulyaugaugustsepsept septemberoctoctobernovnovemberdecdecembercFV^8dQhR\R\\,/#urlreturnstrr)formats"U/Users/bowang/.openclaw/workspace/skills/last30days-official/scripts/lib/websearch.py __annotate__r,&s##s#x}#cZ\P!RV4pV'doVP4wr#pR\V4u;8:dR8:dDMM@^\V4u;8:d^ 8:d)MM%^\V4u;8:d^8:dMM V RV RV 2#\P!RV4pV'doVP4wr#pR\V4u;8:dR8:dDMM@^\V4u;8:d^ 8:d)MM%^\V4u;8:d^8:dMM V RV RV 2#\P!RV4pV'drVP4wr#pR\V4u;8:dR8:dGMR#^\V4u;8:d^ 8:d+MR#^\V4u;8:d^8:dMR#V RV RV 2#R#)zTry to extract a date from URL path. Many sites embed dates in URLs like: - /2026/01/24/article-title - /2026-01-24/article - /blog/20260124/title Args: url: URL to parse Returns: Date string in YYYY-MM-DD format, or None z/(\d{4})/(\d{2})/(\d{2})/-z/(\d{4})-(\d{2})-(\d{2})[-/]z/(\d{4})(\d{2})(\d{2})/N)researchgroupsint)r&matchyearmonthdays& r+extract_date_from_urlr:&sk II2C 8E  <<>S 3t9 $ $c%j)>B)>1CCVTVCVV1UG1SE* * II5s ;E  <<>S 3t9 $ $c%j)>B)>1CCVTVCVV1UG1SE* * II0# 6E  <<>S 3t9 $ $ *+c%j)>B)> DECCVTVCV V1UG1SE* * r-cFV^8dQhR\R\\,/#)r%textr'r()r*s"r+r,r,Ls"WWCWHSMWr-c\V'gR#VP4p\P!RV4pV'dVP4wr4p\P VR,4pV'dLR\ V4u;8:dR8:d4MM0^\ V4u;8:d^8:dMMV RVR R\ V4R 2#\P!RV4pV'dVP4wrCp\P VR,4pV'dLR\ V4u;8:dR8:d4MM0^\ V4u;8:d^8:dMMV RVR R\ V4R 2#\P!R V4pV'doVP4wrVpR\ V4u;8:dR8:dDMM@^\ V4u;8:d^ 8:d)MM%^\ V4u;8:d^8:dMM V RV RV 2#\P!4pR V9d%V\^R 7, pVPR 4#R V9dVPR 4#\P!RV4pV'dF\ VP^44p V ^<8:d%V\V R 7, pVPR 4#\P!RV4pV'dVPR 4#RV9d%V\^R 7, pVPR 4#RV9d%V\^R 7, pVPR 4#R#)aTry to extract a date from text snippet or title. Looks for patterns like: - January 24, 2026 or Jan 24, 2026 - 24 January 2026 - 2026-01-24 - "3 days ago", "yesterday", "last week" Args: text: Text to parse Returns: Date string in YYYY-MM-DD format, or None Nz\b(jan(?:uary)?|feb(?:ruary)?|mar(?:ch)?|apr(?:il)?|may|jun(?:e)?|jul(?:y)?|aug(?:ust)?|sep(?:t(?:ember)?)?|oct(?:ober)?|nov(?:ember)?|dec(?:ember)?)\s+(\d{1,2})(?:st|nd|rd|th)?,?\s*(\d{4})\b:NNr/r0r102dz\b(\d{1,2})(?:st|nd|rd|th)?\s+(jan(?:uary)?|feb(?:ruary)?|mar(?:ch)?|apr(?:il)?|may|jun(?:e)?|jul(?:y)?|aug(?:ust)?|sep(?:t(?:ember)?)?|oct(?:ober)?|nov(?:ember)?|dec(?:ember)?)\s+(\d{4})\bz\b(\d{4})-(\d{2})-(\d{2})\b yesterday)daysz%Y-%m-%dtodayz\b(\d+)\s*days?\s*ago\bz\b(\d+)\s*hours?\s*ago\bz last weekz this week) lowerr2r3r4 MONTH_MAPgetr5rnowrstrftimegroup) r< text_lowerr6 month_strr9r7r8rBdaterAs & r+extract_date_from_snippetrLLs J II 6   E  $||~  im, TSY.$.1C3FB3FV1U3KqS#7 7 II    E $||~ im, TSY.$.1C3FB3FV1U3KqS#7 7 II4d ;E  <<>S 3t9 $ $c%j)>B)>1CCVTVCVV1UG1SE* * LLNEj ya((}}Z((*~~j)) II0* =E 5;;q>" 2:9$//D==, , II1: >E ~~j))j ya((}}Z((j ya((}}Z(( r-c V^8dQhR\R\R\R\\\,\3,/#)r%r&snippettitler')r)rr)r*s"r+r,r,s>## # # # 8C=#  #r-c\V4pV'dVR3#\V4pV'dVR3#\V4pV'dVR3#R#)amExtract date from any available signal. Tries URL first (most reliable), then snippet, then title. Args: url: Page URL snippet: Page snippet/description title: Page title Returns: Tuple of (date_string, confidence) - date from URL: 'high' confidence - date from snippet/title: 'med' confidence - no date found: None, 'low' confidence highmed)Nlow)r:rL)r&rNrOurl_date snippet_date title_dates&&& r+extract_date_signalsrWsV*%S)H-W5LU""+51J5  r-c0V^8dQhR\R\/#r$)r))r*s"r+r,r,sr-c\V4pVPP4pVPR4'd VR,pV# \dR#i;i)ziExtract the domain from a URL. Args: url: Full URL Returns: Domain string (e.g., "medium.com") zwww.:NN)r netlocrC startswith Exceptionr&parseddomains& r+extract_domainrbsS#$$&   V $ $BZF sAA AAc0V^8dQhR\R\/#r$)r)bool)r*s"r+r,r,sCDr-c\V4pVPP4pV\9# \dR#i;i)z~Check if URL is from an excluded domain (Reddit/X). Args: url: URL to check Returns: True if URL should be excluded F)r r\rCEXCLUDED_DOMAINSr^r_s& r+is_excluded_domainrgs@#$$&))) s -0 ??c V^8dQhR\\\\3,,R\R\R\R\\\\3,,/#)r%resultstopic from_dateto_dater')rrr)r)r*s"r+r,r,s[YY $sCx. !Y YY Y  $sCx. Yr-c<.p\V4EFwrV\V\4'gKVPRR4pV'gK:\ V4'dKM\ VPRR44P 4p\ VPRVPRR444P 4p V'g V 'gKVPR4p Rp V 'd*\P!R\ V 44'dR p M\WyV4wrV 'dT p T p V 'dV'd W8dEK8V 'dV'd W8dEKQVPR R 4p\R \R \V444pRRV^, 2RVR,RVR\V4RV R,RV RV R VR\ VPRR44P 4/ pVP!V4EK V# \\3dR pLi;i)aParse WebSearch results into normalized format. This function expects results from Claude's WebSearch tool. Each result should have: title, url, snippet, and optionally date/relevance. Uses "Date Detective" approach: 1. Extract dates from URLs (high confidence) 2. Extract dates from snippets/titles (med confidence) 3. Hard filter: exclude items with verified old dates 4. Keep items with no date signals (with low confidence penalty) Args: results: List of WebSearch result dicts topic: Original search topic (for context) from_date: Start date for filtering (YYYY-MM-DD) to_date: End date for filtering (YYYY-MM-DD) Returns: List of normalized item dicts ready for WebSearchItem creation r&r[rOrN descriptionrKrSz^\d{4}-\d{2}-\d{2}$rR relevance?g?gidW:NN source_domain:NiNdate_confidence why_relevant) enumerate isinstancedictrErgr)stripr2r6rWminmaxfloat TypeError ValueErrorrbappend)rirjrkrlitemsiresultr&rOrNrKruextracted_date confidenceroitems&&&& r+parse_websearch_resultsrs4 Ew' &$'' jj#  c " " FJJw+,224fjjFJJ}b,IJKQQSW zz&! BHH3SY??#O*>cE)R &N%", I$"2  G JJ{C0  CS% *:!;2 >?EEG    Tw(z L#:& I s2HHHc V^8dQhR\\\\3,,R\R\R\\P ,/#)r%rrkrlr')rrr)rr WebSearchItem)r*s"r+r,r,ZsH S#X  &   r-c@.pVFp\P!VR,VR,VR,VR,VR,VPR4VPRR4VPR R 4VPR R 4R 7 pVPV4K V#)zConvert parsed dicts to WebSearchItem objects. Args: items: List of parsed item dicts from_date: Start of date range (YYYY-MM-DD) to_date: End of date range (YYYY-MM-DD) Returns: List of WebSearchItem objects rqrOr&rtrNrKrurSrorprvr[) rqrOr&rtrNrKrurorv)r rrEr)rrkrlrrweb_items&&& r+normalize_websearch_itemsrZsF''Dzw-U /O&! HH%6>hh{C0."5    h Mr-cV^8dQhR\\P,R\\P,/#)r%rr')rr r)r*s"r+r,r,|s0D!5!564@T@T;Ur-c\4p.pVFVpVPP4PR4pWA9gK4VP V4VP V4KX V#)zRemove duplicate WebSearch items. Deduplication is based on URL. Args: items: List of WebSearchItem objects Returns: Deduplicated list /)setr&rCrstripaddr)r seen_urlsrrurl_keys& r+dedupe_websearchr|sZI F((.."))#.  # MM' " MM$   Mr->x.com www.x.com reddit.com twitter.comold.reddit.comwww.reddit.comwww.twitter.commobile.twitter.com)r[r[)__doc__r2rrtypingrrrrr urllib.parser r[r rDr:rLrWrfrbrgrrrr-r+rsG  (33!  1   1 !  1 q  1 q   1   1  a  1 a  1   1 a %a 2y" 2z2 2z2  #LWt#N ("YxDr-