+ ix%Rt^RIt^RIHtHtHtHt^RIHt^RI H t H t RRlt !RR] 4tRR R lltR R ltRR RlltRRRlltRRRlltRRRlltR#)zReddit thread enrichment with real engagement metrics. Supports two backends: 1. ScrapeCreators API (preferred) - no rate limits, 1 credit/call 2. reddit.com/.json (fallback) - free but 429-prone N)AnyDictListOptional)urlparse)httpdatescFV^8dQhR\R\\,/#)urlreturn)strr)formats"Y/Users/bowang/.openclaw/workspace/skills/last30days-official/scripts/lib/reddit_enrich.py __annotate__rsSXc]ch\V4pRVP9dR#VP# R#;i)zdExtract the path from a Reddit URL. Args: url: Reddit URL Returns: Path component or None z reddit.comN)rnetlocpath)r parseds& rextract_reddit_pathrs3# v}} ,{{s , ,1c]tRt^!tRtRtR#)RedditRateLimitErrorz3Raised when Reddit returns HTTP 429 (rate limited).N)__name__ __module__ __qualname____firstlineno____doc____static_attributes__rrrrr!s=rrc V^8dQhR\R\\,R\R\R\\\\3,,/#)r r mock_datatimeoutretriesr )r rrintr)rs"rrr&sK!! !~!! ! d38n !rcVeV#\V4pV'gR#\P!WBVR7pV# \Pd,pTPR8Xd\ RT 24ThRp?R#Rp?ii;i)aCFetch Reddit thread JSON data. Args: url: Reddit thread URL mock_data: Mock data for testing timeout: HTTP timeout per attempt in seconds retries: Number of retries on failure Returns: Thread data dict or None on failure Raises: RedditRateLimitError: When Reddit returns 429 (caller should bail) Nr"r#iz#Reddit rate limited (429) fetching )rrget_reddit_json HTTPError status_coder)r r!r"r#rdataes&&&& rfetch_thread_datar,&su( s #D ##D7K >> ==C &)LSE'RSYZ Zs7A7 A22A7cRV^8dQhR\R\\\3,/#)r r*r )rrr )rs"rrrJs"66C6DcN6rc\RRR./p\V\4'd\V4^8dV#V^,p\V\4'dVP R/4P R.4pV'dV^,P R/4pRVP R4RVP R4RVP R4R VP R 4R VP R 4R VP R 4R VP R R 4R,/VR&\V4^8EdV^,p\V\4'dVP R/4P R.4pVFpVP R4R8wdKVP R/4pVP R4'gKFRVP R^4R VP R 4RVP RR4RVP RR 4R,R VP R 4/pVR,P V4K V#)zParse Reddit thread JSON into structured data. Args: data: Raw Reddit JSON response Returns: Dict with submission and comments data submissionNcommentsr*childrenscore num_comments upvote_ratio created_utc permalinktitleselftext:NiNkindt1bodyauthor [deleted]Ni,N) isinstancelistlendictgetappend) r*resultsubmission_listingr1sub_datacomments_listingchildc_datacomments & rparse_thread_datarMJs dBF dD ! !SY] a$d++%))&"599*bI {vr2Hg. ^ < ^ <x||M:X\\+6g.HLLR8>$F<  4yA~7 & - -'++FB7;;JKH!99V$,62.zz&))VZZ3!6::m#<fjj;?FJJvr248K!8 z"))'2" Mrc V^8dQhR\\,R\R\\\\3,,/#r r0limitr )rrr$r r)rs"rrrs2##tDz###tDcN?S#rcVUu.uFq"PR4R9gKVNK pp\VRRR7pVRV#uupi)zGet top comments sorted by score. Args: comments: List of comment dicts limit: Maximum number to return Returns: Top comments sorted by score r=c&VPR^4#r2rDcs&r"get_top_comments..s!%%2CrTkeyreverseNr>z [removed])rDsorted)r0rPrVvalidsorted_commentss&& rget_top_commentsr`sL! V1EE(O;U$UQQE VU(CTRO 6E "" Ws==chV^8dQhR\\,R\R\\,/#rO)rrr$r )rs"rrrs)//tDz/#/d3i/rcBa.pVRV^,EF pVPRR4P4oS'd\S4^8dK>.R Op\;QJdV3RlV4F 'gK RM RM!V3RlV44'dKSR,p\S4^8dJ\ V4F#wrgVR9gKV^28gKVRV^,pM VP 4R ,pVP V4\V4V8gEK V# V#) a%Extract key insights from top comments. Uses simple heuristics to identify valuable comments: - Has substantive text - Contains actionable information - Not just agreement/disagreement Args: comments: Top comments limit: Max insights to extract Returns: List of insight strings Nr<r9c3n<"TF*p\P!VSP44xK, R#5i)N)rematchlower).0pr<s& r +extract_comment_insights..s%@-Qrxx4::<((-s25TF:NNz.!?z...)z@^(this|same|agreed|exactly|yep|nope|yes|no|thanks|thank you)\.?$z^lol|lmao|hahaz ^\[deleted\]z ^\[removed\])rDstriprBany enumeraterstriprE) r0rPinsightsrL skip_patternsinsighticharr<s && @rextract_comment_insightsrusHJUQY'{{62&,,.s4y2~  3@-@333@-@ @ @ t* t9s?$W-5=QV%dqsmG. "..*U2 x=E !  O=(< Orc V^8dQhR\\\3,R\\,R\R\R\\\3,/#)r itemmock_thread_datar"r#r )rr rrr$)rs"rrrsN== sCx.=tn== =  #s(^ =rc VPRR4p\WAW#R7pV'gV#\V4pVPR4pVPR.4pV'dkRVPR4RVPR4RVPR4/VR &VPR 4p V 'd\P!V 4VR &\ V4p .VR &V Fp V PR R4p V 'dRV 2MRp VR ,P RV PR^4R \P!V PR 44RV PRR4RV PRR4R,RV /4K \V 4VR&V#)u~Enrich a Reddit item with real engagement data. Args: item: Reddit item dict mock_thread_data: Mock data for testing timeout: HTTP timeout per attempt (default 10s for enrichment) retries: Number of retries (default 1 — fail fast for enrichment) Returns: Enriched item dict Raises: RedditRateLimitError: Propagated so caller can bail on remaining items r r9r&r/r0r2r3r4 engagementr5date top_commentsr6https://reddit.comr=excerptr<NNcomment_insights)rDr,rMrtimestamp_to_dater`rEru)rwrxr"r#r thread_datarr/r0r5r|rVr6 comment_urls&&&& renrich_reddit_itemrsw( ((5" C$C7\K  { +FL)Jzz*b)H Z^^G, JNN>: JNN>: \!nn]3  22;?DL$H-LD EE+r* :C*9+6  ^## QUU7A& E++AEE-,@A aeeHb) quuVR(. ; %   8 ED  Krc V^8dQhR\\\3,R\R\R\\\3,/#)r rwtokenr"r )rr rr$)rs"rrrs@== sCx.= == #s(^ =rc^RIHpVPRR4pV'gV#VPWA4pV'gV#.pVR,FpVPRR4pV'dVR9dK&VPR4;'gVPR^4p VPR R4p VPR R4p V 'dR V 2MRp TP RT R VPR 4'd&\ P !VPR 44MRR V RVR,RVR,RV /4K VPRRR7.VR&VFtpVR,P RVPR^4R VPR 4R VPR R4RVPRR4RVPRR4/4Kv \V4VR&V#)a*Enrich a Reddit item using ScrapeCreators comment API. No rate limit risk. Uses 1 credit per call. Args: item: Reddit item dict (already has engagement from search) token: ScrapeCreators API key timeout: HTTP timeout Returns: Enriched item with top_comments and comment_insights )redditr r9:N Nr<r>upsr2r=r6r}r{r5Nr?r~rc&VPR^4#rSrTrUs&rrW'enrich_reddit_item_sc..7sAEE'1$5rTrYr|rr\) r9rrDfetch_post_commentsrErrsortru) rwrr" reddit_modr raw_commentsr|rVr<r2r=r6rs &&& renrich_reddit_item_scrs"' ((5" C  11#=L  L #  uuVR t99 e 11gq 1x-EE+r* :C*9+6  U QUU=EYEYE++AEE-,@A_c f DJ tDz ;   &5tDD  ^## QUU7A& AEE&M aeeHb) quuY+ 155# %   8 ED  Kr)N)r))Nr)r)rrdtypingrrrr urllib.parserr9rrr Exceptionrr,rMr`rurrrrrrsS ,,!$ 9 !H6r#&/d=@==r