+ iGJ hRt^RIt^RIt^RIHt^RIHtHt^RIHtH t H t H t H t ^RI t^RIHtRtRR^R ^R ^R R /R R^R ^R ^R R/RR^R ^R ^R R//t]!0RkRkRkRkRkRkRkRkRkRkRkRkRkRkRkRkR kR!kR"kR#kR$kR%kR&kR'kR(kR)kR*kR+kR,kR-kR.kR/kR0kR1kR2kR3kR4kR5kR6kR7kR8kR9k4tR:R;ltR<R=ltR>R?ltR@RAlt]!0RXm4tRYRBRClltRDREltRZRFRGlltR[RHRIlltR[RJRKlltRLRMlt RNROlt!R\RPRQllt"R]RRRSllt#R\RTRUllt$RVRWlt%R# ]dRtELi;i)^aReddit search via ScrapeCreators API for /last30days. Uses ScrapeCreators REST API to search Reddit globally, discover relevant subreddits, run targeted subreddit searches, and fetch comment trees. Replaces openai_reddit.py as the primary Reddit search backend. Falls back to openai_reddit.py if SCRAPECREATORS_API_KEY is missing but OPENAI_API_KEY is present. Requires SCRAPECREATORS_API_KEY in config (same key as TikTok + Instagram). API docs: https://scrapecreators.com/docs N)Counter)datetimetimezone)AnyDictListOptionalSet)httpz(https://api.scrapecreators.com/v1/redditquickglobal_searchessubreddit_searchescomment_enrichments timeframeweekdefaultmonthdeepbesttopgoodgreatawesomekillerlatestnewnewsupdateupdatestrendinghottestpopular practicesfeaturestipsrecommendationsadvicepromptprompts promptingmethods strategies approacheshowtotheaanforwithofinonisarewhatwhichguidetutorialusingc$V^8dQhR\/#)msgstr)formats"R/Users/bowang/.openclaw/workspace/skills/last30days-official/scripts/lib/reddit.py __annotate__rEBscc\PPRV R24\PP4R#)zLog to stderr.z [Reddit]  N)sysstderrwriteflush)r@s&rD_logrMBs-JJyR()JJrFcRV^8dQhR\R\\\3,/#)r?tokenreturn)rBr)rCs"rDrErEHs"stCH~rFcRVRR/#)z%Build ScrapeCreators request headers.z x-api-keyz Content-Typezapplication/json)rOs&rD _sc_headersrSHs U* rFc0V^8dQhR\R\/#)r?topicrPrA)rCs"rDrErEPs    rFcVP4P4p.ROpVF?pVPVR,4'gK#V\V4RP4pKA VP 4pVUu.uFqU\ 9gKVNK ppV'dRP V4MTpVPR4#uupi)zqExtract core subject from verbose query. Strips meta/research words to keep only the core product/concept name.  N?!.) zwhat are the bestzwhat is the bestzwhat are the latestzwhat are people saying aboutzwhat do people think aboutz how do i usez how to usezhow tozwhat arezwhat isztips forzbest practices for)lowerstrip startswithlensplit NOISE_WORDSjoinrstrip)rUtextprefixespwordswfilteredresults& rD_extract_core_subjectrhPs ;;=   DH  ??1s7 # #A=&&(D JJLE 95a[$85H9#+SXXh F == :s < C CcRV^8dQhR\R\R\\,/#)r?rUdepthrP)rBr)rCs"rDrErEis%ST#YrFcp\V4pV.pVP4PR4pVP4VP48wd0\ VP 44^8:dVP V4VR9dVP V R24VR8XdVP V R24V#)aAGenerate multiple Reddit search queries from a topic. Uses local logic (no LLM call needed): 1. Extract core subject (strip noise words) 2. Include original topic if different from core 3. For default/deep: add casual/review variant 4. For deep: add problem/issues variant Returns 1-4 query strings depending on depth. rXrz worth it OR thoughts OR reviewz$ issues OR problems OR bug OR broken)rr)rhrZr`rYr\r]append)rUrjcorequeriesoriginal_cleans&& rDexpand_reddit_queriesrpis ! 'DfG[[]))%0N zz|~++--#n6J6J6L2MQR2R~& ##$>?@ $CDE NrFc V^8dQhR\\\\3,,R\R\R\\,/#)r?resultsrUmax_subsrP)rrrBrint)rCs"rDrErEsA.<.< $sCx. !.< .<.< #Y .&discover_subreddits..s!OjCFQJna9njs' 'TFg@g333333?upsscoreg?) rhsetrYr]rgetany UTILITY_SUBS most_common) rrrUrsrm core_wordsscorespostsubbaser}_rzs &&& @rDdiscover_subredditsrs$,1  'bD.2TZZ\'')*J YFhh{B' IIK ##OjO###OjOOO CKD  $ CKDhhuo55'1!5 39 CKD t -0%00: ;:FCC: ;; ;s! E2c:V^8dQhR\\,/#)r?rP)rrB)rCs"rDrErEs rFcV'gR#\P!\V4\PR7pVP R4# \ \\3dR#i;i)z%Convert Unix timestamp to YYYY-MM-DD.N)tzz%Y-%m-%d) r fromtimestampfloatrutcstrftime ValueError TypeErrorOSError) created_utcdts& rD _parse_datersP   # #E+$68<< H{{:&&  7 +s?A A&%A&c V^8dQhR\\\3,R\R\R\\\3,/#)r?ridx source_labelrP)rrBrrt)rCs"rDrErEs=$sCx.s#UYZ]_bZbUcrFcVPRR4pV'dRV 2MVPRR4pV'd RV9dRpRRV 2RVPRR4R \VPR R44P4RTR \VPR R44P4R \VPR 44R RVPR4;'gVPR^4RVPR^4RVPR4/RRRRV R2R\VPRR44R,/ #)z>Normalize a ScrapeCreators Reddit post to our internal format. permalinkrvzhttps://www.reddit.comurlz reddit.comidR reddit_idtitlerwdater engagementr~r} num_comments upvote_ratio relevancegffffff? why_relevantzReddit z searchselftext:NiN)rrBrZr)rrrrrs&&& rD_normalize_postrs0b)I2; "9+ .%QSATC |3& #iTXXdB'TXXgr*+113 sS+r2399; DHH]34 TXXe_<<!(< DHH^Q7 DHH^4 S',w7CR01$7 rFc V^8dQhR\R\R\R\R\\\\3,,/#)r?queryrOsortrrPrBrrr)rCs"rDrErEsG,, , , , ,  $sCx. ,rFc \'g\R4^RIHpV!RVRVRV/4p\ RV 2p\ V4p\ PVR&\ P!Wg^^R7pVPR VPR .44#\P!\ R 2RVRVRV/\ V4^R7p V P4V P4pVPR VPR .44# \dp \R T 24.uR p ? #R p ? ii;i \dp \RT 24.uR p ? #R p ? ii;i)aSearch across all of Reddit via ScrapeCreators global search. Args: query: Search query token: ScrapeCreators API key sort: Sort order (relevance, hot, top, new) timeframe: Time filter (hour, day, week, month, year, all) Returns: List of post dicts z6requests library not installed, falling back to urllib urlencoderrrz/search? User-AgentheaderstimeoutretriespostsdatazGlobal search error (urllib): Nz/searchparamsrrzGlobal search error: ) _requestsrM urllib.parserSCRAPECREATORS_BASErSr USER_AGENTr Exceptionraise_for_statusjson) rrOrrrrrrreresps &&&& rD_global_searchrsC" 9 EF  .k9UVF()&:C!%(G$(OOGL !88C"aHD88GTXXfb%9: : }}"#7 +UFD+yI&   yy{xx&"!566  1!5 6I   $QC () s=A7DA1D, D)D$D)$D), E7E E EcV^8dQhR\R\R\R\R\R\\\\3,,/#)r?rwrrOrrrPr)rCs"rDrErEsQ444 4 4  4  4  $sCx. 4rFc \'g|^RIHpV!RVRVRVRV/4p\ RV 2p\ V4p\ P VR&\ P!Wx^^R7p V PR V PR .44#\P!\ R2RVRVRVRV/\ V4^R7p V P4V P4p V PR V PR .44# \dp \R T R T 24.uR p ? #R p ? ii;i \dp \RT R T 24.uR p ? #R p ? ii;i)zSearch within a specific subreddit via ScrapeCreators. Args: subreddit: Subreddit name (without r/) query: Search query token: ScrapeCreators API key sort: Sort order timeframe: Time filter Returns: List of post dicts rrwrrrz/subreddit/search?rrrrz&Subreddit search error (urllib) for r/z: Nz/subreddit/searchrzSubreddit search error for r/ rrrrrSr rrrrMrr) rwrrOrrrrrrrrrs &&&&& rD_subreddit_searchrs_& 9  .Yk9 F)));F8DC!%(G$(OOGL !88C"aHD88GTXXfb%9: : }}"##4 5YY   &   yy{xx&"!566%  9)BqcJ KI &  ,YKr! => s=A9C= A3D(= D%D D% D%( E3E E Ec tV^8dQhR\R\R\\\\3,,/#)r?rrOrPr)rCs"rDrErEKs3&& & & $sCx.&rFc\'gv^RIHpV!RV/4p\ RV 2p\ V4p\ P VR&\ P!WE^^R7pVPRVPR.44#\P!\ R 2RV/\ V4^R 7pVP4VP4pVPRVPR.44# \dp\RT 24.uR p?#R p?ii;i \dp\R T 24.uR p?#R p?ii;i) zFetch comments for a Reddit post via ScrapeCreators. Args: url: Reddit post URL or permalink token: ScrapeCreators API key Returns: List of comment dicts with score, author, body, etc. rrz/post/comments?rrcommentsrzComment fetch error (urllib): Nz/post/commentsrzComment fetch error: r) rrOrrapi_urlrrrrs && rDfetch_post_commentsrKs( 9  .s|,F,-_VHEG!%(G$(OOGL !88Gb!LD88J(<= = }}"#> 23<&   yy{xx DHHVR$899  1!5 6I   $QC () s=A3C1A-D1 D<D DD D>$D93D>9D>cV^8dQhR\\\\3,,R\\\\3,,/#)r?rrPrrrBr)rCs"rDrErEts4d38n-$tCH~2FrFcR\4p\4p.pVFpVPRR4pVPRR4pV'd WQ9dK7V'd Wb9dKGV'dVPV4V'dVPV4VPV4K V#)z9Deduplicate posts by reddit_id, keeping first occurrence.rrvr)rraddrl)rseen_ids seen_urlsuniquerridrs& rD _dedupe_postsrtsuHI Fhh{B'hhub! 3?  3#   LL   MM#  d MrFcV^8dQhR\R\R\R\R\R\\\3,/#r?rU from_dateto_daterjrOrPrBrr)rCs"rDrErEsT^ ^ ^ ^ ^   ^  ^  #s(^ ^ rFc  V'gR.RR/#\PV\R,4pVR,p\W4p\RV R\ V4 RV 24.pVR ,p \ VR V 4FewrV ^8XdR MR p \R V ^, RV RV RV R2 4\ WWR7p \R\ V 4 R24VPV 4Kg .p\ V4F)wr\W^,R4pVPV4K+ \WVR,R7p\RV 24\V4pVR VR,Fp\RV RV R24\VVVR VR7p\R\ V4 RV 24\ V4F>wpp\V\ V4V,^,RV 24pVPV4K@ K \V4p\R\ V4 R24.p^pVFepVR ,'d-VVR ,u;8:dV8:dMMVPV4K>VR ,fVPV4K\V^, pKg V'dTpV'd\R!V R"24M\R#\ V4 24VPR$R%R&7\ V4Fwp pR'V ^, 2VR(&K \R)\ V4 R*24RV/#)+aFull Reddit search: multi-query global discovery + subreddit drill-down. This is the main entry point. Replaces openai_reddit.search_reddit(). Args: topic: Search topic from_date: Start date (YYYY-MM-DD) to_date: End date (YYYY-MM-DD) depth: 'quick', 'default', or 'deep' token: ScrapeCreators API key Returns: Dict with 'items' list and optional 'error'. itemserrorz$No SCRAPECREATORS_API_KEY configuredrrz Expanded 'z' into z queries: r NrrzGlobal search /z: 'z' (sort=))rrz -> z resultsglobalr )rUrszDiscovered subreddits: zSubreddit search: r/z for ''z results from r/zr/z After dedup: z unique postsrz Filtered z posts outside date rangez(No posts within date range, keeping all cZVPR/4PR^4;'g^#)rr~r)xs&rDsearch_reddit..s'quu\2.227A>CC!CrFTkeyreverserrzFinal: z Reddit posts) DEPTH_CONFIGrrprMr\ enumeraterextendrrlrrhrrr)rUrrrjrOconfigrrn all_raw_posts max_globalirrr all_itemsritemdiscovered_subsrmr sub_postsjin_range out_of_ranges&&&&& rD search_redditrs * W&LMM   e\)%< =F{#I$E1G:eWGCL>G9 EFM)*Jgkz231f{% ~acU!Ji(I=Y( 67HL <"- 01 Y rFc V^8dQhR\\\\3,,R\R\R\\\\3,,/#)r?rrOrjrPr)rCs"rDrErEsPKK S#X K K K $sCx. KrFcl\PV\R,4pVR,pV'd V'gV#VRVp\R\V4 R24VEFpVPRR4pV'gK \ Wq4pV'gK5.p .p \ VR,4EFWwrV PR R4p V 'dV R9dK)V PR 4;'gV PR ^4pV PR R 4pV PRR4pV'dRV 2MRpV ^8XdRMRpV P R VR\V PR44R VRV RVRV/4\V 4^8gKVR9gKV R,p\V 4^8dK\ V4F$wppVR9gKV^28gKVRV^,pM VP4R,pV P V4EKZ V PRRR7V R,VR&V R,VR&EK V#)zEnrich top items with comment data from ScrapeCreators. Args: items: Reddit items from search_reddit() token: ScrapeCreators API key depth: Depth for comment limit Returns: Items with top_comments and comment_insights added. rrNzEnriching comments for z postsrrv:N Nbody [deleted]r}r~authorrzhttps://reddit.comii,rrexcerpt:NNz.!?z...c&VPR^4#)r~r)cs&rDr&enrich_with_comments../sgq(9rFTr top_commentscomment_insights)r [removed])rr AutoModerator) rrrMr\rrrlrr`r)rrOrjr max_comments top_itemsrr raw_commentsrinsightscirrr~rr comment_url max_excerptinsightrchars&&& rDenrich_with_commentsrs  e\)%< =F/0L  m|$I "3y>"2& 9:hhub! *36   |C01EB55$D4#==EE%L55AEE'1$5EUU8[1Fk2.I>G.yk:RK"$q#cK    AEE-$89&4 -{ ! 4yB61\#\t*t9s?#,W#545=QV&-dqsmG!$6 #*.."2U":(=2B 94H+C0^#+C=  cf LrFcV^8dQhR\R\R\R\R\R\\\3,/#rr)rCs"rDrErE7sL       #s(^ rFc\WW#V4pVPR.4pV'dV'd\WdV4pWeR&V#)avFull Reddit pipeline: search + comment enrichment. This is the convenience function that does everything. Args: topic: Search topic from_date: Start date (YYYY-MM-DD) to_date: End date (YYYY-MM-DD) depth: 'quick', 'default', or 'deep' token: ScrapeCreators API key Returns: Dict with 'items' list. Items include top_comments and comment_insights. r)rrr)rUrrrjrOrgrs&&&&& rDsearch_and_enrichr7s?*5WU CF JJw #E $U59w MrFcV^8dQhR\\\3,R\\\\3,,/#)r?responserP)rrBrr)rCs"rDrErEVs/%%DcN%tDcN7K%rFc&VPR.4#)zzParse ScrapeCreators response to item list. Compatibility shim matching openai_reddit.parse_reddit_response() signature. rr)rs&rDparse_reddit_responserVs << $$rF> helpmefind findareddit findthatsong namethatsong tipofmytongue whatsthissongsubredditdramawhatisthissongwhatisthisthing)rv)r)rr)rN)r)&__doc__rerI collectionsrrrtypingrrrrr requestsr ImportErrorrvr rr frozensetr^rMrSrhrprrrrrrrrrrrrrRrFrDr*s  '11 @ 1aqV  1aqW   1aqW   ,      " $- /7     % '0   %   $          %   *       " $) +1       " $* ,3    !     2< .%AIsD$$ D10D1