Commit Graph
14960 Commits
Author SHA1 Message Date
Brandon Thomas 3786a64eb1 text splitting 2023-02-13 03:49:01 -05:00
Brandon Thomas cc6cf0d6c0 "add dragon", as old colleagues would say
Maybe one day we can afford to buy Nintendo. (That's crazy.)
2023-02-12 22:53:56 -05:00
Brandon Thomas 144df6ffc0 refactor to make llm rendition a part of production flow 2023-02-12 17:52:18 -05:00
Brandon Thomas 85e0ce4b4a Greenlighting stories + production workflow (abstract, but will use) 2023-02-12 15:54:26 -05:00
Brandon Thomas 107d11f0f9 Analysis of paying subscribers 2023-02-12 02:40:11 -05:00
Brandon Thomas 7efb65ae08 new tables 2023-02-10 21:26:14 -05:00
Brandon Thomas ba3ff9768a WIP - tables for stories 2023-02-10 06:28:55 -05:00
Brandon Thomas b8e37d2e77 mark jobs done 2023-02-10 03:49:45 -05:00
Brandon Thomas 5a1e61b692 add some filters 2023-02-10 01:16:51 -05:00
Brandon Thomas 19b57b9c1d unused module 2023-02-10 00:41:57 -05:00
Brandon Thomas eabe30c2bc Merge pull request #180 from storytold/bflat-fy-superbowl-rebased
superbowl images
2023-02-09 15:59:44 -05:00
BFlat 28c305d141 superbowl images 2023-02-09 15:58:09 -05:00
Brandon Thomas 3974721325 fix build errors 2023-02-09 15:47:09 -05:00
Brandon Thomas f310aa6165 change up social media 2023-02-09 15:46:49 -05:00
Brandon Thomas 6c33c31289 skip CNN video content 2023-02-08 05:13:45 -05:00
Brandon Thomas b1bbfe21ec OpenAI API calls 2023-02-08 03:36:41 -05:00
Brandon Thomas 5878224f7e rendition schema 2023-02-07 22:40:35 -05:00
Brandon Thomas 5497b7c0aa small refactor 2023-02-07 18:54:23 -05:00
Brandon Thomas bc58b50408 shared title/image extractors 2023-02-07 17:50:58 -05:00
Brandon Thomas ce17a3e1bf CNN articles, shared extractors 2023-02-07 17:13:07 -05:00
Brandon Thomas b8fe3a0e7d fix pagination bugs 2023-02-07 03:04:04 -05:00
Brandon Thomas d41cec6c90 cleanup log spam 2023-02-07 02:24:44 -05:00
Brandon Thomas 6a86f43a92 scraping appears to work 2023-02-07 02:18:00 -05:00
Brandon Thomas 65a7a46914 finish refactoring macros 2023-02-06 23:53:19 -05:00
Brandon Thomas 31eafed60d refactor database enum macros 2023-02-06 23:51:30 -05:00
Brandon Thomas 6abbbaae01 list query, enum macros for web_scraping_targets (sqlite) 2023-02-06 23:46:22 -05:00
Brandon Thomas 82efbf4d1f update docs 2023-02-06 22:10:12 -05:00
Brandon Thomas b1cefa66d5 docs about windows setup 2023-02-06 22:09:03 -05:00
Brandon Thomas 7f5f578abd ignore this mess 2023-02-06 21:58:47 -05:00
Brandon Thomas 0c574c31d6 update path 2023-02-06 18:42:31 -05:00
Brandon Thomas 393bc084d4 scope aichatbot to sqlite 2023-02-06 18:38:33 -05:00
Brandon Thomas 035faa0561 update launch script 2023-02-06 17:56:32 -05:00
Brandon Thomas 84e2bcd2c3 sqlite library for windows 2023-02-06 16:37:12 -05:00
Brandon Thomas bc69ecbda5 start script for windows 2023-02-06 16:17:16 -05:00
Brandon Thomas 5f35323a5f fixes for windows 2023-02-06 16:14:24 -05:00
Brandon Thomas 30c9f779bd outline remaining work 2023-02-06 05:00:32 -05:00
Brandon Thomas 4f7d03a505 index cnn + techcrunch 2023-02-06 04:56:49 -05:00
Brandon Thomas 5a031b1b80 indexer flow 2023-02-06 04:49:28 -05:00
Brandon Thomas d1b6facd95 worker threads 2023-02-06 04:46:10 -05:00
Brandon Thomas 79984058c0 Save webpage and scraping summary 2023-02-06 03:56:51 -05:00
Brandon Thomas adc52cd01e directory to persist html 2023-02-06 03:32:07 -05:00
Brandon Thomas aad257a1b2 fully refactor "hashing" out of container_common 2023-02-06 03:18:53 -05:00
Brandon Thomas b8d5a1fad1 hashing refactor 2023-02-06 03:06:01 -05:00
Brandon Thomas f757b94eaf refactor "hashing" 2023-02-06 03:02:23 -05:00
Brandon Thomas 8ff2408cbf begin to work on persisting scraping 2023-02-06 02:47:21 -05:00
Brandon Thomas a5eaceaba8 Merge pull request #179 from storytold/bflat-fy-tts-update
big update
2023-02-05 22:51:39 -05:00
Brandon Thomas 01fa2f8d67 serde 2023-02-05 17:35:44 -05:00
Brandon Thomas 25b7024655 title, more fields 2023-02-05 17:32:29 -05:00
Brandon Thomas f7b8423623 techcrunch parsing sort of works 2023-02-05 16:29:17 -05:00
BFlat 04b7261c97 w2l page 2023-02-05 22:56:52 +07:00