Commit Graph
2812 Commits
Author SHA1 Message Date
Brandon Thomas 6a86f43a92 scraping appears to work 2023-02-07 02:18:00 -05:00
Brandon Thomas 65a7a46914 finish refactoring macros 2023-02-06 23:53:19 -05:00
Brandon Thomas 31eafed60d refactor database enum macros 2023-02-06 23:51:30 -05:00
Brandon Thomas 6abbbaae01 list query, enum macros for web_scraping_targets (sqlite) 2023-02-06 23:46:22 -05:00
Brandon Thomas 82efbf4d1f update docs 2023-02-06 22:10:12 -05:00
Brandon Thomas b1cefa66d5 docs about windows setup 2023-02-06 22:09:03 -05:00
Brandon Thomas 7f5f578abd ignore this mess 2023-02-06 21:58:47 -05:00
Brandon Thomas 0c574c31d6 update path 2023-02-06 18:42:31 -05:00
Brandon Thomas 393bc084d4 scope aichatbot to sqlite 2023-02-06 18:38:33 -05:00
Brandon Thomas 035faa0561 update launch script 2023-02-06 17:56:32 -05:00
Brandon Thomas 84e2bcd2c3 sqlite library for windows 2023-02-06 16:37:12 -05:00
Brandon Thomas bc69ecbda5 start script for windows 2023-02-06 16:17:16 -05:00
Brandon Thomas 5f35323a5f fixes for windows 2023-02-06 16:14:24 -05:00
Brandon Thomas 30c9f779bd outline remaining work 2023-02-06 05:00:32 -05:00
Brandon Thomas 4f7d03a505 index cnn + techcrunch 2023-02-06 04:56:49 -05:00
Brandon Thomas 5a031b1b80 indexer flow 2023-02-06 04:49:28 -05:00
Brandon Thomas d1b6facd95 worker threads 2023-02-06 04:46:10 -05:00
Brandon Thomas 79984058c0 Save webpage and scraping summary 2023-02-06 03:56:51 -05:00
Brandon Thomas adc52cd01e directory to persist html 2023-02-06 03:32:07 -05:00
Brandon Thomas aad257a1b2 fully refactor "hashing" out of container_common 2023-02-06 03:18:53 -05:00
Brandon Thomas b8d5a1fad1 hashing refactor 2023-02-06 03:06:01 -05:00
Brandon Thomas f757b94eaf refactor "hashing" 2023-02-06 03:02:23 -05:00
Brandon Thomas 8ff2408cbf begin to work on persisting scraping 2023-02-06 02:47:21 -05:00
Brandon Thomas 01fa2f8d67 serde 2023-02-05 17:35:44 -05:00
Brandon Thomas 25b7024655 title, more fields 2023-02-05 17:32:29 -05:00
Brandon Thomas f7b8423623 techcrunch parsing sort of works 2023-02-05 16:29:17 -05:00
Brandon Thomas 0f99360c20 the guardian 2023-02-05 05:54:25 -05:00
Brandon Thomas fe606c1610 three techcrunch feeds 2023-02-05 05:28:39 -05:00
Brandon Thomas 201481f969 handle TechCrunch venture feed 2023-02-05 05:24:54 -05:00
Brandon Thomas 665cd83739 techcrunch scraping of RSS feed 2023-02-05 05:12:42 -05:00
Brandon Thomas eefe48f8ca CNN candidate articles via RSS + Sqlite inserts 2023-02-05 05:02:13 -05:00
Brandon Thomas a1c5ef6eb2 add sqlite columns, move database 2023-02-05 03:44:02 -05:00
Brandon Thomas 2f4fe2dabc Web scraping WIP 2023-02-05 03:36:17 -05:00
Brandon Thomas d63a505b8b comments in .gitignore, aichatbot diesel configs 2023-02-05 01:41:08 -05:00
Brandon Thomas fb1bf9940e move migrations dir 2023-02-05 01:32:34 -05:00
Brandon Thomas d4de388bb6 new reserved usernames for channels 2023-02-05 01:21:57 -05:00
Brandon Thomas a0a5c68086 Project outline 2023-02-04 18:24:45 -05:00
Brandon Thomas ddb106a9af reqwest, ingestion modules (wip) 2023-02-03 23:57:12 -05:00
Brandon Thomas 7c229ba59b fix 2023-02-03 06:00:21 -05:00
Brandon Thomas d1978298f0 unixy paths 2023-02-03 05:57:41 -05:00
Brandon Thomas 1dcf06b571 fix? 2023-02-03 05:50:37 -05:00
Brandon Thomas 8af2368f32 fix? 2023-02-03 05:46:29 -05:00
Brandon Thomas 79fba33aae more debugging 2023-02-03 05:44:38 -05:00
Brandon Thomas bff0f9181d debugging 2023-02-03 05:42:27 -05:00
Brandon Thomas bd8f2570e2 report audio filename 2023-02-03 05:37:29 -05:00
Brandon Thomas 74c289b338 refactor sidecar, save dir 2023-02-03 05:17:09 -05:00
Brandon Thomas 63bb0e7253 cursor 2023-02-03 03:45:17 -05:00
Brandon Thomas 4140d07924 OpenAI API calls 2023-02-03 02:09:55 -05:00
Brandon Thomas aa03abd3b5 Merge pull request #28 from storytold/saj-unsubscribe-reason
endpoint for indicating why a user is unsubscribing
2023-02-03 01:33:54 -05:00
Paul Sajna fb8142fb49 endpoint for indicating why a user is unsubscribing 2023-02-02 22:25:00 -08:00