Commit Graph
14891 Commits
Author SHA1 Message Date
Brandon Thomas ce17a3e1bf CNN articles, shared extractors 2023-02-07 17:13:07 -05:00
Brandon Thomas b8fe3a0e7d fix pagination bugs 2023-02-07 03:04:04 -05:00
Brandon Thomas d41cec6c90 cleanup log spam 2023-02-07 02:24:44 -05:00
Brandon Thomas 6a86f43a92 scraping appears to work 2023-02-07 02:18:00 -05:00
Brandon Thomas 65a7a46914 finish refactoring macros 2023-02-06 23:53:19 -05:00
Brandon Thomas 31eafed60d refactor database enum macros 2023-02-06 23:51:30 -05:00
Brandon Thomas 6abbbaae01 list query, enum macros for web_scraping_targets (sqlite) 2023-02-06 23:46:22 -05:00
Brandon Thomas 82efbf4d1f update docs 2023-02-06 22:10:12 -05:00
Brandon Thomas b1cefa66d5 docs about windows setup 2023-02-06 22:09:03 -05:00
Brandon Thomas 7f5f578abd ignore this mess 2023-02-06 21:58:47 -05:00
Brandon Thomas 0c574c31d6 update path 2023-02-06 18:42:31 -05:00
Brandon Thomas 393bc084d4 scope aichatbot to sqlite 2023-02-06 18:38:33 -05:00
Brandon Thomas 035faa0561 update launch script 2023-02-06 17:56:32 -05:00
Brandon Thomas 84e2bcd2c3 sqlite library for windows 2023-02-06 16:37:12 -05:00
Brandon Thomas bc69ecbda5 start script for windows 2023-02-06 16:17:16 -05:00
Brandon Thomas 5f35323a5f fixes for windows 2023-02-06 16:14:24 -05:00
Brandon Thomas 30c9f779bd outline remaining work 2023-02-06 05:00:32 -05:00
Brandon Thomas 4f7d03a505 index cnn + techcrunch 2023-02-06 04:56:49 -05:00
Brandon Thomas 5a031b1b80 indexer flow 2023-02-06 04:49:28 -05:00
Brandon Thomas d1b6facd95 worker threads 2023-02-06 04:46:10 -05:00
Brandon Thomas 79984058c0 Save webpage and scraping summary 2023-02-06 03:56:51 -05:00
Brandon Thomas adc52cd01e directory to persist html 2023-02-06 03:32:07 -05:00
Brandon Thomas aad257a1b2 fully refactor "hashing" out of container_common 2023-02-06 03:18:53 -05:00
Brandon Thomas b8d5a1fad1 hashing refactor 2023-02-06 03:06:01 -05:00
Brandon Thomas f757b94eaf refactor "hashing" 2023-02-06 03:02:23 -05:00
Brandon Thomas 8ff2408cbf begin to work on persisting scraping 2023-02-06 02:47:21 -05:00
Brandon Thomas a5eaceaba8 Merge pull request #179 from storytold/bflat-fy-tts-update
big update
2023-02-05 22:51:39 -05:00
Brandon Thomas 01fa2f8d67 serde 2023-02-05 17:35:44 -05:00
Brandon Thomas 25b7024655 title, more fields 2023-02-05 17:32:29 -05:00
Brandon Thomas f7b8423623 techcrunch parsing sort of works 2023-02-05 16:29:17 -05:00
BFlat 04b7261c97 w2l page 2023-02-05 22:56:52 +07:00
BFlat f662560017 update 2023-02-05 22:36:34 +07:00
BFlat c941f10fdb updates 2023-02-05 22:14:21 +07:00
BFlat 328872e73c comments clean up 2023-02-05 21:35:31 +07:00
BFlat 70d93140e7 made page header reusable 2023-02-05 21:34:34 +07:00
BFlat 3d8b694123 navbar icon and fix 2023-02-05 20:59:59 +07:00
BFlat 645b5cb78e remove unwanted space at the bottom of page 2023-02-05 20:45:12 +07:00
BFlat 563c5984e4 waveform icon 2023-02-05 20:26:36 +07:00
Brandon Thomas 0c384328dd Merge pull request #178 from storytold/bflat-fy-tts-update
fixed padding/title
2023-02-05 06:24:25 -05:00
BFlat bf4e5d1940 fixes 2023-02-05 18:10:13 +07:00
Brandon Thomas 0f99360c20 the guardian 2023-02-05 05:54:25 -05:00
Brandon Thomas fe606c1610 three techcrunch feeds 2023-02-05 05:28:39 -05:00
Brandon Thomas 201481f969 handle TechCrunch venture feed 2023-02-05 05:24:54 -05:00
Brandon Thomas 83e22750ad Merge pull request #177 from storytold/bflat-fy-tts-update
TTS page style update
2023-02-05 05:24:00 -05:00
BFlat 9d80028920 padding fix 2023-02-05 17:20:01 +07:00
BFlat 23a052480c TTS page style update 2023-02-05 17:16:43 +07:00
Brandon Thomas 665cd83739 techcrunch scraping of RSS feed 2023-02-05 05:12:42 -05:00
Brandon Thomas eefe48f8ca CNN candidate articles via RSS + Sqlite inserts 2023-02-05 05:02:13 -05:00
Brandon Thomas a1c5ef6eb2 add sqlite columns, move database 2023-02-05 03:44:02 -05:00
Brandon Thomas c2e0321ffe Merge pull request #176 from storytold/bflat-fy-landing-edit
landing update
2023-02-05 03:38:52 -05:00