Commit Graph
338 Commits
Author SHA1 Message Date
Brandon Thomas 6a86f43a92 scraping appears to work 2023-02-07 02:18:00 -05:00
Brandon Thomas 6abbbaae01 list query, enum macros for web_scraping_targets (sqlite) 2023-02-06 23:46:22 -05:00
Brandon Thomas 4f7d03a505 index cnn + techcrunch 2023-02-06 04:56:49 -05:00
Brandon Thomas d1b6facd95 worker threads 2023-02-06 04:46:10 -05:00
Brandon Thomas aad257a1b2 fully refactor "hashing" out of container_common 2023-02-06 03:18:53 -05:00
Brandon Thomas b8d5a1fad1 hashing refactor 2023-02-06 03:06:01 -05:00
Brandon Thomas f757b94eaf refactor "hashing" 2023-02-06 03:02:23 -05:00
Brandon Thomas 8ff2408cbf begin to work on persisting scraping 2023-02-06 02:47:21 -05:00
Brandon Thomas 01fa2f8d67 serde 2023-02-05 17:35:44 -05:00
Brandon Thomas 25b7024655 title, more fields 2023-02-05 17:32:29 -05:00
Brandon Thomas f7b8423623 techcrunch parsing sort of works 2023-02-05 16:29:17 -05:00
Brandon Thomas 0f99360c20 the guardian 2023-02-05 05:54:25 -05:00
Brandon Thomas fe606c1610 three techcrunch feeds 2023-02-05 05:28:39 -05:00
Brandon Thomas 201481f969 handle TechCrunch venture feed 2023-02-05 05:24:54 -05:00
Brandon Thomas 665cd83739 techcrunch scraping of RSS feed 2023-02-05 05:12:42 -05:00
Brandon Thomas eefe48f8ca CNN candidate articles via RSS + Sqlite inserts 2023-02-05 05:02:13 -05:00
Brandon Thomas 2f4fe2dabc Web scraping WIP 2023-02-05 03:36:17 -05:00
Brandon Thomas a0a5c68086 Project outline 2023-02-04 18:24:45 -05:00
Brandon Thomas bd8f2570e2 report audio filename 2023-02-03 05:37:29 -05:00
Paul Sajna fb8142fb49 endpoint for indicating why a user is unsubscribing 2023-02-02 22:25:00 -08:00
Brandon Thomas 2b50d2bce5 new lib: actix_helpers (RouteBuilder), --gui, etc. 2023-02-02 15:33:01 -05:00
Brandon Thomas 02d7495e54 kick this can down the road _again_ 2023-02-02 00:43:59 -05:00
Brandon Thomas a0da010dab Add model ratings to TTS list and get endpoints 2023-01-26 01:12:20 -05:00
Brandon Thomas 74ff632f4d update TTS statistics on model rate 2023-01-26 01:12:20 -05:00
Brandon Thomas 22e8a14170 Fix build errors and mistakes with user ratings 2023-01-25 16:24:44 -05:00
Brandon Thomas b6fce130b5 GET and POST endpoints for user ratings 2023-01-25 16:08:22 -05:00
Brandon Thomas 1bb0dda330 Rating type instead of bool, upsert query, enums 2023-01-25 02:33:56 -05:00
Brandon Thomas d46778569c Add Arabic and Turkish language support (serverside) 2023-01-20 03:25:17 -05:00
Brandon Thomas f3c34d9a7b Trending voices / job 2023-01-17 05:49:23 -05:00
Brandon Thomas 77e16d4bd8 synthetic categories 2023-01-16 04:21:19 -05:00
Brandon Thomas 58c7695a2a Refactor enums 2023-01-16 01:56:38 -05:00
Brandon Thomas 9015efdf9e real world language header test 2023-01-14 20:20:41 -05:00
Brandon Thomas 623b82dd0e fix accept-language for q-factor 2023-01-14 06:54:34 -05:00
Brandon Thomas 9fbafd7fcd sqlx 0.4.x -> 0.6.x 2023-01-14 06:39:28 -05:00
Brandon Thomas 8755e7a533 generic inference job queries 2023-01-11 00:33:40 -05:00
Brandon Thomas 9f873c33e7 Begin refactor of generic inference-job 2023-01-11 00:33:40 -05:00
Brandon Thomas 81302d0e1d Payload for voice conversion inference records 2023-01-11 00:33:40 -05:00
Brandon Thomas 9e589c2b72 Refactor - db enum types into enums crate 2023-01-11 00:33:40 -05:00
Brandon Thomas 7a33c0721a enqueue webvc inference work 2023-01-11 00:33:40 -05:00
Brandon Thomas e1793d71b5 enqueue voice conversion request handler, media synthetic ids, ... 2023-01-11 00:33:40 -05:00
Brandon Thomas 77e1319b81 'crockford' crate, use crockford entropy for bucket 2023-01-11 00:33:40 -05:00
Brandon Thomas 8061880a83 consolidate upload handling, use new bucket paths 2023-01-11 00:33:40 -05:00
Brandon Thomas 651ed42b64 New 'buckets' crate for cloud storage uploads 2023-01-11 00:33:40 -05:00
Brandon Thomas e870d6f4de rename storage_buckets_common crate -> cloud_storage 2023-01-11 00:33:40 -05:00
Brandon Thomas 16a2e765ca Handle video formats, too 2023-01-11 00:33:40 -05:00
Brandon Thomas ee7626602a Calculate duration for audio files without metadata 2023-01-11 00:33:40 -05:00
Brandon Thomas 533cd5e051 Tests + test data for media uploads 2023-01-11 00:33:40 -05:00
Brandon Thomas f2bfcfeb75 audio codec/encoding 2023-01-11 00:33:40 -05:00
Brandon Thomas 603a678378 new errors crate, cleanup media duration calculation 2023-01-11 00:33:40 -05:00
Brandon Thomas 1ba3215881 organize media/files crates 2023-01-11 00:33:40 -05:00