Commit Graph
14960 Commits
Author SHA1 Message Date
Brandon Thomas 15570be82d Inputs and tensors appear to be correct - now need to get data/dims 2019-12-11 02:42:33 -05:00
Brandon Thomas dd9362352e Add 2nd binary to load tacotron (Keith Ito) model 2019-12-11 01:16:29 -05:00
Brandon Thomas dee59f5f4c Add 2nd binary for tacotron 2019-12-10 23:59:50 -05:00
Brandon Thomas 32a54e395d record before (or right during) activating edge.
This keeps the beginning audio segment from being choppy.
2019-11-08 03:24:15 -05:00
Brandon Thomas 354c6a7261 Move sidecar out to own module 2019-11-08 02:29:12 -05:00
Brandon Thomas 37d8c9ec85 Move CPAL mic/speaker into new module 2019-11-08 01:56:57 -05:00
Brandon Thomas 16639c7bed README multi-gpu, CycleGAN sample rate cleanup 2019-11-08 01:23:30 -05:00
Brandon Thomas 7f325513fb This is almost realtime and should work in conversation 2019-10-21 04:11:03 -04:00
Brandon Thomas 89d3ae6362 heuristic for pausing the mic 2019-10-21 04:08:09 -04:00
Brandon Thomas ed05ab1551 well, this is as best as the model does so far... 2019-10-21 03:37:08 -04:00
Brandon Thomas fe5e15f206 This sounds good coming back down the pipe... 2019-10-21 03:23:01 -04:00
Brandon Thomas 21bc256478 This might be right up until sending back. Might just need an upsample!
Original audio - sounds good
Downsampled audio - sounds good
Model output - sounds good (might even be closer to trump, didn't test
enough)

Voder audio - squeaky. needs upsample probably
2019-10-21 03:18:02 -04:00
Brandon Thomas 4155fa4e36 this is a good shape for debugging 2019-10-21 03:12:26 -04:00
Brandon Thomas f096ae07bf Changing proto schema. Degradation in quality.
I had something really close. That might not have found it into a
commit between now and the last commit :(
2019-10-21 02:58:05 -04:00
Brandon Thomas af20a57e8a THIS EVALUATES THE MODEL IN REALTIME +3-6sec delay
Still doesn't sound right. Probably a sample rate issue.
2019-10-20 03:10:21 -04:00
Brandon Thomas d63007ac9f Experimenting - trying to figure out why audio sounds so bad 2019-10-20 02:50:18 -04:00
Brandon Thomas 7e33d9c7ca Add my demo_server.py implementation from CycleGAN 2019-10-20 02:18:51 -04:00
Brandon Thomas b38c96ae2f Protobufs UP and DOWN. Sounds great! 2019-10-20 02:04:41 -04:00
Brandon Thomas 05b703068a THIS SOUNDS FANTASTIC (no transform yet, 1:1 audio) 2019-10-20 01:51:55 -04:00
Brandon Thomas 6df1e8b072 Two way works over protobuf! Woo! This will be so much better... 2019-10-20 01:36:12 -04:00
Brandon Thomas dc9983e45b Protos in python 2019-10-20 01:17:25 -04:00
Brandon Thomas 45a8dc446e Better proto pipeline 2019-10-20 00:48:18 -04:00
Brandon Thomas 1ae8aafd5a Add protos. Temporarily commented out TensorFlow pieces 2019-10-20 00:38:04 -04:00
Brandon Thomas 47022cdeeb Copy relevant CycleGAN code here.
master @ 1ca8b078c12d915bca1f57e822859fa20bd439c8
Date:   Tue Oct 15 10:50:12 2019 -0400
2019-10-20 00:11:53 -04:00
Brandon Thomas 7c3f3255b0 STUPID VEC POP WAS THE ISSUE 2019-10-15 02:59:16 -04:00
Brandon Thomas 4b956e594f get rid of unneeded loop 2019-10-15 02:45:18 -04:00
Brandon Thomas 86900188d8 super direct round trip 2019-10-15 01:49:38 -04:00
Brandon Thomas 708a728b85 simple audio roundtrip 2019-10-15 01:41:24 -04:00
Brandon Thomas de07378bcb cleanup! 2019-10-15 01:20:37 -04:00
Brandon Thomas 7916f7c307 this inquires about processed buffer length 2019-10-15 00:55:12 -04:00
Brandon Thomas a6ac91331e whellp, there's the data round trip. This is bad 2019-10-15 00:35:34 -04:00
Brandon Thomas ff0a7d7922 sending successfully 2019-10-14 20:00:21 -04:00
Brandon Thomas 6464e6344d fix formatting 2019-10-14 19:18:21 -04:00
Brandon Thomas 9f11012252 add CPAL 2019-10-14 19:14:47 -04:00
Brandon Thomas 8f611958a3 sending more data is better 2019-10-13 22:20:10 -04:00
Brandon Thomas 6d928fa7ec cleanup speaker/mic 2019-10-13 21:49:23 -04:00
Brandon Thomas 64e4018640 This works with large byte buffers! Sidecar reconstitutes the audio 2019-10-13 21:42:32 -04:00
Brandon Thomas 592bebe823 drained send 2019-10-13 21:35:43 -04:00
Brandon Thomas 089aab7930 move model stuff to new file 2019-10-13 21:23:11 -04:00
Brandon Thomas 58cfbef65e sending audio, but still very broken 2019-10-13 20:51:18 -04:00
Brandon Thomas e88cc5ff24 ZeroMQ IPC (first steps) 2019-10-13 00:41:46 -04:00
Brandon Thomas 08d7fc6797 zeromq 2019-10-12 23:21:37 -04:00
Brandon Thomas 41e9e45fe7 start work on synthesis 2019-10-11 01:58:39 -04:00
Brandon Thomas af2f5ba68e Modify readme 2019-10-11 00:21:54 -04:00
Brandon Thomas cd6b5a37fd change how dep override is declared 2019-09-30 01:43:44 -04:00
Brandon Thomas a66a084a84 same dimensions for input! 2019-09-23 20:02:00 -04:00
Brandon Thomas 3cd90ded8b more OO 2019-09-23 01:42:25 -04:00
Brandon Thomas 5cc533061e This returns a tensor... 2019-09-23 01:25:47 -04:00
Brandon Thomas 2377494231 Getting closer... 2019-09-23 01:23:30 -04:00
Brandon Thomas b9bb56085e this works with the model 2019-09-23 01:18:55 -04:00