Brandon Thomas
15570be82d
Inputs and tensors appear to be correct - now need to get data/dims
2019-12-11 02:42:33 -05:00
Brandon Thomas
dd9362352e
Add 2nd binary to load tacotron (Keith Ito) model
2019-12-11 01:16:29 -05:00
Brandon Thomas
dee59f5f4c
Add 2nd binary for tacotron
2019-12-10 23:59:50 -05:00
Brandon Thomas
32a54e395d
record before (or right during) activating edge.
...
This keeps the beginning audio segment from being choppy.
2019-11-08 03:24:15 -05:00
Brandon Thomas
354c6a7261
Move sidecar out to own module
2019-11-08 02:29:12 -05:00
Brandon Thomas
37d8c9ec85
Move CPAL mic/speaker into new module
2019-11-08 01:56:57 -05:00
Brandon Thomas
16639c7bed
README multi-gpu, CycleGAN sample rate cleanup
2019-11-08 01:23:30 -05:00
Brandon Thomas
7f325513fb
This is almost realtime and should work in conversation
2019-10-21 04:11:03 -04:00
Brandon Thomas
89d3ae6362
heuristic for pausing the mic
2019-10-21 04:08:09 -04:00
Brandon Thomas
ed05ab1551
well, this is as best as the model does so far...
2019-10-21 03:37:08 -04:00
Brandon Thomas
fe5e15f206
This sounds good coming back down the pipe...
2019-10-21 03:23:01 -04:00
Brandon Thomas
21bc256478
This might be right up until sending back. Might just need an upsample!
...
Original audio - sounds good
Downsampled audio - sounds good
Model output - sounds good (might even be closer to trump, didn't test
enough)
Voder audio - squeaky. needs upsample probably
2019-10-21 03:18:02 -04:00
Brandon Thomas
4155fa4e36
this is a good shape for debugging
2019-10-21 03:12:26 -04:00
Brandon Thomas
f096ae07bf
Changing proto schema. Degradation in quality.
...
I had something really close. That might not have found it into a
commit between now and the last commit :(
2019-10-21 02:58:05 -04:00
Brandon Thomas
af20a57e8a
THIS EVALUATES THE MODEL IN REALTIME +3-6sec delay
...
Still doesn't sound right. Probably a sample rate issue.
2019-10-20 03:10:21 -04:00
Brandon Thomas
d63007ac9f
Experimenting - trying to figure out why audio sounds so bad
2019-10-20 02:50:18 -04:00
Brandon Thomas
7e33d9c7ca
Add my demo_server.py implementation from CycleGAN
2019-10-20 02:18:51 -04:00
Brandon Thomas
b38c96ae2f
Protobufs UP and DOWN. Sounds great!
2019-10-20 02:04:41 -04:00
Brandon Thomas
05b703068a
THIS SOUNDS FANTASTIC (no transform yet, 1:1 audio)
2019-10-20 01:51:55 -04:00
Brandon Thomas
6df1e8b072
Two way works over protobuf! Woo! This will be so much better...
2019-10-20 01:36:12 -04:00
Brandon Thomas
dc9983e45b
Protos in python
2019-10-20 01:17:25 -04:00
Brandon Thomas
45a8dc446e
Better proto pipeline
2019-10-20 00:48:18 -04:00
Brandon Thomas
1ae8aafd5a
Add protos. Temporarily commented out TensorFlow pieces
2019-10-20 00:38:04 -04:00
Brandon Thomas
47022cdeeb
Copy relevant CycleGAN code here.
...
master @ 1ca8b078c12d915bca1f57e822859fa20bd439c8
Date: Tue Oct 15 10:50:12 2019 -0400
2019-10-20 00:11:53 -04:00
Brandon Thomas
7c3f3255b0
STUPID VEC POP WAS THE ISSUE
2019-10-15 02:59:16 -04:00
Brandon Thomas
4b956e594f
get rid of unneeded loop
2019-10-15 02:45:18 -04:00
Brandon Thomas
86900188d8
super direct round trip
2019-10-15 01:49:38 -04:00
Brandon Thomas
708a728b85
simple audio roundtrip
2019-10-15 01:41:24 -04:00
Brandon Thomas
de07378bcb
cleanup!
2019-10-15 01:20:37 -04:00
Brandon Thomas
7916f7c307
this inquires about processed buffer length
2019-10-15 00:55:12 -04:00
Brandon Thomas
a6ac91331e
whellp, there's the data round trip. This is bad
2019-10-15 00:35:34 -04:00
Brandon Thomas
ff0a7d7922
sending successfully
2019-10-14 20:00:21 -04:00
Brandon Thomas
6464e6344d
fix formatting
2019-10-14 19:18:21 -04:00
Brandon Thomas
9f11012252
add CPAL
2019-10-14 19:14:47 -04:00
Brandon Thomas
8f611958a3
sending more data is better
2019-10-13 22:20:10 -04:00
Brandon Thomas
6d928fa7ec
cleanup speaker/mic
2019-10-13 21:49:23 -04:00
Brandon Thomas
64e4018640
This works with large byte buffers! Sidecar reconstitutes the audio
2019-10-13 21:42:32 -04:00
Brandon Thomas
592bebe823
drained send
2019-10-13 21:35:43 -04:00
Brandon Thomas
089aab7930
move model stuff to new file
2019-10-13 21:23:11 -04:00
Brandon Thomas
58cfbef65e
sending audio, but still very broken
2019-10-13 20:51:18 -04:00
Brandon Thomas
e88cc5ff24
ZeroMQ IPC (first steps)
2019-10-13 00:41:46 -04:00
Brandon Thomas
08d7fc6797
zeromq
2019-10-12 23:21:37 -04:00
Brandon Thomas
41e9e45fe7
start work on synthesis
2019-10-11 01:58:39 -04:00
Brandon Thomas
af2f5ba68e
Modify readme
2019-10-11 00:21:54 -04:00
Brandon Thomas
cd6b5a37fd
change how dep override is declared
2019-09-30 01:43:44 -04:00
Brandon Thomas
a66a084a84
same dimensions for input!
2019-09-23 20:02:00 -04:00
Brandon Thomas
3cd90ded8b
more OO
2019-09-23 01:42:25 -04:00
Brandon Thomas
5cc533061e
This returns a tensor...
2019-09-23 01:25:47 -04:00
Brandon Thomas
2377494231
Getting closer...
2019-09-23 01:23:30 -04:00
Brandon Thomas
b9bb56085e
this works with the model
2019-09-23 01:18:55 -04:00