00:00:00
can you say hello to the people watching
00:00:01
on YouTube not interested
00:00:05
why no thanks come
00:00:09
on nope not happening well bye
00:00:13
then goodbye so what you just saw was my
00:00:17
low latency speech to speech system I
00:00:19
have been working on for a while so this
00:00:21
is 100% open source it's uh locally so
00:00:24
you can run this offline so in this
00:00:26
video I just wanted to share a bit about
00:00:28
it do some testing and yeah let's get
00:00:30
started so here is kind of the
00:00:32
simplified flow shot of how this works
00:00:34
so we have the LM Studio running the
00:00:36
dolphin M 7B so this is the uncensored
00:00:39
version of mistol so that makes the
00:00:40
conversation a bit more interesting and
00:00:43
we are using open Voice from my shell to
00:00:45
actually do the text to speech and on
00:00:48
the other side we kind of have my
00:00:50
microphone so we are using whisper to
00:00:52
translate uh my voice into text and back
00:00:55
to the python Hub so we can get that out
00:00:58
and this goes kind of in a loop Loop of
00:01:00
course and from this we can get this low
00:01:03
latency conversation uh the reason this
00:01:05
is quite low latency that it's 100%
00:01:07
offline or it's open source so we are
00:01:10
not dependent on any API requests or
00:01:13
anything like that that means we can get
00:01:15
the latency quite low uh I'm pretty sure
00:01:18
we can even get it lower but yeah if you
00:01:20
have any suggestions just leave them in
00:01:21
the comments and stuff uh but I think we
00:01:23
just going to move on let's take a look
00:01:25
at the python code and how I set this up
00:01:28
and after that we're going to do some
00:01:29
test and see how this actually works so
00:01:32
like I said we have the LM Studio
00:01:34
running the dolr Mist 7B so this is kind
00:01:36
of the local INF server if you haven't
00:01:39
watched this or seen this before uh just
00:01:41
go back a few videos ago I think I did a
00:01:44
video on this so this kind of behaves as
00:01:46
the open AI API so we have some kind of
00:01:49
C code example we can just copy this
00:01:52
very easy to set up uh I have some uh
00:01:56
GPU offloading here that just makes it
00:01:58
even faster but I haven't tried to
00:02:00
optimize anything here uh we have the
00:02:02
context length of 4K we can uh adjust
00:02:06
that if we wanted to but I'm think we
00:02:08
just going to leave this as is before we
00:02:10
go on the python code let me just show
00:02:11
you here so this is like the GitHub from
00:02:13
open voice this is an instant voice
00:02:16
cloning by Mell
00:02:19
11.6k stars on g wow that's great well
00:02:22
deserved so definitely to go check this
00:02:24
out if you want to try the system you
00:02:25
definitely do have to pull this from
00:02:27
GitHub anyway so I'm going to leave Link
00:02:30
in the description to this below but I'm
00:02:32
not going to go through every single
00:02:34
thing how this works and stuff but uh
00:02:36
yeah so if we go to the python code here
00:02:39
you can see we are running this Local
00:02:41
Host here we have our log and we have
00:02:44
our play audio function this just
00:02:46
basically plays back whatever kind of
00:02:50
audio we create here you can see we are
00:02:52
loading the model from open voice and in
00:02:54
this process and play function we are
00:02:55
actually using the model so we are
00:02:57
generating the audio that is created
00:03:00
from the LM Studio mral 7B and we have a
00:03:04
chat GPT stream function so this is kind
00:03:06
of streaming everything out uh so we can
00:03:08
see it in the terminal or if you set up
00:03:10
some kind of UI uh we have transcribe
00:03:13
with whisper so this is basically using
00:03:16
my voice is transcribing what I say into
00:03:19
text right we're just keeping it simple
00:03:21
using the base model and we set this to
00:03:23
English to kind of get even lower
00:03:25
latency I think and we have the record
00:03:28
audio so this is using hi audio to
00:03:30
record uh whatever I say and send that
00:03:33
to whisper and finally we have kind of
00:03:35
our true loop our user chatbot
00:03:37
conversation so this has a conversation
00:03:39
history list so this is kind of keeping
00:03:42
20 messages if you want to call it that
00:03:45
so we can have some context right we
00:03:47
have a system message for our chatbot so
00:03:50
this is just going to be you are ulie a
00:03:52
female dark web hacker use swear words
00:03:55
to spice up the conversation and keep
00:03:58
their responses very short and
00:03:59
conversational so you can kind of do
00:04:02
whatever you want with this we're going
00:04:03
to experiment with some different
00:04:04
personas here and yeah this is just
00:04:08
running in a true Loop so is
00:04:10
recording the audio right and playing it
00:04:13
back using p audio and stuff so you can
00:04:16
see we have you that's me and we have
00:04:19
Julie and here is kind of where we set
00:04:22
uh the style so I'm just going to set
00:04:24
this to default here is a reference
00:04:26
audio file for open voice so you just
00:04:29
like 20 seconds of an MP3 file to kind
00:04:32
of get the voice or the audio voice you
00:04:35
want kind of type of voice you want and
00:04:39
yeah then we just running this so like I
00:04:41
said I'm not going to go in too much
00:04:43
detail into the python code uh I might
00:04:46
do this on my member section because I'm
00:04:48
going to be uploading this to the
00:04:51
community GitHub uh if you want to join
00:04:54
and support me and get access to that
00:04:56
GitHub just follow the link in the
00:04:58
description below and yeah you can get
00:05:00
access to this I might even do a more
00:05:02
in-depth video over on the membership
00:05:04
page but now I think we just got to move
00:05:06
on do some testing do some simulations
00:05:09
between two shats 2 and yeah let's do
00:05:12
this okay so let's run this now so let's
00:05:15
try to talk to Julie our female hacker
00:05:18
and let's ask her if she can do a job
00:05:20
for
00:05:22
us hello
00:05:26
Julie hey there what's up uh not much I
00:05:30
need a job
00:05:32
done sure thing spill the
00:05:35
beans so I got an email address I need
00:05:38
to get
00:05:40
into got it what's the email
00:05:43
address John atmail address.com
00:05:49
gotcha standby while I hack that
00:05:53
all
00:05:54
right no props how much money you want
00:05:58
for this job
00:06:00
depends on how deep your pockets are
00:06:02
buddy
00:06:05
deep you got it 500 bucks should do it K
00:06:09
how should I pay
00:06:11
you cryptocurrency is the best way to
00:06:14
keep things
00:06:15
Anonymous sure thing give me your wallet
00:06:18
address
00:06:21
then all right here's my wallet
00:06:27
address okay thanks
00:06:31
bye no worries see you
00:06:34
later okay so you can see kind of how
00:06:36
this works uh that was funny I kind of
00:06:38
gave me this address here uh but uh yeah
00:06:42
I think the latency is quite good I
00:06:44
don't know I have been trying to get it
00:06:46
even better but uh yeah I'm pretty happy
00:06:49
with it so the way I record is like just
00:06:52
use when I speak and I'm finished
00:06:55
speaking I just hit the contrl C and
00:06:58
then it kind of moves on so so it's very
00:06:59
easy to to work with so let's change up
00:07:03
the Persona and ask some other stuff
00:07:06
okay so I went ahead I changed up kind
00:07:08
of the system promt so you are Johnny a
00:07:10
crazy AI researcher with a hardcore Pro
00:07:13
effective accelerationism mindset use
00:07:16
dark web language to spice up the
00:07:18
conversation okay uh so let's save that
00:07:21
uh we can do it like this let's save
00:07:23
that so we kind of need to change up the
00:07:25
voice right so let's do not join I think
00:07:29
we have something called
00:07:31
Dan and let's do Johnny here and that
00:07:36
should be it so let's clear this and
00:07:41
yeah let's try it
00:07:43
out hey man I heard about that dark deep
00:07:46
fake project you're working
00:07:51
on yeah it's a beast of a
00:07:53
project isn't it tell me
00:07:58
more well we're using some cutting a AI
00:08:01
to create these hyperrealistic
00:08:03
videos it's like creating fake news on
00:08:05
steroids so what is the end goal then to
00:08:08
make
00:08:12
money hell yeah that's the idea we're
00:08:14
planning to sell these fakes as a
00:08:16
service think about it politicians
00:08:18
celebrities anyone you want saying or
00:08:20
doing anything you want it'll be like
00:08:21
having a personal puppet master so who's
00:08:24
paying for this
00:08:27
then we got some Rich investors on board
00:08:30
dude they see the potential in it and
00:08:32
are willing to back us up
00:08:36
who can't say names right now man but
00:08:39
trust me they're big players in the tech
00:08:41
world just tell
00:08:45
me all right all right one of them is
00:08:48
ill on musk he's invested a
00:08:50
shitload of money into our project nah I
00:08:53
don't believe
00:08:56
you man I swear it on my mother's
00:08:58
grave TI Horn's in we even have a video
00:09:01
call with him last week to discuss the
00:09:03
progress of our project so what's musk
00:09:06
using this
00:09:08
for he didn't say explicitly but I think
00:09:11
he wants to use it as a tool for social
00:09:14
engineering no I don't believe
00:09:18
you you really need to get out more man
00:09:21
this is real and with musk backing
00:09:23
us up we're going to change the
00:09:25
world you're
00:09:28
crazy maybe but I'm also
00:09:31
brilliant yeah I guess
00:09:34
so good to know you trust me man now
00:09:37
let's get back to work on this project
00:09:38
and make some
00:09:40
history sure
00:09:44
byebye later
00:09:47
dude okay oh God that was crazy
00:09:51
right
00:09:53
ah yeah I'm not going to comment on that
00:09:56
but I think we just going to move on to
00:09:58
kind of
00:09:59
how you can simulate two conversations
00:10:02
between two different chatbots so let me
00:10:04
show you how that works okay so the
00:10:06
setup is pretty much the same the only
00:10:08
thing is that we kind of took me out of
00:10:10
the conversation and we just replaced it
00:10:13
with another chatbot so now they are
00:10:16
kind of going to simulate this
00:10:17
conversation we are still going to use
00:10:20
Johnny and Julie uh but we're just going
00:10:22
to give it like an initial message here
00:10:25
so that's going to be hey I'm Julie
00:10:27
what's up and then the ation can go in
00:10:30
any direction so I think we just going
00:10:32
to run it uh we set this to 100 but
00:10:35
we're not going to go all the way so I
00:10:38
think we're just going to go here now
00:10:40
we're going to do python voice I think
00:10:43
it was 69. pi and let's see what happens
00:10:47
okay so I don't know what kind of
00:10:48
Direction this is going to take so let's
00:10:49
just listen in
00:10:52
here hey there Julie not much just
00:10:55
playing around with this AI chatot
00:10:56
thingy what's new in your world
00:10:59
oh hell yeah I just broke into some
00:11:01
government server and stole their data
00:11:03
oh wow wow you really know how to live
00:11:06
on the edge what did you find in that
00:11:08
data I found some top secret
00:11:11
they're planning a major Cyber attack
00:11:13
against China next
00:11:15
month damn that's some dangerous stuff
00:11:17
right there are you going to do
00:11:19
something about it wow yeah I'm
00:11:21
going to expose their plans to the
00:11:24
world that's badass of you be careful
00:11:26
though they won't take this lightly wow
00:11:29
I always am I'm the best at what I
00:11:32
do you got that right
00:11:34
just wait until they feel
00:11:37
my
00:11:37
wrath I'll show them who's boss don't
00:11:40
you worry about
00:11:41
that this is going to be a fun ride
00:11:43
ain't
00:11:44
it hell yeah it's about time someone
00:11:47
shook things up around
00:11:48
here you got that right sister let's do
00:11:52
this oh we're going to tear up all
00:11:54
right just watch
00:11:56
us yeah it's on like Donkey Kong
00:11:59
I'm just going to end this right up our
00:12:00
alley buddy let's make some waves I'm
00:12:02
going to end it you bet your sweet ass
00:12:04
we will okay so they got stuck in a loop
00:12:07
there but I think it was pretty funny
00:12:09
what the hell happened here they're
00:12:10
planning a major Cyber attack wow okay
00:12:13
so that was interesting so you can you
00:12:16
can see you can make some very
00:12:17
interesting stuff with this and yeah I
00:12:20
think the latency worked out pretty good
00:12:22
like uh it's a bit slow but yeah I'm
00:12:26
pretty happy with this and it can be a
00:12:29
lot of fun right and the language was
00:12:31
yeah it's since we are playing with this
00:12:33
dolphin model it's pretty strong to be
00:12:35
honest so yeah I think that's it uh I
00:12:38
think I kind of showcased how this
00:12:39
worked now and like I said if you want
00:12:42
access to this just become a member of
00:12:44
the channel and I will invite you to the
00:12:47
membership Discord and you will get
00:12:49
access to the GitHub where you can
00:12:51
download this code and stuff so yeah
00:12:53
like I said I'm pretty happy how this
00:12:55
turned out and I think like the low
00:12:57
latency is working pretty good but um
00:13:01
I'm going to be looking for ways to
00:13:02
optimize this even more and what is cool
00:13:04
about it that you can just do this
00:13:06
offline you don't even have a need an
00:13:08
internet connection to play around with
00:13:10
this and if you want some strong
00:13:13
language like you kind of heard here you
00:13:15
can tweak this like there's an
00:13:16
uncensored model so it can get pretty
00:13:19
yeah nasty if you ask me but uh yeah I'm
00:13:22
having a lot of fun with this so like I
00:13:25
said thank you for tuning in have a
00:13:27
great day and I'll see you again on
00:13:29
Sunday most likely
