00:00:18
[Music]
00:00:18
hello and welcome to day three this is a launch
we've been excited for for a long time we're going
00:00:23
to launch Sora our video product and we'll talk a
lot about why this is so important and so exciting
00:00:28
but first it's so cool we just want to show to
so um we'll look here at a little bit of what
00:00:33
the sore product looks like this is the feed uh
you can see videos that users have been generating
00:00:38
and we'll talk much more about this later but uh
just couldn't wait to to show you a little bit so
00:00:43
video is important to open ey for a lot of reasons
but I'll talk about three here one we love to make
00:00:48
tools for creatives it's important to our culture
uh it's important to how we hope humans will use
00:00:53
Ai and this is one in particular where there's a
new kind of co-creative dynamic that we're seeing
00:00:58
emerge between early testers that we think points
to something interesting about AI creative tools
00:01:03
and how people will use them second we don't want
the world to just be text uh if the AI systems are
00:01:08
you know primarily you interact with by text
I think we're missing something important we
00:01:12
want our AIS to be able to understand video and
generate video and I think it really will deeply
00:01:16
change the way that we use computers and third
this is critical to our AGI road map video will
00:01:22
be an important environment where we're going to
learn or the AI is going to learn a lot about how
00:01:25
to do things that we we need in the world so uh
I'm going to hand this over now to adya who leads
00:01:33
Sora and Bill who leads Sora research they're
going to tell you a little bit about what went
00:01:36
into this um and then after that we will uh have
the product team come up thanks Sam guys today
00:01:42
is finally the day that Sora will be available
we're launching Sora both in the United States
00:01:47
as well as most countries internationally later
today you can access the model at sora.com this
00:01:52
is a completely new product experience from open
AI built for the ground up for video generation
00:01:58
the best part is that if you have a chat GPT Plus
Pro account that's all you need to get started you
00:02:02
don't have to pay extra for Sora we're including
it in the accounts you already have you know to
00:02:06
do a deployment this broad the Sora research team
had to do a ton of work finding ways to make the
00:02:11
February model we previewed way faster and cheaper
they really delivered and today we're launching
00:02:15
Sora turbo this is a new high-end accelerated
version of that original Sora model and it has
00:02:21
all the capabilities that we talked about in
our tech report on world simulation earlier
00:02:24
this year this includes things like generating
videos from text animating images and a ton of
00:02:30
to video features like remixing into new Styles
extending forwards and backwards in time Etc some
00:02:35
other folks are going to show you this in just a
few minutes as Sam alluded to you know we started
00:02:39
the Sora project at open AI to build AI systems
that really deeply understand the world and its
00:02:44
physics we're really just getting started here
you know this early version of Sora will make
00:02:48
mistakes it's not perfect but it's already
at the point where we think it's going to
00:02:52
be really useful for augmenting human creativity
and we can't wait to see what the world is going
00:02:56
to make with Sora starting later today ad hi I'm
ad yeah um I'm really excited for this release
00:03:02
open AI has had a multi-year long history of
training state-of-the-art models that have
00:03:07
pushed the boundaries of what's possible to do
with visual generation however we feel like for
00:03:12
further advances in visual generation we need
breakthroughs both in machine learning and in
00:03:16
human computer interface design so it's for that
reason that I'm really proud of the product that
00:03:21
we've built and I'd like to hand things over to
Rohan and Joey who can tell you more about it
00:03:29
Sam heyan hey Joey hey what's up Sam I'm excited
to show this product off go ahead let's do it I'm
00:03:36
ran I lead our Sora product team and I'm Joey
I'm the product designer on Sora all right Joey
00:03:40
get us started all right I'll kick it off
by talking a little bit more about explore
00:03:46
explore is the place for inspiration it's a feed
of videos shared by the community where everyone
00:03:53
can come together and explore the capabilities
of this powerful new model and we know that the
00:03:59
models especially the first time you use them
it can be hard to understand just everything
00:04:04
that you can do with them so creating a space
where people can come together learn share
00:04:10
techniques share methods felt really exciting
but also really important to us and so you can
00:04:16
see just scrolling through here you can be
inspired by all of these amazing videos and
00:04:21
I saw one up here if you see one that's
particularly interesting to you you can
00:04:24
click into it and view it in a light box and
at the bottom of this light box it'll show you
00:04:30
the exact method that was used to create this
video whether it's simple text prompt an image
00:04:36
extension video extension or one of our other
more powerful creative tools you can take this
00:04:42
methodology and learn how to incorporate it into
your own creative workflow so without further
00:04:48
Ado I'll kick it back to Rohan to do our first
generation all right let's head to our library
00:04:55
you can think about this as your home base in
Sora where you can view all your Generations
00:04:59
you can slice The View here a couple different
ways a grid view a list view you can create
00:05:06
folders you can favorite things look at bookmarks
from the feed all minor organizational touches
00:05:12
but show that we really care about empowering
storytelling and and real use of this product
00:05:17
all right down here you'll see our simple composer
here you can create a video by simply describing
00:05:23
it with text or uploading an image uh Sam you got
an idea for us how about some woly mammoths uh
00:05:29
in the desert all right woolly mammoths walking
through the desert love it uh let's say woolly
00:05:34
mammoths walking through the desert landscape
let's maybe make it a wide shot cool and before
00:05:44
we fire this off I want to touch on some of the
options you'll see down here aspect ratio so Sora
00:05:49
can generate from horizontal aspect ratios to
square to Vertical can generate in resolutions
00:05:55
from 480p up to 1080p can generate from 5 Seconds
up to 20 second videos and you can also generate
00:06:02
multiple variations at once so you might not know
exactly what you want out of this description and
00:06:07
S might take in a couple different directions
variations let you see a couple of options we'll
00:06:11
do a four video uh variation here and last
but not least there's presets sometimes you
00:06:18
might find an aesthetic or style that you really
love and you want to capture that in a reusable
00:06:23
component and apply it to a ton of generations
you can do that you can create your own we have
00:06:27
a couple defaults here stop motion balloon world
a crazy one highly recommend it um but let's fire
00:06:32
off this gen and then I'm going to hand it back
to Joey to talk about storyboard another really
00:06:37
awesome feature we have awesome thank you Rohan so
Rohan just showed how you can take a general idea
00:06:43
and send it to Sora and have it create an entire
set of beautiful videos but today we're excited to
00:06:49
talk about an entirely new creative tool that
we're introducing a more advanced tool that's
00:06:54
still very early but something we're calling
storyboard that lets you direct a video with
00:06:59
multiple actions across the sequence using a
familiar timeline so I'll click in right here
00:07:05
and I'll tell you a little bit about storyboard at
the top of the screen you see the storyboard cards
00:07:11
this is where you'll describe the environment the
characters and the actions you want to occur at a
00:07:17
particular point in your video below that is the
timeline you can see the outline of my entire clip
00:07:23
and this is where I'll sequence the actions in my
video and then below that is the creation settings
00:07:29
that Rohan just went over so I'll pop back up to
the storyboard and I'll set my first uh storyboard
00:07:35
card in the scene so I'll say a beautiful white
crane stands in a creek let's give it a Yellow
00:07:45
Tail stands in a creek so here I can write
as little or as much as I want and the less
00:07:54
I write the more Sora will fill in the details
and the more I write the more Sora will try to
00:07:58
adhere to my dire ction so in this video I want
this crane to be standing at the beginning and
00:08:04
then dip its head in the water and pick out a fish
so I'll come down to my timeline and I can click
00:08:10
anywhere within the outline of my clip to add an
additional card and give sore of those actions
00:08:16
so I'll come up here and I'll say the crane dips
its head into the water and pulls out a fish so
00:08:26
looking back at my timeline I can now see at the
start of my timeline I've set the scene and then
00:08:33
at five seconds the crane will dip its head into
the water and you'll notice that there's space
00:08:37
between these two cards within the outline of my
clip that space is important for Sora to connect
00:08:43
this first set of actions with the second set
of actions I can always adjust where I want
00:08:48
these actions to occur but giving Sora adequate
time to connect these ideas is really important
00:08:53
if you want a continuous shot you can also have
it make cinematic cuts by moving them closer or
00:08:59
move them further away and let Sora do even more
filling in of the details so I'll move this back
00:09:04
to 5 seconds and I'll fire it off and we can
review this in a minute but there's one more
00:09:11
storyboard feature I want to show um that's
really really cool and that's using image to
00:09:17
create video so in this first storyboard card I'll
go ahead and upload an image that I have on my
00:09:23
desktop this image is of a lighthouse and you
can see the Sora automatically put that first
00:09:31
image into the first card and then it created
an entirely new card and this is a continuation
00:09:38
caption s has looked at that image and it is added
an additional and understanding the movement that
00:09:44
we might want to make with this image and it
has filled out a caption for to continue or to
00:09:49
turn this image into a beautiful video so much
like with the text I can come up here and edit
00:09:55
anything in this card I can adjust its position
um but for now we'll fire this off and we can
00:10:00
see how it looks so I'm going to kick it back
to Rohan to review some of these videos that
00:10:05
we made Let's Do It Let's see uh let's check out
those woolly mammoths let's see what we got here
00:10:12
amazing pretty good pretty good um so here we
can hover over our you know our variations of
00:10:19
this generation kind of get a feel for which one
we might like best um and then we can continue to
00:10:24
refine this with Sora so I think I like maybe top
right me too yeah all right let's take a look at
00:10:31
the top right um now this is cool but now that
I'm seeing the scene I think it would be cooler
00:10:37
if these woolly mammoths were robots what do you
guys think great all right let's do it so remix
00:10:43
lets you just describe changes to the video and
Sor will do the rest so I'm going to click remix
00:10:48
here and simply say replace the woolly mammoths
with robots you'll see a couple familiar options
00:10:58
here you can create multiple variations you
can change the resolution you can also tell
00:11:03
Sora the strength of the remix you want so
if you want a big change in the scene this
00:11:09
is probably a significant change we'll tell Sora
hey give this a strong remix if it's something
00:11:13
subtle like say you just wanted a little bit more
wind in this background of the scene or more sand
00:11:18
kicking up you go with a mild or subtle remix
for now we'll kick off a strong remix all right
00:11:25
should we take a look at your storyboard J let's
see how the CR came out all right let's do it
00:11:31
all right so here let's pop into one of these
and we can see all right so we see about halfway
00:11:39
through my crane is dipping its head into the
water can see if it grabs a fish oh looks like
00:11:44
it missed on that one can review another one
of these too but you see that Sora has taken
00:11:49
my direction and it's done a pretty good job at
understanding exactly where it wants to go and
00:11:55
both of these cranes they may have missed I got
a little fish that one yeah I got a little fish
00:11:59
um but this is again something I want to point out
which half of the half of the story with Sora is
00:12:05
taking a video editing it and building on top of
it so the beginning of this video right when the
00:12:11
Crane's head splashes in I love this part so I'm
going to go ahead and use another editing tool
00:12:16
here called recut that allows me to take my video
trim it down and extend it in a storyboard with
00:12:22
even more Direction so clicking recut has taken
me into a new storyboard and Sora has imported
00:12:30
this video of the crane and now I can see on the
timeline my video here I can scrub through it to
00:12:36
review it and I can also trim my video so I think
I like actually I'm going to take this H first
00:12:43
few seconds right until its head splashes into
the water I like that and so much like in the
00:12:50
other storyboard examples any area that I leave
empty here story will seamlessly continue from
00:12:57
whatever storyboard card I have in there so if I
want an entirely New Ending I can leave the end
00:13:02
blank and I can go ahead and hit create if I want
an entirely New Beginning let's say I wanted this
00:13:07
at the end of my scene I can leave this here
and maybe it will the camera will stay on the
00:13:12
crane for a little bit more in the beginning I
can also move it into the middle and generate
00:13:16
entirely new endings and Beginnings for all of my
videos and much like the rest of the storyboard I
00:13:22
can always click to add more cards and give it
more a Direction so let's generate a new ending
00:13:27
to this video and we can see um how it turns out
awesome cool thanks Joey while that's going see
00:13:36
if we got some robots oh my God we did amazing all
right we'll see that Sora hair these are sort of
00:13:44
like willly Mammoth is robots yeah yeah it's kind
of cool um so yeah that one Walks Like amazing
00:13:50
actually yeah that is pretty cool it's amazing
um so s took our prompt of replacing the woolly
00:13:54
mammoths with robots and did just that we click in
we can see the original one here this is a strong
00:14:01
remix and we replaced the Wily mammuts with robots
pretty awesome uh let's take a look at a couple
00:14:06
other features actually quickly let's look at your
uh image to video Generations here Joey pretty
00:14:11
cool some nice Ambiance with this Lighthouse top
right one's pretty yeah you get a couple different
00:14:17
shots here with different sort of camera motion
um and as you can see you know you might not know
00:14:22
exactly what you want you could throw an image in
there and see what Sora does kind of like this top
00:14:26
this bottom right one rather um I think it would
be cool as a Loop so one of our awesome features
00:14:31
is if you really like a generation you can tell
Sora hey I want this to endlessly repeat because
00:14:36
it's so beautiful and you can do just that with
Loop so if you click into Loop you can tell Sora
00:14:42
where do you want the start of this Loop to be
where do you want the end of it to be and Sora
00:14:46
will fill in the gaps to create this sort of
seamless repeated scene um you have a couple
00:14:51
options here Sora can add fewer frames if the
beginning and the end are already pretty similar
00:14:56
or you can tell it to add lots of frames to try
try to connect maybe two more disparate beginning
00:15:01
and endings and but Sor will do the heavy lifting
it's a really really awesome feature um a lot of
00:15:05
the artists in our Alpha really love Loop um cool
last but not least I just want to quickly touch on
00:15:11
another feature blend so you can think about blend
as giving Sora two scenes and Sora will create a
00:15:19
net new scene that is a cohesive version of both
of those it's almost like smashing two videos
00:15:24
together in another dimension and bring it back
to this one it's I I've never seen anything like
00:15:29
it until I use blend with our model um so if
you click into blend you can choose another
00:15:32
video from your library you know we could blend
the robots with the woolly mammoths that could
00:15:37
be a cool one and there's a couple options here
I won't go into a ton of detail right now but
00:15:42
long story short you can kind of dictate to Sora
how you would like it to sort of blend these two
00:15:47
scenes together some really awesome Advanced
features for um yeah for our heavy users and
00:15:52
power users trying to make a lot of awesome
cre can we do that yeah we can run this one
00:15:56
for sure um I think yeah transition B blend is
probably a good one for the woolly mammoths and
00:16:00
the robots let run it all right awesome cool
so to wrap it all up I'm going to come back
00:16:09
to the featured feed and you'll remember Joey was
scroll scrolling through these videos earlier you
00:16:14
might have seen at the bottom storyboard now you
know what that is you can kind of uncover each
00:16:19
of these Generations in the feed and see how they
created I love the feed because you can just find
00:16:24
inspiration and then run your own remix of someone
else's video in addition to inspiration I just
00:16:29
find it like so compelling to just watch like it's
amazing what people are doing it's crazy yeah it
00:16:34
really is wild um and that's Sora that's kind of
the end to-end product where we're really excited
00:16:40
to see what you create and add more features here
and and do something amazing uh do more amazing
00:16:45
things with Sora but uh yeah Sam you want to tell
us about availability yeah so this is going live
00:16:50
today in most of the world um except uh most of
Europe and the UK will be a while uh we're going
00:16:55
to try our hardest to be able to launch there
but we don't have any time need to share yet
00:16:58
and there are some other countries that we're
not able to operate in if you have an open AI
00:17:02
Plus subscription you get 50 Generations a month
if you have an open AI Pro you get uh unlimited
00:17:07
Generations in our sort of slow que mode um and
500 normal faster Generations you can also have
00:17:13
get fewer Generations at the higher re at higher
resolution so and and anybody with any account
00:17:19
can just uh enjoy the feed we're really excited
to see what you all will create um we're really
00:17:23
excited to see kind of all of the new ways
that this sort of new kind of entertainment uh
00:17:29
and and Tool will be used uh you all did
incredible work on this I'm super proud
00:17:33
of the team I love the product and um yeah any
closing thoughts um yeah I mean Joey and I are
00:17:39
just representatives of an amazing team here uh
I just want to shout out the research team that
00:17:44
built this in crazy mo incredible model and got
it to a place where we could actually serve it
00:17:49
to the world and our product team is a group of
like five or six product Engineers that build
00:17:53
this entire product in a matter of months um
and obviously a village at openai to support
00:17:57
us to get to this this point um and quickly on um
just kind of Abuse Prevention and safety that's
00:18:03
something obviously is in our DNA at open Ai and
we really care about um we obviously have a big
00:18:09
Target on our back as opening ey so we want to
prevent legal activity of Sora but we also want
00:18:13
to balance that with creative expression we know
that's something that will be an evergo ongoing
00:18:17
challenge we might not get it perfect on day
one we're starting a little conservative and
00:18:20
so if our moderation doesn't quite get it right
just give us that feedback we'll be iterating
00:18:25
um yeah really really really excited to see what
you create Joey any other final thoughts yeah I
00:18:30
think maybe my final thought is um I think if you
come into Sora with the expectation that you'll
00:18:35
just be able to click a button and generate a
feature film I think you're coming in with the
00:18:40
wrong expectation Sora is a tool it allows you to
be multiple places at once try multiple ideas at
00:18:47
once try things that are entirely impossible
before um but really we think it's something
00:18:53
that's super super special in an extension of the
crater who's behind it and so we can't wait to see
00:18:59
what you create and uh we'll be watching in the
feed yeah to come back to the gpt1 analogy it's
00:19:04
early like it's going to get a lot lot better so
uh but we've always been surprised when we put
00:19:09
things out even in an early state that people are
able to get amazing performance and real value out
00:19:13
of them and yeah we can't wait to see what you
do in the feed later today thank you thank you
00:19:28
[Music]
00:19:29
[Music]
