ChatGPT x Apple Intelligence—12 Days of OpenAI: Day 5

00:11:36
https://www.youtube.com/watch?v=mBhkD0iFf4w

Résumé

TLDRThe video showcases the new integration of ChatGPT with Apple's iOS and macOS devices. This initiative aims to enhance user interaction by allowing ChatGPT to be accessed via Siri, writing tools, and camera controls. Users can enable and manage settings easily within Apple devices. ChatGPT can now be summoned across iPhones, iPads, and Macs, offering functionalities like organizing events, composing documents, and engaging in visual intelligence. This integration supports seamless sharing and processing of information, such as PDFs, across multiple platforms, providing assistance for both professional tasks and fun activities like creating holiday playlists and artwork. The integration does not require an account, but having one offers better features, allowing for a more enriched user experience. The segment highlights the convenience and excitement around making ChatGPT a part of everyday Apple device usage.

A retenir

  • 📱 ChatGPT is now integrated with iOS devices, making it more accessible.
  • 🎙️ Siri can hand tasks over to ChatGPT for enhanced assistance.
  • 📝 ChatGPT aids in document creation and refinement using Apple's writing tools.
  • 📷 Visual intelligence allows ChatGPT to analyze and learn from camera input.
  • 📂 Users can analyze and share full PDFs with ChatGPT on macOS.
  • 🎉 Fun applications include organizing events and creating playlists.
  • 🎨 ChatGPT can assist in generating artwork such as album covers.
  • 🔄 The integration allows for both personal and professional uses.
  • 🔍 ChatGPT offers seamless sharing across iPhones, iPads, and Macs.
  • 🚀 The extension supports a quality user experience without mandatory accounts.

Chronologie

  • 00:00:00 - 00:05:00

    Apple is integrating Chat GPT into iOS, iPad, and Mac OS to enhance user convenience by allowing direct access from the operating system. Key integrations include Siri, where tasks can be handed over to Chat GPT, writing tools for document composition, and camera control for using visual intelligence. Users can enable Apple intelligence in settings to access these features. Demonstrations include using Siri to organize a Christmas party and creating playlists with Chat GPT's assistance. The system supports interactions through a conversational interface, enabling users to have seamless, task-based interactions on Apple devices.

  • 00:05:00 - 00:11:36

    McDad demonstrates setting up and using Chat GPT integration on Apple devices, using Siri to manage festive tasks like organizing a Christmas sweater contest and generating music playlists. Visual intelligence features allow photo analysis and ranking contest entries, demonstrating fun applications of the technology. Switch to Mac allows similar integrations, where users can send documents to Chat GPT for analysis and feedback, enhancing productivity by enabling complex task management across applications. This release signifies a collaboration with Apple, aiming to make AI usage more accessible and integrated into daily workflows.

Carte mentale

Vidéo Q&R

  • What devices are compatible with the new ChatGPT integration?

    The integration is compatible with iPhones, iPads, and Mac computers.

  • Do I need an account to use ChatGPT on Apple devices?

    You can use ChatGPT without an account, but it's enhanced if you have one.

  • What are the main integrations of ChatGPT on Apple devices?

    The integrations include using Siri, writing tools, and camera control.

  • How does Siri work with ChatGPT?

    Siri can hand off tasks to ChatGPT when it thinks ChatGPT can be of help.

  • Can ChatGPT be used on Apple devices for document editing?

    Yes, it can refine and summarize documents or compose new documents from scratch.

  • What is the role of camera control in the iPhone 16 with ChatGPT?

    You can use visual intelligence via ChatGPT to learn more about what you see.

  • How does ChatGPT help with event organization?

    You can conveniently access ChatGPT by asking Siri to connect you.

  • What are some creative uses for ChatGPT mentioned in the video?

    Creating holiday playlists, judging a sweater contest, and generating album art.

  • Can ChatGPT analyze PDF documents on macOS?

    Yes, ChatGPT can analyze and process entire documents for information extraction.

Voir plus de résumés vidéo

Accédez instantanément à des résumés vidéo gratuits sur YouTube grâce à l'IA !
Sous-titres
en
Défilement automatique:
  • 00:00:00
    [Music]
  • 00:00:07
    welcome to day 5 today is about making
  • 00:00:09
    chat GPT even easier to use our friends
  • 00:00:11
    at Apple are releasing uh the chat GPT
  • 00:00:14
    integration in iOS for iPhone and iPad
  • 00:00:16
    and also on Mac OS we really want to
  • 00:00:19
    make chat GPT as frictionless and easy
  • 00:00:21
    to use everywhere we love Apple devices
  • 00:00:23
    and so this integration is one that
  • 00:00:24
    we're very very proud of you can use it
  • 00:00:27
    without an account if you have an
  • 00:00:28
    account it'll be even better and I think
  • 00:00:29
    we should just jump right in and show
  • 00:00:31
    you how it works yeah cool so so this is
  • 00:00:33
    Dave I'm Dave I'm from the engineering
  • 00:00:35
    team um as Sam says we love Apple
  • 00:00:37
    devices I've been using one for 30 years
  • 00:00:40
    um on lots of Apple devices W me too on
  • 00:00:44
    lots of Apple devices now uh you will be
  • 00:00:47
    able to invoke chat GPT directly from
  • 00:00:49
    the operating system so this will work
  • 00:00:51
    on iPhone on iPad and on Mac uh we've
  • 00:00:54
    got three different Integrations
  • 00:00:55
    starting today and we're going to show
  • 00:00:57
    you all of them today um the first is
  • 00:01:00
    Siri so when Siri thinks that it would
  • 00:01:02
    be helped by giving a task over to chat
  • 00:01:04
    GPT it can just hand it off the next is
  • 00:01:07
    writing tool so writing tools in apple
  • 00:01:08
    intelligence lets you refine documents
  • 00:01:11
    and summarize them get key points but
  • 00:01:13
    now you can also use trat GPT uh to
  • 00:01:16
    compose a document from scratch which is
  • 00:01:18
    super cool um and also uh we've got
  • 00:01:21
    camera control on the iPhone 16 which
  • 00:01:24
    lets you invoke visual intelligence
  • 00:01:26
    where you can use chat GPT uh to learn
  • 00:01:28
    more about the thing that you're looking
  • 00:01:29
    at which is super cool um so this is
  • 00:01:31
    McDon from the product team who's going
  • 00:01:33
    to show us some of this stuff all right
  • 00:01:35
    let's uh let's open up our iPhones a
  • 00:01:37
    little bit so now that I have this thing
  • 00:01:39
    up there's a couple things that you want
  • 00:01:41
    to pay attention to once you get the
  • 00:01:43
    iPhone the first thing is that you have
  • 00:01:44
    to enable Apple intelligence so we'll go
  • 00:01:46
    into settings and we will go right into
  • 00:01:50
    Apple intelligence and Siri I'll enable
  • 00:01:52
    Apple intelligence which I have already
  • 00:01:54
    and then as I scroll down the new chat
  • 00:01:56
    GPT extension is now available cool that
  • 00:01:59
    says chat
  • 00:02:01
    um when we open it up you're going to be
  • 00:02:03
    able to enable chat GPT log into your
  • 00:02:05
    account in this case I'm already logged
  • 00:02:06
    in and then there's also this option for
  • 00:02:08
    you to confirm chat GPT requests so
  • 00:02:10
    anytime as Dave mentioned Siri thinks
  • 00:02:12
    hey this is a good idea to ask chat GPT
  • 00:02:15
    uh it will prompt you to do so before
  • 00:02:18
    you send your information over and then
  • 00:02:20
    you'll also have access to the app which
  • 00:02:21
    you can update install or open directly
  • 00:02:23
    from here but I've got this all set up
  • 00:02:25
    so let's go back into our main screen
  • 00:02:28
    and let's I mean I feel like we're in
  • 00:02:30
    festive mood here something's going on
  • 00:02:32
    uh so let's maybe get a Christmas party
  • 00:02:35
    organized and there's a a quick shortcut
  • 00:02:37
    if you want to go directly to chat GPT
  • 00:02:39
    you can just ask Siri to ask chat GPT so
  • 00:02:42
    I'm going to invoke Siri new Rainbow
  • 00:02:44
    thing shows up uh can you ask chat GPT
  • 00:02:47
    to organize a Christmas party for
  • 00:02:49
    us so right away we see the working with
  • 00:02:52
    chat GPT it's going to go back and forth
  • 00:02:54
    and I'm going to get a response in this
  • 00:02:56
    case I see a whole bunch of different
  • 00:02:58
    things guest list music and
  • 00:02:59
    entertainment man um Sam any follow can
  • 00:03:02
    can we ask you for that holiday playlist
  • 00:03:03
    yeah let's do that can we get a holiday
  • 00:03:06
    playlist
  • 00:03:08
    made and I don't know about you guys but
  • 00:03:10
    there is one song I'm specifically
  • 00:03:12
    looking for and it is number one it's
  • 00:03:15
    number one if Mariah Carey weren't there
  • 00:03:17
    I think we'd have to file a bug yeah I I
  • 00:03:19
    think this is a good solid list uh I
  • 00:03:22
    like it I want to be able to like edit
  • 00:03:24
    more in the chat GPT app so there's this
  • 00:03:26
    like blue icon at the bottom that says
  • 00:03:28
    chat GPT if I click on that it's going
  • 00:03:30
    to open up chat GPT with all of my
  • 00:03:33
    conversation already integrated so cool
  • 00:03:35
    and I can do the normal things of saying
  • 00:03:37
    hey like uh add Emoji to my
  • 00:03:40
    playlist and it'll do that but I I think
  • 00:03:44
    what we need is a little bit more of a
  • 00:03:45
    festive thing so I'm hoping this is
  • 00:03:47
    festive but let's make a album AR cover
  • 00:03:51
    so uh let's make an album art cover uh
  • 00:03:56
    and for some reason I don't know why but
  • 00:03:58
    I'm feeling as though a fro would really
  • 00:04:01
    make it pop um I'm having the same
  • 00:04:03
    feeling too yeah I don't know it's
  • 00:04:05
    something in the background but I feel
  • 00:04:07
    like a FR uh include a
  • 00:04:11
    FR in the cover do you think chat gbt
  • 00:04:14
    knows what a FR is uh surely
  • 00:04:18
    not let's see what comes
  • 00:04:22
    through and uh we've got ourselves a
  • 00:04:26
    beautiful we do have faster image gen
  • 00:04:28
    coming
  • 00:04:31
    always great to see this come through
  • 00:04:32
    hey here we go FR giant happy FR in the
  • 00:04:36
    Middle with holiday Vibes I think we've
  • 00:04:37
    got the makings of a party and I as
  • 00:04:40
    we're in already a festive mood I'd love
  • 00:04:42
    to like get the visual intelligence part
  • 00:04:45
    of this rolling um I think we should
  • 00:04:47
    have a Christmas sweater contest and I
  • 00:04:48
    think chat chpt should help us rank
  • 00:04:51
    who's most to least fun um in
  • 00:04:54
    preparation for this I feel like the
  • 00:04:56
    right move is to let Santa dance so if
  • 00:04:59
    you're bringing aame for the sweater
  • 00:05:00
    contest uh I will do this I feel a
  • 00:05:03
    little outgun here do anything uh so I'm
  • 00:05:05
    going to long press on the camera
  • 00:05:07
    control button and I've got uh the
  • 00:05:10
    visual intelligence set up and now we
  • 00:05:12
    can see our lovely camera crew yeah
  • 00:05:14
    we're going to break the fourth well for
  • 00:05:15
    a second can everybody wave hey
  • 00:05:18
    guys so let's zoom in on our little
  • 00:05:20
    picture here and I'm going to press this
  • 00:05:22
    ask button and that'll ask chat PT
  • 00:05:25
    directly first thing it's going to do is
  • 00:05:27
    it's just going to like Identify some of
  • 00:05:28
    the things going on in the picture my
  • 00:05:30
    poor Santa's got covered so we'll see
  • 00:05:31
    how this goes um we're having a
  • 00:05:36
    Christmas
  • 00:05:38
    sweater
  • 00:05:40
    contest mcdad on the left Dave in the
  • 00:05:46
    middle and Sam on the right uh rank
  • 00:05:51
    judge judge rank CU we we don't judge we
  • 00:05:54
    listen but we don't judge uh rank us
  • 00:05:58
    from most to least
  • 00:06:02
    fun all right moment of truth
  • 00:06:07
    here Sam
  • 00:06:10
    wins that file a bug for that so I'm
  • 00:06:14
    last the sweater features a more
  • 00:06:16
    treditional design with a subtle festive
  • 00:06:19
    pattern what hang on scroll down wait
  • 00:06:22
    wait wait all the sweaters have their
  • 00:06:23
    charm but Sam stands out as the most fun
  • 00:06:26
    with its bold let tell you something
  • 00:06:28
    someone bought like three options for me
  • 00:06:29
    I had to just pick right before this
  • 00:06:31
    which one I was going to wear and I
  • 00:06:32
    thought that if I was going to win it
  • 00:06:34
    was because it was different and you
  • 00:06:36
    know let's make a trophy image for
  • 00:06:43
    Sam I I I was not expecting this result
  • 00:06:46
    I really thought the L thought were
  • 00:06:48
    going to do something I thought I
  • 00:06:49
    thought you guys were going to
  • 00:06:51
    congratulations sweater Champion that's
  • 00:06:53
    a cool great yeah love that okay so so
  • 00:06:57
    we've got the fun part of it taken care
  • 00:06:58
    of uh when out of my sales and I'm going
  • 00:07:00
    to move Santa into a slow down I just
  • 00:07:03
    want to say I feel like that was very
  • 00:07:04
    unjust I appreciate you Sam uh but we'll
  • 00:07:07
    pass to Dave now who's going to show us
  • 00:07:09
    how we can use apple intelligence to get
  • 00:07:10
    back to work yeah so fun and games are
  • 00:07:12
    over um if I'm back at my Mac uh just
  • 00:07:15
    like MCD showed earlier with the iPhone
  • 00:07:19
    if you go into system settings you can
  • 00:07:21
    enable Apple intelligence and so uh uh
  • 00:07:24
    right here we've got Apple intelligence
  • 00:07:26
    enabled and new in Mac OS 15.2 COA that
  • 00:07:30
    we didn't have before is the trachy PT
  • 00:07:32
    extension so just like on the iPhone or
  • 00:07:35
    iPad you can use this fully Anonymous or
  • 00:07:38
    with an account we've got here an
  • 00:07:39
    account that we have linked um and
  • 00:07:42
    what's really cool is now that I've
  • 00:07:44
    enabled Apple intelligence I can invoke
  • 00:07:46
    Siri or writing tools from just about
  • 00:07:48
    any application and it's super easy to
  • 00:07:50
    invoke Siri so I've disabled hey Siri so
  • 00:07:53
    that all of the MacBooks and iPhones in
  • 00:07:54
    this room don't go off at once um but
  • 00:07:57
    you can type to Siri now so if you
  • 00:08:00
    either click on the little Siri icon on
  • 00:08:02
    the top right or hit the uh command key
  • 00:08:05
    twice it brings up the little Siri
  • 00:08:07
    prompt that's really cool and again like
  • 00:08:09
    anytime Siri thinks ooh this is a
  • 00:08:11
    complex task maybe I should get chat
  • 00:08:13
    PT's help with it it'll hand it off
  • 00:08:15
    It'll ask for confirmation um but then
  • 00:08:17
    get uh the help of our super powerful
  • 00:08:19
    models to make it happen so what are
  • 00:08:21
    some places where we might use this well
  • 00:08:24
    um gosh in catching up on all of uh our
  • 00:08:27
    launches this week uh I've got here the
  • 00:08:30
    01 system card9 page system 49 page PDF
  • 00:08:34
    so I've opened this in preview but again
  • 00:08:35
    like in any application I can just
  • 00:08:38
    double tap the command key to bring up
  • 00:08:40
    type to Siri uh how about this uh this
  • 00:08:43
    Doc is super long um how did they get
  • 00:08:48
    the model to be so good at coding um oh
  • 00:08:54
    I spelled model wrong that's why
  • 00:09:04
    and you know what I wasn't in the system
  • 00:09:07
    card so let me make sure we give the
  • 00:09:09
    right credit
  • 00:09:11
    here so what happens is Siri recognizes
  • 00:09:14
    okay this is a complex task let's send
  • 00:09:15
    it off to chat GPT um but before we do
  • 00:09:18
    it wants to know do we want to send any
  • 00:09:21
    of the content that I'm looking at as
  • 00:09:23
    part of the request and we can either
  • 00:09:24
    send the screenshot or the full 49 page
  • 00:09:28
    PDF send it all send it all at all times
  • 00:09:31
    I'm in control of what I share with chat
  • 00:09:32
    GPT and so now we're uploading this
  • 00:09:35
    whole document for chat GPT to process
  • 00:09:37
    along with uh my query of like how in
  • 00:09:40
    the world did they get this model so
  • 00:09:42
    good at coding um and awesome there's
  • 00:09:44
    the answer uh maybe this saves me a good
  • 00:09:46
    bit of time um MCD showed earlier on the
  • 00:09:50
    iPhone that if you tap this little chaty
  • 00:09:52
    BT button down at the bottom it will
  • 00:09:54
    open this in chat GPT and that's super
  • 00:09:57
    cool because then I get to save it for
  • 00:09:58
    later I get to continue the conversation
  • 00:10:00
    I get to do more with it so like one of
  • 00:10:02
    the cool things I might do now that I
  • 00:10:04
    have it saved here um and it shows up in
  • 00:10:07
    my sidebar over there is uh um okay as a
  • 00:10:12
    side note the chbt desktop app is so
  • 00:10:14
    good now if you try so good it's so good
  • 00:10:17
    uh I'm a more visual
  • 00:10:20
    learner can we make a pie chart of the
  • 00:10:26
    respective influence of each of the
  • 00:10:30
    techniques on making it good at
  • 00:10:33
    coding and so this is just picking up
  • 00:10:36
    where we left off it all already has the
  • 00:10:38
    full PDF it's able to read through it
  • 00:10:40
    again analyze it um reason about uh how
  • 00:10:46
    uh I guess like the relative ranks and
  • 00:10:48
    importance of uh each of the different
  • 00:10:50
    techniques here and ultimately write
  • 00:10:52
    some code to help visualize it
  • 00:10:55
    cool um and I'll check with our
  • 00:10:57
    colleagues over on the reasoning te if
  • 00:10:59
    this is representative but this helps me
  • 00:11:02
    better understand the paper which is
  • 00:11:03
    super cool um so all of this from just
  • 00:11:06
    about any application on your Mac um
  • 00:11:09
    with you everywhere in your iPhone in
  • 00:11:11
    your pocket um and uh we're hoping that
  • 00:11:14
    a lot of folks who maybe are already
  • 00:11:16
    using chat PC are now getting to use it
  • 00:11:18
    uh in more places with uh less friction
  • 00:11:21
    yeah so we're thrilled about this launch
  • 00:11:23
    uh or this release this button makes it
  • 00:11:26
    really easy to talk to chat gbt this
  • 00:11:27
    button makes it easy for chat to look at
  • 00:11:29
    something for you we hope you love it uh
  • 00:11:31
    grateful to our friends at Apple and
  • 00:11:33
    have a good day
Tags
  • ChatGPT
  • Apple Integration
  • Siri
  • iOS
  • macOS
  • Visual Intelligence
  • Writing Tools
  • Event Planning
  • PDF Analysis
  • User Experience