How To Build The Future: Aravind Srinivas
Ringkasan
TLDRArvin Shavas, co-founder and CEO of Perplexity, shares insights into the inception and growth of the company, emphasizing its goal to build an intelligent search engine that exceeds traditional models like Google. He recounts his early experiences in AI and how they led to recognizing the opportunity in enhancing search functionalities through AI. Perplexity aims to create a user-centric product that allows for an end-to-end experience in information retrieval while adapting to the evolving AI landscape. As the company navigates the competitive space against giants like Google, Shavas stresses the importance of user engagement and innovative monetization strategies.
Takeaways
- 🚀 Perplexity is a growing AI-based search engine with over a billion-dollar valuation within three years.
- 👁️ Emphasis on user experience is key, aiming to make search simple and relevant without clutter.
- 📈 Engagement doubled after introducing follow-up questions, showcasing strong user interaction.
- 🤖 Shavas emphasizes the importance of evolving AI models to enhance functionality and speed.
- 💡 Future ambitions include facilitating end-to-end user tasks and shifting from traditional advertising models.
Garis waktu
- 00:00:00 - 00:05:00
The introduction of follow-up questions has significantly increased user engagement on the site, highlighting the potential of the platform. The visionary ambition behind the project reflects aspirations similar to those who sought to innovate at a scale akin to Google.
- 00:05:00 - 00:10:00
Arvin Shavas recounts his journey into the AI world, rooted in deep learning research, culminating in pivotal internships at OpenAI. His formative experiences underscore the importance of foundational research in shaping future entrepreneurial pursuits.
- 00:10:00 - 00:15:00
A focus on developing AI-powered search capabilities led to the inception of Perplexity. Initial challenges included skepticism about competing with tech giants like Google, yet a unique approach towards querying and information retrieval led to a path forward, marking the beginning of a distinct venture.
- 00:15:00 - 00:20:00
Early product iterations involved leveraging Twitter data to create a conversational search experience, allowing users to engage with their social media insights in innovative ways. This initial MVP laid the groundwork for understanding user needs in information retrieval.
- 00:20:00 - 00:25:00
Transitioning from the Twitter-centric demo to Perplexity involved recognizing the potential of unstructured data. The team aimed to capitalize on evolving generative AI models, believing that improving AI could lead to a more fluid user experience without heavy indexing.
- 00:25:00 - 00:34:39
The competitive landscape solidified an understanding that while giants like Google posed challenges, the unique appeal of Perplexity lay in its user-centered design and adaptability. The intention is to evolve not just as a search tool but as a comprehensive solution that integrates various user needs, from shopping to booking, all while maintaining high engagement.
Peta Pikiran
Video Tanya Jawab
What is Perplexity?
Perplexity is an AI-driven search engine designed to deliver intelligent and accurate search results tailored to user needs.
How has Perplexity grown since its inception?
Perplexity has rapidly escalated to over a billion-dollar valuation within three years, focusing on enhancing user engagement through follow-up questions.
What differentiates Perplexity from Google?
Perplexity aims to provide a more focused and user-friendly search experience, emphasizing simplicity and immediate relevance without the clutter of ads.
What challenges does Perplexity face in competing with Google?
Perplexity must address the complexities of integrating monetization with delivering quality search results while competing against a well-established platform.
What is the future vision for Perplexity?
The vision includes evolving into a comprehensive platform that not only answers queries but also facilitates user tasks, shifting away from current ad-centric models.
Lihat lebih banyak ringkasan video
- 00:00:00we release the ability to ask follow-up
- 00:00:02questions that double the engagement
- 00:00:04time on the site and also increase the
- 00:00:06number of questions every day so I was
- 00:00:08like okay there's something here it's
- 00:00:09not worth killing and pivoting to
- 00:00:11Enterprise it was not like I want to go
- 00:00:13and kill Google like that sort of a
- 00:00:15motivation it was more like what is an
- 00:00:17idea of that scale and ambition is
- 00:00:19something like this today my view of
- 00:00:22perplexity is a more intelligent Google
- 00:00:25search that's really useful in certain
- 00:00:27scenarios what do you want me to think
- 00:00:29it it in 3 or 4
- 00:00:32[Music]
- 00:00:36years welcome back to another episode of
- 00:00:38how to build the future today we're
- 00:00:40joined by Arvin shavas co-founder and
- 00:00:43CEO of perplexity which in less than
- 00:00:45three years has grown to more than a N9
- 00:00:47billion valuation thanks for joining us
- 00:00:49thank you for having me David how did
- 00:00:51you get into this world I was pretty
- 00:00:53interested in AI deep learning research
- 00:00:56uh that's actually what got me into the
- 00:00:58US I was an underr in India came here to
- 00:01:01the US for doing my PhD here at Berkeley
- 00:01:03life really changed when I got to do an
- 00:01:05internship at open aai and Ilia s was
- 00:01:08there I still remember the day I first
- 00:01:10met him and I was very prepared and had
- 00:01:13all these fancy ideas that I thought
- 00:01:15were very interesting and he listened
- 00:01:17for 5 minutes and said all this resource
- 00:01:19is useless feels really bad to hear that
- 00:01:22so I got used to you know hearing the
- 00:01:25right things even if they're
- 00:01:26uncomfortable and then he told me the
- 00:01:28only thing that matters is he drew two
- 00:01:29cir circles one big circle called it
- 00:01:32unsupervised learning and then inside he
- 00:01:35said reinforcement learning another
- 00:01:36Circle and he said this is Agi every
- 00:01:40other research doesn't matter this was
- 00:01:42around the time when they were building
- 00:01:44gpt1 okay they didn't even call it
- 00:01:47gpt1 uh when I saw the research I went
- 00:01:50back to Berkeley and said I was working
- 00:01:52a lot on RL that was the rage at the
- 00:01:54time because of alpha go and deep mine
- 00:01:57right but that was kind of like chasing
- 00:01:59the friend so I went back to my
- 00:02:01professor and said hey we have to
- 00:02:02actually go and study unsupervised and
- 00:02:04generative models and generative AI so
- 00:02:07then I got into that and uh did more
- 00:02:10internships at Google and during my
- 00:02:12Google internship I stumbled upon this
- 00:02:14book called in the Plex so I would
- 00:02:17launch jobs during the day training runs
- 00:02:19and then um go and read these books in
- 00:02:21the library because interns don't have
- 00:02:23any other thing to do right and we feel
- 00:02:25amazing that oh like these guys actually
- 00:02:27Were Once Upon a Time grad students like
- 00:02:29me and now I'm working as an intern in
- 00:02:32their offices and reading reading the
- 00:02:33book book it's it feels nice it would be
- 00:02:36amazing to start a company like that in
- 00:02:39future where there's a lot of research
- 00:02:42there's a lot of like AI at the same
- 00:02:44time it's very grounded in product
- 00:02:46building uh it's very difficult to do
- 00:02:48that uh and I spent a lot of time
- 00:02:50thinking about it I even spoke to IIA
- 00:02:52about it and like where we said there
- 00:02:54are probably only two problems where uh
- 00:02:57you can work on AI and also build
- 00:02:59product at the same same time one is
- 00:03:01like search and the other is sub driving
- 00:03:03car because all your product roll outs
- 00:03:06are becoming data points for improving
- 00:03:08the underlying AI in the product and
- 00:03:10that'll make the product even better and
- 00:03:13that'll lead to more users and more
- 00:03:15usage will lead to more data points and
- 00:03:16it'll become a flywheel and uh it should
- 00:03:19also be on the AI completeness path it's
- 00:03:23sort of a buzzword to say this but
- 00:03:25basically what it means is better AI
- 00:03:27should keep making your products better
- 00:03:29so that that way you can keep working on
- 00:03:31your company until AI is solved right
- 00:03:34and once it's Sol okay sure we'll worry
- 00:03:35about all those you know imp but your
- 00:03:37company gets better as AI gets better as
- 00:03:39opposed to your company gets run over by
- 00:03:41somebody else exactly so searge is like
- 00:03:43one of those problems yeah so you're at
- 00:03:45this moment where you kind of have this
- 00:03:47realization that you want to start a
- 00:03:48company how did you get the kind of
- 00:03:51activation energy to quit your great job
- 00:03:53at open Ai and go do that how did you
- 00:03:55find your co-founders I came across this
- 00:03:57blog that um one of the
- 00:04:00former YC Partners Daniel gross wrote
- 00:04:02but it was like how to build the next
- 00:04:04Google um and I think basically the core
- 00:04:07idea is like you could do so much more
- 00:04:10with better query reformulation so you
- 00:04:13take a query and you just add some
- 00:04:15suffixes uh so if someone's looking for
- 00:04:17reviews of a movie uh just suffix site
- 00:04:20colon rodent tomatoes.com if someone's
- 00:04:22looking for uh reviews of some uh new
- 00:04:25Gadget uh do site call in that
- 00:04:27corresponding subreddit you can get away
- 00:04:29with a lot of these suffixes and like
- 00:04:32our special strings to like filter
- 00:04:34results and and already make Google uh
- 00:04:37so much better even with the existing
- 00:04:39Goog Google ranking uh I'm not even
- 00:04:42talking about the ads problem just
- 00:04:44simple ranking and then you can do more
- 00:04:46sophisticated things of like classifying
- 00:04:49queries and he was talking about how
- 00:04:51llms could automatically figure out
- 00:04:53these suffixes and I was pretty
- 00:04:55interested in that okay that that seemed
- 00:04:57like okay maybe uh generative AI might
- 00:04:59be um as in like I used to just call it
- 00:05:02llm so General models could be a better
- 00:05:04way to build search engines too I also
- 00:05:07was pretty interested in like trying to
- 00:05:08do something agent like when deep mine
- 00:05:11had this um Android environment that
- 00:05:14they built where like they they kind of
- 00:05:15wanted to prototype a mobile app using
- 00:05:18agent uh that knows when to use what
- 00:05:20apps and control the apps um that's when
- 00:05:23I I spoke to my uh co-founder in CTO uh
- 00:05:25his name is Dennis we had written the
- 00:05:27same paper a day apart so we we knew
- 00:05:29each other and he was a visiting student
- 00:05:30in my lab and we used to talk about I
- 00:05:32with brainstorm ideas of how like we can
- 00:05:34build agents to control the Android
- 00:05:36environment so we we were definitely
- 00:05:38chatting about doing a lot of things but
- 00:05:40never concretely about any company or
- 00:05:42product the first thing that anyone
- 00:05:44would tell you is like why why you work
- 00:05:47on this of course Google's going to do
- 00:05:49this right it's not even like you go
- 00:05:51build a better Google Docs uh Google
- 00:05:54will eventually do it because it's a
- 00:05:56secondary thing for them so companies
- 00:05:58like notion can still be funded this is
- 00:06:00their core crownwell so why would you
- 00:06:03even try I think the reason it actually
- 00:06:06made sense this is again after launching
- 00:06:09the product we realized this not before
- 00:06:12um so there's like some benefit to being
- 00:06:13ignorant ignorance is bliss uh is that
- 00:06:17if people stop clicking on links the ad
- 00:06:19economy kind of dies now you can there's
- 00:06:22a lot of you know Nuance to this but
- 00:06:24that core Insight was only uh realized
- 00:06:27by us after launching so so once we
- 00:06:29realized that I thought okay we were on
- 00:06:31to something and that kind of took us
- 00:06:34last two years yeah walk us through like
- 00:06:35the first iterations of your
- 00:06:37experimentation like I know you did a
- 00:06:39bunch of demos that were very dissimilar
- 00:06:41from perplexity yeah so I was like adash
- 00:06:43is enough to go and pitch to The in
- 00:06:46first seed investor of ours elot Gil
- 00:06:48that like hey like um you know I want to
- 00:06:51disrupt Google um but I kind of want to
- 00:06:54do it from pixels from a glass and I
- 00:06:57think that's way you know you're not
- 00:06:59competing with people typing on the
- 00:07:01search bar they just seeing even at that
- 00:07:03point you like knew in your mind I want
- 00:07:05to go after Google or like yeah yeah it
- 00:07:08was not like I want to go and kill
- 00:07:10Google like that sort of a motivation it
- 00:07:12was more like what is an idea of that
- 00:07:14scale and ambition is something like
- 00:07:16this it was also around the time when
- 00:07:17multimo models were slowly beginning to
- 00:07:19work so I thought like if you were on
- 00:07:21the trajectory of improving technology
- 00:07:23you could build something pretty amazing
- 00:07:25my investor rightfully said like not to
- 00:07:27work on it in the beginning so we
- 00:07:29focused more on searching over like
- 00:07:30specific verticals or data sets or
- 00:07:32databases tables actually and we were an
- 00:07:35Enterprise kind of focused company
- 00:07:37except like nobody wanted to give us
- 00:07:40their data I remember I used to you know
- 00:07:43hustle for calls with like bitbook or
- 00:07:45crunch Bas as because I kind of wanted
- 00:07:47to build a demo that would first make
- 00:07:49sense to an investor and that way we can
- 00:07:51keep you know raising some capital and
- 00:07:53then actually hiring good people and
- 00:07:55then go and like do the real thing and
- 00:07:57so crunch base add all this data which
- 00:07:59will as but they they just don't want to
- 00:08:00give it to us and so um next best step
- 00:08:04Twitter yeah Twitter pre Elon CEO
- 00:08:07moments uh academic access was allowed
- 00:08:10legal so we um um built a database of
- 00:08:13Twitter we organized it in the form of
- 00:08:15tables we Tred to do it with the openai
- 00:08:18Codex modeles this was even pre gbt
- 00:08:213.5 we we wrote a lot of templates oh
- 00:08:24for these kind of queries these are
- 00:08:25example sequels and then the model would
- 00:08:27do kind of rag they pull queries in the
- 00:08:30templates and then write the actual SQL
- 00:08:33based on the template sqls and that was
- 00:08:36the only way to get it to work reliably
- 00:08:38and then we had a lot of call backs in
- 00:08:40case errors happen it'll automatically
- 00:08:42correct it uh and then it will go and
- 00:08:44query the database and then retrieve the
- 00:08:47records it was very nice and it was a
- 00:08:49chat UI you could chat you could
- 00:08:51Converse you could plot and this was
- 00:08:53like the first real like product or demo
- 00:08:55that you guys watch yeah yeah we did it
- 00:08:57very fast like took only a month to do
- 00:08:58this um because there like three people
- 00:09:01only but that energy in the beginning is
- 00:09:03insane and they showed it to a bunch of
- 00:09:05people and they all allowed it main
- 00:09:07there are two reasons one something like
- 00:09:08that never existed before like uh you
- 00:09:11could never actually goarch exactly to
- 00:09:14this day even today right and then uh
- 00:09:17also people lowed I finding all these I
- 00:09:20think I think the social search of like
- 00:09:23knowing who other people are following
- 00:09:25whose streets are they liking whose
- 00:09:26streets are they not liking who did they
- 00:09:28unfollow this week mhm you know those
- 00:09:30kind of diffs it's all like funny so you
- 00:09:33launched this Twitter search thing yeah
- 00:09:35how did you transition from that to now
- 00:09:38what we all know as perplexity yeah so
- 00:09:39we had that right and then we were
- 00:09:41trying to do something similar to that
- 00:09:43for many different databases GitHub like
- 00:09:47if coders could go and search about Reb
- 00:09:49host or LinkedIn if you could like
- 00:09:52almost be a recruiter just say but even
- 00:09:54now it's pretty hard I want to say like
- 00:09:56I want all the people who worked uh who
- 00:09:58who have been C Founders you know who
- 00:10:01and and who also worked at C C or D
- 00:10:03startup because they would know what it
- 00:10:05means to be Scrappy it's very difficult
- 00:10:07to like using the LinkedIn UI to do that
- 00:10:09you cannot do that right for whatever
- 00:10:11reasons people don't want to give their
- 00:10:12data their pay wall like you know such
- 00:10:15technology if it exists we'll be
- 00:10:17creating like way more value but some it
- 00:10:20doesn't exist for many other reasons we
- 00:10:22were beginning to see how like even with
- 00:10:25the capability of the models at that
- 00:10:27time in 2022
- 00:10:29um pre 3.5 turbo uh things were actually
- 00:10:33pretty reliable to the extent where like
- 00:10:36people would like use this and find
- 00:10:38Value I actually read this um polyram
- 00:10:41tweet I think uh like where if you try
- 00:10:43to often when you when you figure out
- 00:10:46the better solution when you try to Sol
- 00:10:48solve a harder version of it but you end
- 00:10:50up with a simpler Solution that's more
- 00:10:51General and scalable that's what we
- 00:10:54realized like okay like there's one way
- 00:10:55of doing these things where we go to
- 00:10:57each of these domains and like try to
- 00:10:59build an index of it and put it into
- 00:11:01specific formats like tables and then
- 00:11:04have the
- 00:11:05llm like like read that uh in a
- 00:11:08structured language SQL or you could do
- 00:11:11the other way where you just keep it
- 00:11:12unstructured and expect the llm to do
- 00:11:15most of the work at the inference time
- 00:11:17at at at the time of the query and and
- 00:11:19don't do all this work in the indexing
- 00:11:21time and clearly we knew that if if
- 00:11:24second is where the world is headed uh
- 00:11:27where the models will get smarter and
- 00:11:28smarter
- 00:11:30it gives you an advantage to build it
- 00:11:32that way because it's it's more General
- 00:11:35and uh you also stand a chance against
- 00:11:37the Legacy system that Google has built
- 00:11:40which is a lot more in the first style
- 00:11:42so we thought okay we would try to build
- 00:11:44a more General solution and then we
- 00:11:45prototype this thing one weekend
- 00:11:47actually actually John Schulman's theme
- 00:11:50had already published this thing called
- 00:11:51Web GPT at the time so I was pretty
- 00:11:53aware of it opena I even had a bot when
- 00:11:56I worked there called the truth bot
- 00:11:58which John John bill with this steam
- 00:12:00okay where you could ask it a question
- 00:12:02and it'll go and search the web and then
- 00:12:04it'll give you an answer uh with some
- 00:12:06with some sources and um it was very
- 00:12:09slow and it was built with the 175b gp3
- 00:12:13model so incredibly slow and inefficient
- 00:12:15it was more agentic like it would
- 00:12:17actually be like an RL agent that
- 00:12:19decides if it wants to click on a link
- 00:12:21and browse it scroll okay this is very
- 00:12:23slow so what we tried is a very simple
- 00:12:26uh heuristic version but much faster
- 00:12:29which is okay you always take the topk
- 00:12:31links that a search API provides you you
- 00:12:33always only take the summary Snippets
- 00:12:35that the index is already cached so
- 00:12:38there's no scrolling there's no clicking
- 00:12:40and you always feed all those links into
- 00:12:42the prompt so there's no selection ask
- 00:12:45you to write a summary with sources in
- 00:12:47like the academic format and that's it
- 00:12:50when these models were're getting to a
- 00:12:52point like 3.5 turbo sort of models were
- 00:12:54beginning to come um this actually
- 00:12:57started working much better yeah
- 00:13:00instruction following capability
- 00:13:01increased enough that you didn't have to
- 00:13:03do it very very uh rigorously got so so
- 00:13:07you kind of did like the the dumb
- 00:13:09approach um betting on the fact that the
- 00:13:12the AI would get good enough that would
- 00:13:14make all of
- 00:13:15that uh right timing I would say one
- 00:13:18year ago and John and his team tried
- 00:13:20like the models were just so so much uh
- 00:13:23worse that like if you tried the dumb
- 00:13:25approach it just wouldn't work and so
- 00:13:27therefore you would conclude that you
- 00:13:28need a smarter approach okay but then
- 00:13:30when the modeles began to be much better
- 00:13:32instruction following the dumb approach
- 00:13:35actually works and that fixes a core
- 00:13:38product ux problem of latency you are
- 00:13:40used to uh like like links appearing
- 00:13:43instantly on a traditional search right
- 00:13:46even then by the way the first version
- 00:13:48we launched which is the answer version
- 00:13:50uh took 7 seconds or something to um
- 00:13:53because we didn't even have this concept
- 00:13:54of streaming answers we we would wait
- 00:13:57till the entire answer was generated we
- 00:13:59couldn't control the verbosity so
- 00:14:00sometimes the answer would be very very
- 00:14:02big we even had to hardcode a prompt
- 00:14:04saying only write five sentences or
- 00:14:06something like that or 80 words to keep
- 00:14:08it fast yeah exactly okay so you
- 00:14:10launched this when was the first moment
- 00:14:13that you thought like oh I'm on to
- 00:14:15something here so we tweeted it okay I I
- 00:14:18I was while writing the tweet I was like
- 00:14:20um you know people are going to ridicule
- 00:14:22it it's going to make mistakes blah blah
- 00:14:24blah first moment of virality came and
- 00:14:26one uh annoyed uh like intellectual
- 00:14:30academic came search for herself uh it
- 00:14:34said she it gave a biography in the past
- 00:14:37tense and she's like I'm still alive
- 00:14:39what the hell but actually what happened
- 00:14:42was there was a person with the exact
- 00:14:44same name and
- 00:14:46spelling uh who died and LM thought she
- 00:14:50died and she gave a it gave a past tense
- 00:14:52okay actually thought that was pretty
- 00:14:54clever reasoning on the modotto except
- 00:14:57it's not even higher order to know that
- 00:14:58they're different people so then that
- 00:15:01got us a lot of attention people were
- 00:15:02beginning to start thinking okay look
- 00:15:03the sources thing is good but can we
- 00:15:06really trust the answers these things
- 00:15:07are uh saying and then um that got into
- 00:15:12into this trend of people uh like
- 00:15:13searching for themselves this is
- 00:15:15something that keeps happening time and
- 00:15:17again with all consumer products when I
- 00:15:19got a chance to speak to Mike ker uh
- 00:15:21that vacation uh he said the same that
- 00:15:24even though you can click on your own
- 00:15:26profile icon and go go back to your
- 00:15:28photos people always love to go to their
- 00:15:31profile on Instagram by typing their
- 00:15:33username on the search bar it's such a
- 00:15:36human habit yeah so we a lot of people
- 00:15:39start putting their Twitter handles or
- 00:15:41social like usernames and then it would
- 00:15:43Mash all their activity across the
- 00:15:45internet including stuff they did in the
- 00:15:48childhood like many years ago and then
- 00:15:51give like this interesting summaries and
- 00:15:52they would screenshot it and share it
- 00:15:54yeah so I thought there was something
- 00:15:55there there something driving it that
- 00:15:57you but I still wasn't sure yeah and
- 00:15:59then we release the ability to ask
- 00:16:01follow-up questions that double the
- 00:16:03engagement time on the site and also
- 00:16:05increase the number of questions every
- 00:16:07day and number of people number of
- 00:16:09questions every day was increasing
- 00:16:10exponentially so I was like okay this is
- 00:16:13there's something here it's not worth
- 00:16:14killing and pivoting to Enterprise you
- 00:16:16have this like initial momentum and you
- 00:16:19you said earlier it wasn't until
- 00:16:20hindsight that you had the idea that
- 00:16:22like oh we actually have a chance of
- 00:16:23competing with somebody like a Google um
- 00:16:26when did that realization happen in this
- 00:16:27journey how' that go down so I never
- 00:16:29really thought about the Google
- 00:16:31competition in a serious way to be very
- 00:16:33honest um because I knew that like the
- 00:16:37they cannot make this exact product on
- 00:16:40the Google homepage it's so hard to know
- 00:16:43when a query is purely informational or
- 00:16:45not and then the Google search page is
- 00:16:47already like so cluttered that's the
- 00:16:49answer box the knowledge panel uh
- 00:16:52there's some ads there's some links
- 00:16:53there's you know like perspectives from
- 00:16:56socials all these social cards it's all
- 00:16:59too much information so that it's
- 00:17:01clearly like feels like you know fast
- 00:17:03food and like healthy meal difference
- 00:17:06for using Google and perplexity on even
- 00:17:08informational queries I was more worried
- 00:17:10about like Microsoft in the beginning uh
- 00:17:13because they were launching Bing chat in
- 00:17:15fact on the day we agreed to uh have a
- 00:17:18term sheet like hand Shook on a term
- 00:17:20sheet uh with with with with one of the
- 00:17:23Venture Capital investors Nea here uh in
- 00:17:25in San Road after like one week of
- 00:17:28torturous pictures and we just having
- 00:17:30like uh uh like coffee and then the
- 00:17:34Verge leak screenshots of Bing chat and
- 00:17:37um I was like okay like uh there's this
- 00:17:3930-day due diligence period right and
- 00:17:42one of the other investors would give me
- 00:17:43a term sheet he just increased it to 45
- 00:17:45days you know you could see the diff
- 00:17:47yeah right it was done sneakily and I
- 00:17:50knew why clearly he also text what do
- 00:17:53you think about this thing okay okay I
- 00:17:55get it I get it getting a little
- 00:17:56sheepish and then the other person I
- 00:17:58hand with like he text me the night
- 00:18:00saying hey do you have time for a call
- 00:18:02tomorrow okay like clearly like this is
- 00:18:05it right so I told my co-founder look
- 00:18:07maybe they're going to uh back out or
- 00:18:10ask us to Pivot so um maybe we should
- 00:18:14just try to sell the company and like
- 00:18:15get it done you know this is not going
- 00:18:17to go anywhere the person actually who
- 00:18:19hand shook said look I'm not going to
- 00:18:21ask you to Pivot I'm not going to ask
- 00:18:22you to like do anything different uh you
- 00:18:26guys keep going and uh we already word
- 00:18:28is word and I I was like damn that's
- 00:18:30that's pretty impressive and then the
- 00:18:31next week actually Google also releases
- 00:18:34a Blog from Sundar saying they're
- 00:18:36announcing something called The Bard
- 00:18:37with just screenshots so we knew that
- 00:18:39like this is going to get pretty big and
- 00:18:41competitive but we were like look it's
- 00:18:44at the end um Microsoft was never really
- 00:18:48good at consumer products for a long
- 00:18:49long time you can't suddenly change that
- 00:18:52uh so they actually messed up the
- 00:18:53opportunity in my opinion totally Google
- 00:18:55obviously I knew that they're going to
- 00:18:57have their own problems challenges so I
- 00:18:59felt like there was space for someone
- 00:19:01else here yeah having spent almost a
- 00:19:03decade at Google myself um I see a lot
- 00:19:06of the culture of the early days of
- 00:19:08Google like the things I've learned
- 00:19:09about Larry or about SAR and I see a lot
- 00:19:12of that in the way that you have built
- 00:19:13your product like there's a lot of
- 00:19:15attention to detail feels like you are
- 00:19:16the primary user of the product yourself
- 00:19:19like is that a thing that you
- 00:19:21deliberately tried to do yeah I did I
- 00:19:23did deliberately try to do it uh one
- 00:19:25thing that Larry said is like you know
- 00:19:27we we uh I keep reminding everyone in
- 00:19:30our company about it the user is never
- 00:19:32wrong so even today while testing a new
- 00:19:35feature um it didn't work uh but there
- 00:19:39was some ambiguity in the query so the
- 00:19:42person I was talking to the engineer and
- 00:19:44say Hey you know this is not good what
- 00:19:46else could theyi have done here and you
- 00:19:50know what they should have done it
- 00:19:51should have come and clarified to me
- 00:19:53right and and asked me hey I'm not sure
- 00:19:55either it's this or this which one did
- 00:19:58you actually want
- 00:19:59and then I should have clarified and
- 00:20:00then it should have gone and done
- 00:20:01instead of saying I don't know that is
- 00:20:04the user is never wrong principle the
- 00:20:06other way of Designing products is like
- 00:20:08make the user be a better prompt
- 00:20:10engineer mhm blame the user and tell
- 00:20:13them to be a better prompt engineer
- 00:20:14teach them educate them get them to do
- 00:20:15it the way that the product wants to do
- 00:20:17it yeah exactly enterprise software is
- 00:20:19more like second kind yeah but magical
- 00:20:22consumer products are more the first
- 00:20:23kind age right like in Google why should
- 00:20:26uh Google have handled typos they need
- 00:20:28it right we should have all been great
- 00:20:30at English it's like Larry says he was
- 00:20:32never good at spelling and that's why I
- 00:20:34think the true story is YC partner Paul
- 00:20:37buite he was just annoyed by it and he's
- 00:20:38like someone should build that yeah
- 00:20:40exactly and spell check corrector it's
- 00:20:42all there similarly Auto suggest why is
- 00:20:45it there like easier right similarly uh
- 00:20:48cached results I was even reading
- 00:20:50somewhere where Larry wanted the
- 00:20:51homepage to have the a simulation of the
- 00:20:54weather outside your home so that you
- 00:20:56don't even need to type the weather
- 00:20:58query is this already there so I was
- 00:21:00very influenced by that style of design
- 00:21:02like including like subtle things like
- 00:21:04Chrome search bar if you've already gone
- 00:21:06to a site it's already there you just
- 00:21:08have to click enter after typing the
- 00:21:09first two letters so that influenced me
- 00:21:12to like make sure we have the cursor
- 00:21:15ready to type on the search bar you
- 00:21:17don't need to take your mouse and place
- 00:21:19it there it sounds like your your main
- 00:21:20metric that you care about is number of
- 00:21:22queries per day which is exactly what
- 00:21:24Google did I think in the early days
- 00:21:25right it's hard to grow that uh
- 00:21:29uh without like retention in the long
- 00:21:31run you cannot just uh pay for a user
- 00:21:34and get that number up user could
- 00:21:36install your app and maybe you can even
- 00:21:38game it where when they install as one
- 00:21:40query automatically submitted but a
- 00:21:42repeat query doesn't need to be
- 00:21:43submitted yeah I think the only counter
- 00:21:45example which I don't think is happening
- 00:21:46in your case is the product is not
- 00:21:48serving their needs and so they need to
- 00:21:51issue a bunch of queries to get what
- 00:21:52they want which is kind of the opposite
- 00:21:53of like Larry's approach on Google was
- 00:21:56you should be on Google as short as
- 00:21:57possible cuz trying to get you somewhere
- 00:21:59else to solve your so that's not
- 00:22:01happening I mean sure I'm sure there are
- 00:22:03some errors and stuff but most of the
- 00:22:06followup queries actually we see are
- 00:22:07like completely irrelevant to the first
- 00:22:09query because they just want to keep
- 00:22:10continuing the session or questions that
- 00:22:13they never even knew they wanted to ask
- 00:22:15but they want to keep asking so so I
- 00:22:17presume your team has grown a bunch you
- 00:22:19raised a bunch of money um how do you
- 00:22:22manage the team how do you operate your
- 00:22:24team on a week to week or or cycle to
- 00:22:26cycle basis with that you know number of
- 00:22:29queries per day is our primary metric so
- 00:22:32every All Hands we start with that
- 00:22:33number okay I don't believe in this um
- 00:22:36putting a TV and having the metric you
- 00:22:38know being seen every day because I
- 00:22:40think that's also distracting but I I do
- 00:22:43think like it it makes sense to take a
- 00:22:44look every week see the weekly growth
- 00:22:46rates um see the monthly growth rates
- 00:22:49and like if something declined then
- 00:22:52discuss about it figure out ways to
- 00:22:54actually freak out if something declines
- 00:22:56we do and something grows was like look
- 00:22:59into why where so we are very data
- 00:23:01driven and we shareed across the company
- 00:23:05actually I've been trying to share to
- 00:23:07the users too so that they feel like uh
- 00:23:10you know it's it's an something that's
- 00:23:12actually happening right in front of
- 00:23:13their eyes and and they want to be part
- 00:23:15of it there's no hierarchy like if if
- 00:23:18there is some bug to be fixed if I know
- 00:23:20some particular person's working on it I
- 00:23:22can go and talk to the person directly
- 00:23:24nobody else feels threatened because I'm
- 00:23:26going and talking to that person there
- 00:23:27is no feeling that because I'm raising a
- 00:23:29bug uh uh it's like oh they are going to
- 00:23:32be fired or something uh because I
- 00:23:34raised like 50 bugs a day so you know
- 00:23:37like it's more like they understand okay
- 00:23:40this it's important for the product to
- 00:23:42feel uh great and if it doesn't feel
- 00:23:45good for ourselves then the user is also
- 00:23:47not going to feel that in fact we have
- 00:23:49way more incentive to go use our own
- 00:23:51product but the user doesn't so the
- 00:23:53standards for the user should be even
- 00:23:54higher so always feel like a user I
- 00:23:57think that culture is there company I
- 00:23:59love that and and did you intentionally
- 00:24:01select for that when you were hiring
- 00:24:03like people who were very product
- 00:24:04Centric and in the details I wouldn't
- 00:24:06say I I explicitly had that as a
- 00:24:08Criterion but I look for people who
- 00:24:10cared about doing good work if you don't
- 00:24:13care and you're just reading it as a job
- 00:24:15then it's very hard for you to get
- 00:24:17excited about things and I think so much
- 00:24:19of it feeds off of the founders and like
- 00:24:21your culture your DNA and sounds like
- 00:24:23you're that type of person that obsesses
- 00:24:25over the details and you're just going
- 00:24:27to naturally want to hire people who
- 00:24:28share that trait yeah I I do get pissed
- 00:24:31off if answers are wrong and I do get
- 00:24:33pissed off if people on Twitter are
- 00:24:34saying like perplexity is degrading or
- 00:24:36like you know but a lot of the things
- 00:24:38this some things are actually not true
- 00:24:41but I do try to see you know leave aside
- 00:24:44the cynicism um even if it was someone
- 00:24:47who's like a hater y but if there was
- 00:24:50something true there and I want to still
- 00:24:52know yeah I I love seeing you engage on
- 00:24:55Twitter with customers is that the
- 00:24:57primary way that you talk to users or
- 00:24:59are there lots of other ways that you
- 00:25:01are talking so I mainly use x Twitter
- 00:25:04people are just like super like brutally
- 00:25:07honest there and uh I think in email
- 00:25:10people are a lot more polite yeah which
- 00:25:12is okay too like I I like both sides but
- 00:25:14I think the brutal honesty brings out
- 00:25:16the worst bugs and uh things that people
- 00:25:19are afraid to say oh and in person is
- 00:25:21the worst where you go show someone
- 00:25:23something and they're just going to tell
- 00:25:24you good things even if they hate it I
- 00:25:26kind of like don't like any hey what hey
- 00:25:28tell me what do you think yeah you're
- 00:25:30always gonna say nice things right
- 00:25:32you're gonna grow your company
- 00:25:34presumably you're going to need to hire
- 00:25:35more people how do you avoid the fate of
- 00:25:38becoming a big slow company well it's uh
- 00:25:41beginning to happen already a little bit
- 00:25:43right we're not as fast as we used to be
- 00:25:46I think some of it is not because of
- 00:25:47people it's it's also because things
- 00:25:50breaking in production people start
- 00:25:53losing trust in the product like today
- 00:25:56we deployed some change and then someone
- 00:25:57got rated that there was some uh front
- 00:26:00and Bug somewhere it was actually
- 00:26:01something in the backend but people are
- 00:26:03just assuming things I think like uh
- 00:26:06fast loading all that stuff matters and
- 00:26:09not every new engineer uh has the full
- 00:26:12context of the code base in their head
- 00:26:13the earlier ones to there's some tension
- 00:26:15in like moving fast and breaking things
- 00:26:17if you do want to like grow to mass
- 00:26:19Market usage uh so that's mainly slowing
- 00:26:22us down I would say uh and I haven't we
- 00:26:25haven't quite figured out like the best
- 00:26:27way to do this fast I mean we do have
- 00:26:28staging deployment testing AB test and
- 00:26:31all that stuff's happening and that's
- 00:26:33naturally slowing us down and like
- 00:26:34getting things out to production widely
- 00:26:37other than that I would
- 00:26:38say uh the obsessive detail oriented
- 00:26:42people uh they're only that many people
- 00:26:45in the world so obviously you cannot
- 00:26:47expect engineer number 250 to be like
- 00:26:49that M uh but I I I try my best to still
- 00:26:53like you know go flag bugs to whoever is
- 00:26:55working on whatever new feature uh and I
- 00:26:57kind of like know who's working on what
- 00:27:00even at the size I still try I think our
- 00:27:03co-founders are amazing they they care
- 00:27:05and they push that principle when
- 00:27:08they're like building their teams so uh
- 00:27:11we we we are trying our best I'm not
- 00:27:12saying it's us we figured it out cracked
- 00:27:14it uh but at least like we're trying to
- 00:27:17fight the entropy here I think that's
- 00:27:19the only thing you can try right and
- 00:27:21it's a uphill battle but if you keep on
- 00:27:23it yeah okay let's talk a little bit
- 00:27:25about the future um you know I've seen
- 00:27:27you you're most recent launches are kind
- 00:27:29of like in different directions more
- 00:27:32verticalized or more specific around
- 00:27:33shopping or or other things where do you
- 00:27:35want to take it like today my view of
- 00:27:38perplexity is a more intelligent Google
- 00:27:41search that's really useful in certain
- 00:27:44scenarios where do you what do you want
- 00:27:45me to think it of it in three or four
- 00:27:48years if you go and research what's the
- 00:27:51best sweater to buy or uh which the best
- 00:27:54hotel to stay in this location
- 00:27:56perplexity will give you a great answer
- 00:27:58but where do you actually go and fulfill
- 00:28:00the demand you go to Google and who gets
- 00:28:03credit for that monetarily Google Google
- 00:28:06we we got nothing maybe we get you a pro
- 00:28:08subscription but then someone else will
- 00:28:10undercut us and give it away for free
- 00:28:12with like cheaper models or whatever
- 00:28:14they have bigger cash reserves so the
- 00:28:16challenge is like you want to be uh one
- 00:28:19place where people can have the endtoend
- 00:28:21experience they start with a problem in
- 00:28:23their mind and they seek your help you
- 00:28:27give them the answers
- 00:28:28and you also help them fulfill the
- 00:28:30action it's difficult because uh people
- 00:28:33think like at the if you have an answer
- 00:28:35of like oh like what watch does uh Bezos
- 00:28:39wear MH I think he wears some omega or
- 00:28:42something um I personally thought it
- 00:28:44would be amazing if it not only gave the
- 00:28:47answer but it also had a product card
- 00:28:50for the specific Omega watch with a buy
- 00:28:53button and I just click buy and it's
- 00:28:54done but there are other people in the
- 00:28:57world who think that's an
- 00:28:58it's not even an ad right they think
- 00:29:01like that company is paying us to do
- 00:29:02this so this is where like some of the
- 00:29:04tension with uh the early adopters who
- 00:29:07love the adree informational
- 00:29:10experience with like what is actually
- 00:29:13needed to get Mass market and really be
- 00:29:15useful on a daily basis comes from and
- 00:29:17there are so many other things like
- 00:29:19checking the score of a game or quickly
- 00:29:21getting to a website uh if you just
- 00:29:23wanted to get a docs link of an API or
- 00:29:26if you just wanted to go and book flight
- 00:29:28on United the answer could just be a
- 00:29:30link the answer could be the weather for
- 00:29:32tomorrow that's the temperature or
- 00:29:34someone's age should be like you going
- 00:29:36type like Elon Musk Networth you'll just
- 00:29:38get the answer in like less than a
- 00:29:39second on Google right in perplexity
- 00:29:41it'll pull the right Source maybe it
- 00:29:43might be more accurate than Google but
- 00:29:46people don't care about like some of
- 00:29:47this Minor Details so what you need to
- 00:29:50build is this amazing
- 00:29:52orchestration of small models uh typical
- 00:29:56knowledge graphs uh
- 00:29:58widgets llm streaming answers and more
- 00:30:01complicated multi-step reasoning answers
- 00:30:04but user doesn't care like user is not
- 00:30:07going to tell you like when to use what
- 00:30:09you decide that AI nobody talks about
- 00:30:12like when to use what that that's s of
- 00:30:14router that that orchestrator I think
- 00:30:16that's the hardest thing to build and
- 00:30:18whoever builds that and and and and can
- 00:30:20operate that at a scale of billion users
- 00:30:23and also knows how to monetize like some
- 00:30:25of those queries really well right is
- 00:30:28going to be the next Google cuz they'll
- 00:30:29have the search bar everything will they
- 00:30:31they know exactly what to do they'll go
- 00:30:32and ask clarifying questions they it
- 00:30:34truly understands the user and also does
- 00:30:37tasks for you and and also lets you like
- 00:30:39surf the web in the typical way all
- 00:30:41in-one experience you could even argue
- 00:30:43maybe nobody will ever be able to build
- 00:30:45this because it feels like a daunting
- 00:30:47task but I could say whatever Google has
- 00:30:50already built is the closest system to
- 00:30:52something like this agre so the next
- 00:30:55generation of this clearly can be buil
- 00:30:57MH you just have to like persever and
- 00:30:59work for a decade or two on this problem
- 00:31:01if I talk to people at Google they would
- 00:31:03say yep that's what we're building in
- 00:31:05fact I know they've been saying that for
- 00:31:06more than a decade um probably same at
- 00:31:09open AI probably the same at anthropic
- 00:31:11when you look at the people that you
- 00:31:13likely will be competing against in the
- 00:31:14next 10 years um what do you think is
- 00:31:17the piece that's maybe going to give you
- 00:31:19the edge to to win Obsession about the
- 00:31:22user and good product taste there's a
- 00:31:25lot of these things that require a lot
- 00:31:27of domain knowledge out of the list you
- 00:31:29mentioned Google is the only company
- 00:31:30that actually has the product taste to
- 00:31:33do this and and arguably like you know
- 00:31:37all the distribution in the world
- 00:31:38everything right except the Dilma is
- 00:31:40also there it's funnily like you know
- 00:31:42it's a search company but it's it's also
- 00:31:45an ads company and search is kind of
- 00:31:48almost exists in service of the ads comp
- 00:31:50yes not in the other way and you could
- 00:31:52argue okay that's outside the search
- 00:31:56Revenue every quarter which is like
- 00:31:58close to 200 billion a year MH there's
- 00:32:01still like 100 billion and so other
- 00:32:04other places YouTube and Cloud but the
- 00:32:08margins are all coming in search right
- 00:32:11cloud is only like recently profitable
- 00:32:13YouTube is not never going to be a high
- 00:32:15margin business because number one they
- 00:32:18they don't serve ads on subscription uh
- 00:32:21like users and number two like they have
- 00:32:23to pay the creators they have to pay the
- 00:32:25Media Partners so it's never going to be
- 00:32:27as High margins of search so you're
- 00:32:29arguing basically the stock price is
- 00:32:32going to be their encumbrance correct CU
- 00:32:34like ball TR is like like crazy it just
- 00:32:38automatically uh you know panics if
- 00:32:40search Revenue goes down but search
- 00:32:43Revenue has to go around in in a world
- 00:32:45where people are just directly talking
- 00:32:46to AIS and agents are doing stuff for
- 00:32:48them that doesn't mean they're not going
- 00:32:50to do anything about it they're still
- 00:32:51building Gemini and like the new app the
- 00:32:54hypothesis is that like they're not
- 00:32:56going to be able to easily put it on the
- 00:32:57ore Google where they already have all
- 00:32:59the billion users and that's true right
- 00:33:01right yeah you're you're arguing that
- 00:33:03whoever wins this in the long run will
- 00:33:05kind of by definition need to come up
- 00:33:07with a new monetization model a new
- 00:33:09business model yeah there's like a ton
- 00:33:10of other problems to solve like for for
- 00:33:13shopping or travel or like all these
- 00:33:15things like which which Merchants do you
- 00:33:17use or like which hotels do you plug
- 00:33:20into or you know who's the middleman
- 00:33:22there and who handles the booking and if
- 00:33:24a customer wants to cancel stuff Google
- 00:33:26actually saw these a lot of these
- 00:33:27problems too right they're not just like
- 00:33:30oh a page rank or like a map reduce or
- 00:33:34um you know all these advances that they
- 00:33:35made in like visual like deep learning
- 00:33:38and and and like Bird Transformers it's
- 00:33:40not just that that is great but they
- 00:33:42also did a lot of other boring work of
- 00:33:44bringing Google Finance Google shopping
- 00:33:47Google flights I feel like perplexity is
- 00:33:49better position to do these things than
- 00:33:50open air and Tropic because we have it
- 00:33:52in our DNA to care about the user and
- 00:33:54the product uh we're not just talking
- 00:33:56about reasoning and models right we but
- 00:33:58we are pretty much familiar with all
- 00:34:00those things and we are very much
- 00:34:02capable of taking the latest open source
- 00:34:04models and serving them ourselves and
- 00:34:06fine-tuning them and post training them
- 00:34:08and doing evals we're not like AI
- 00:34:10illiterate we're not going to like spend
- 00:34:12all our band with building data centers
- 00:34:14and chips and like trying to just talk
- 00:34:16about like breaking the most reason
- 00:34:18coding a math benchmarks I think there's
- 00:34:19value in that but it's quite autal to
- 00:34:22like building the next generation
- 00:34:24information experience all right Arvin
- 00:34:27thanks so so much for joining us it's
- 00:34:28great chatting thank you for having me
- 00:34:30again
- 00:34:35[Music]
- AI
- search engine
- Perplexity
- user experience
- monetization
- growth
- Arvin Shavas
- innovation
- technology