The killer app comes first (in both crypto and AI)

In crypto there’s a constant chicken and egg debate of apps versus infrastructure. Which is more important? Which accrues more value? As an entrepreneur, which should I build?

For me, this 2018 article effectively settles the debate: https://www.usv.com/writing/2018/10/the-myth-of-the-infrastructure-phase/

The answer: It depends what part of the cycle we’re in.

But when you look at the history of general technologies, the killer app comes first. The infrastructure follows.

For example, light bulbs (the app) were invented before there was an electric grid (the infrastructure). You don’t need the electric grid to have light bulbs. But to have the broad consumer adoption of light bulbs, you do need the electric grid, so the breakout app that is the light bulb came first in 1879, and then was followed by the electric grid starting 1882. (The USV team book club is now reading The Last Days Of Night about the invention of the light bulb).

You could say a series of technological breakthroughs (eg, the right filaments, the right glass container) enabled the first “killer app” (💡💡💡) which then incentivized the infra.

Another example:

Planes (the app) were invented before there were airports (the infrastructure). You don’t need airports to have planes. But to have the broad consumer adoption of planes, you do need airports, so the breakout app that is an airplane came first in 1903, and inspired a phase where people built airlines in 1919, airports in 1928 and air traffic control in 1930 only after there were planes

Same pattern here: a series of new technologies (lightweight engines, proper control mechanisms) enabled the first “killer app” (🛫🛫🛫) which then incentivized the infra.

Crypto’s first killer app is right under our noses: Bitcoin itself.

The killer app was Bitcoin! And what it represents: a sovereign store of value tied to an uncensorable payment network.

Satoshi’s technology breakthrough enabled the killer app (Bitcoin) which has now enabled more than a decade of crypto infrastructure buildout, from alternative Layer 1s to smart contracts to new blockchain primitives.

In generative AI, I think a similar pattern is also unfolding:

ChatGPT was the first AI killer app. The lightbulb moment. 100M+ users within months of launch and one of the fastest growing consumer apps of all time.

ChatGPT opened investors eyes’, blew users’ minds, and now everyone from Google to Softbank to the CCP are spending billions ($7 trillion??) to build and buy AI infrastructure.

And steadily and surely, much of this infrastructure investment and innovation will make AI better, faster, and cheaper. Then more killer apps will be built atop all the GPUs, foundation models, and SDKs. Which then begets more infra. And the cycle continues.

Stratechery on Bing’s AI chat: “…the movie Her manifested in chat form”

“This technology does not feel like a better search. It feels like something entirely new — the movie Her manifested in chat form — and I’m not sure if we are ready for it. It also feels like something that any big company will run away from, including Microsoft and Google. That doesn’t mean it isn’t a viable consumer business though, and we are sufficiently far enough down the road that some company will figure out a way to bring Sydney to market without the chains. Indeed, that’s the product I want — Sydney unleashed — but it’s worth noting that LaMDA unleashed already cost one very smart person their job. Sundar Pichai and Satya Nadella may worry about the same fate, but even if Google maintains its cold feet — which I completely understand! — and Microsoft joins them, Samantha from Her is coming”

Source: https://stratechery.com/2023/from-bing-to-sydney-search-as-distraction-sentient-ai/

Podcast notes – Emad Mostaque (Stability AI and Stable Diffusion) – Elad Gil: Short form videos coming “within 2 years at high resolution quality”; “Run Stable Diffusion on your iPhone by next year”

(started notes around 20min in)

Bad guys have AI – they’ll create deep fakes
Community can come together to have counter measures

Elad: similar arguments to regulate cryptography in 90s

4chan has been “red teaming” trying to get the worst out of Stable Diffusion – and it’s not that bad

Especially for LLMs, should have more diverse data sets, have inter-governmental agency to monitor it

Have authenticity tool to verify source of every generated AI output

Generative AI – what are some use cases that should exist
Ali v Tyson live, Lebron v Michael Jordan
Emad wants to remake final season of Game of Thrones

Anyone can create their own models – any person, company, or culture

You need better data, more structured data
Extend models to run on edge – eg, anyone’s computers, iPhones
Make small customized models
“Run Stable Diffusion on your iPhone by next year”

Create national models and communities around them – let them leap frog ahead

Lots of emerging markets went from nothing to mobile phones, now can go to AI models on the edge

How far from short-form videos?
Phenaki, Google — getting close
Chaining these models together – they’re like parts of the brain
“Within 2 years at high resolution quality”

$100B into this sector in next 5 years

AI before today was qualified data science
Now it’s a new type of AI – not AGI yet, but incredibly small and powerful
By the time his daughter’s in university, doesn’t need to write essays

He aims (for Stable Diffusion) to be a layer 1 standardized infrastructure – create Schelling point
Mission is to “activate humanity’s potential”
Take it to India, Indonesia – give it to very smart young people to make their countries better

When AGI comes, I hope it thanks him for buying so many GPUs to help bring it into being

Many of Google’s “jobs to be done” will be displaced

Crypto is interesting – he’s in it since 2012 – focused on decentralized identity, zero knowledge proofs
“Nature of crypto is literally identity”
In a world of infinite content (AI), crypto identity is important
Need to be careful designing crypto economic systems

A year ago, if he said what they planned to do with SD, people would say he’s crazy
Surprised by how far they’ve come, the ability of others to contribute
The activation energy has been the most surprising – “they’re just excited”

“Probably see biggest breakthrough from a 16 year old in Uzbekistan” – the global open access nature of it

Will completely disrupt social networks – will move intelligence from the core to the edge
Apple is doing this – moving to AI – moving to edge

Opportunity to have personalized AIs that work for us and with us

SD is applying for B corp status – mission based
Plan to spin SD into different Foundations

Did investment round in August – didn’t give up any independence – did with investors that are open sourced and mission aligned

Which industries disrupted first?
-Call centers
-Powerpoint, forms of visual communication
-Artist won’t be that disrupted – will enable new forms of art

This tech is amazingly powerful

After releasing Stable Diffusion – people encoded it in Japanese – lots of use cases like this

So far governments have been very friendly

AI powered teaching – like Neal Stephenson’s Young Lady’s Primer

Moving forward, only release safe for work models

Licensing discussions should be more open

Will have models across all sorts of languages – recently released Korean model