Random facts 9 – things I learned recently – Hugh Howey: “I’ll write 2 books a year for 10 years. And at the end of that 10 years I’ll know if I’m a writer.

All of these costs will trend down until eventually it’s just like…the cloud. Like they’re all the same. You might use AWS or Oracle or IBM Cloud, they all have different purposes, but you don’t really care, but there might be lockin. You build your stack on AWS, it’s kinda expensive, you want to switch but it’s difficult… if I had to guess that’s how this plays out…
Turner Novak

Tunnel vision helps. Being a bit of a shit helps. A thick skin helps. Stamina is crucial, as is a capacity to work so hard that your best friends mock you, your lovers despair and the rest of your acquaintances watch furtively from the sidelines, half in awe and half in contempt. Luck helps—but only if you don’t seek it.

And the Portuguese rutter? That’s our death warrant, for of course it’s stolen. At least it was bought from a Portuguese traitor, and by their law any foreigner caught in possession of any rutter of theirs, let alone one that unlocks the Magellan, is to be put to death at once. And if the rutter is found aboard an enemy ship, the ship is to be burned and all aboard executed without mercy.

Alan Greenspan in 1966, when he was still in the private sector:
An almost hysterical antagonism toward the gold standard is one issue which unites statists of all persuasions…In the absence of the gold standard, there is no way to protect savings from confiscation through inflation. There is no safe store of value. If there were, the government would have to make its holding illegal, as was done in the case of gold. The financial policy of the welfare state requires that there be no way for the owners of wealth to protect themselves

It is breathtaking how slow, substandard and unfocused many companies out there get through the day. And think nothing of it. The lack of energy is palatable. There is performance upside everywhere. As a leader, your opportunity is to reset in each of these dimensions. You do it in every single conversation, meeting, and encounter

In a system that depends on irresponsible government spending (especially for perpetual war) and fiat printing to cover that irresponsibility, alarm bells cannot be allowed to work. There must be no pure price signals. And above all, an alarm bell must not also serve as a life-raft that’s easily accessible to everyone, especially the general public, in the form of an ETF. There must be no escape hatch

The overall degree is negligible. In 2013, researchers found that the average degree of personalization in Google Search was 11.7%, of course varying widely by query and rank. Higher positions, for example, have a higher chance of being personalized than lower positions.11 A study from 2019 found that Google personalizes 2/10 results when searching for people and 4/10 for political parties. In other words, not much

When you’re healthy you have 10,000 needs, but when you’re sick you only have 1

marketplaces are fueled by two core properties: 1) discovery and curation (presenting things that users want to see and interact with), and 2) trust and reputation (providing assurances to users)

I think for most people who want to do great work, the right strategy is not to plan too much. At each stage do whatever seems most interesting and gives you the best options for the future. I call this approach “staying upwind.” This is how most people who’ve done great work seem to have done it

From Mercedes effectively renting you your accelerator pedal by the month to Internet of Things dishwashers that lock you into proprietary dish soap, enshittification is metastasising into every corner of our lives. Software doesn’t eat the world, it just enshittifies it.

Tyler Cowen, economist, professor, and founder of the popular blog Marginal Revolution, developed three laws while he was teaching macroeconomics. One: “There is something wrong with everything,” two: “There is a literature on everything” and three: “All propositions about real interest rates are wrong.”

Also, he changes one menu item every week. Has a massive spreadsheet that tells him what’s being ordered, profit margins on each item, etc. He gets rid of the least popular thing, tries something else. Every. Single. Week

The interesting thing about OnlyFans is that OF agencies use the models as image/video content to bait simps. However, many of the OF girls are unable to talk to so many simps at once and end up using virtual assistants who are following a script in an attempt to extract maximal value from simps by sending them prepared media from a google drive after the simp tips his final buck. Even if it is not real, it feels real to the end consumer and that is all that matters

They say movies are the shared dreams of the audience—that’s why they have to be experienced in the dark.

“Peter Thiel used to insist at PayPal that every single person could only do exactly one thing. And we all rebelled. You feel like it’s insulting to be asked to do just one thing.
But Peter would enforce this pretty strictly. He’d basically say: ‘I will not talk to you about anything else except for this one thing that I’ve assigned to you. I don’t want to hear about how great you’re doing in this other area. Just focus until you conquer this one problem.’…
The insight behind this is that most people will solve problems that they understand how to solve. Roughly speaking, they will solve B+ problems instead of A+ problems. A+ problems are high-impact problems for your company but they’re difficult–you don’t wake up in the morning with a solution to them, so you tend to procrastinate…
If you have a company that’s always solving B+ problems, you’ll never create the breakthrough idea because no one is spending 100% of their time banging their head against the wall every day until they solve it”

“Failure is the information you need to get where you’re going”
Every time in Delphi’s history when we expected or “needed” something to happen. It didn’t happen and ended up turning out for the better.
– We weren’t able to raise money to start our business so we bootstrapped it ourselves and today, Delphi is fully employee owned.
- We weren’t able to finish raising a fund, and today – Delphi Ventures is basically all prop capital.
- There were numerous times we *almost* got acquired and ended up saying no – and it’s resulted in us building up Delphi into a brand we’re proud to be building for the space first and foremost

When galaxies collide, the black holes at their center begin orbiting one another before merging, and astronomers have just identified the largest pair yet. Researchers estimate that the black holes at the center of elliptical galaxy B2 0402+379 (the Loop’s longtime favorite galaxy, obviously) weigh about 28 billion times the mass of the Sun.

Curse of Knowledge: The inability to communicate your ideas because you wrongly assume others have the necessary background to understand what you’re talking about.

Compassion Fade: People have more compassion for small groups of victims than larger groups, because the smaller the group the easier it is to identify individual victims.

Bottom line: There is room up in organizations to boost performance by amping up the pace and intensity. Considerable slack naturally exists in organizations to perform at much higher levels. The role of leadership is to convert that lingering potential into superlative results

We see in professional sports all the time how teams go almost overnight from losing to winning with basically the same roster, but different leadership. Call it what you want, the X factor, whatever, it is real. Anybody can dial into this, but not many do.

It is not easy because you will drive people out of their comfort zones. There will be resistance. Change is hard. Some will vote with their feet. If you want to be popular as a leader, this may not be for you. The role of a leader is to change the status quo, step up the pace, and increase the intensity. Leaders are the energy bunnies and pacemakers of the organization. Some people drain energy from organizations; not leaders, they engulf organizations with energy.

Open Source vs. Proprietary Models: Zhu discusses the ongoing debate between open-source and proprietary AI models. He predicts that open-source models will eventually catch up with, if not surpass, their proprietary counterparts. This viewpoint reflects his belief in the democratization of AI technology and skepticism toward the long-term dominance of closed, proprietary systems.

If you’re not nervous it doesn’t mean anything to you — Justin Thomas

The inevitable direction of history is that the vast majority of AI systems will be built on top of open source platforms – Yann Lecun

“Deep learning, which is fundamentally a technique for recognizing patterns, is at its best when all we need are rough-ready results, where stakes are low and perfect results optional“ Still true

Your worst day is a chance to show your best qualities, to stand out, and to learn an enormous amount about yourself. Very few people plan or prepare for what they’ll do and how they’ll act during those times. Those who do might well end up turning their worst day into their best

In short, it will FEEL like a regular bear cycle, but in reality the game has changed for BTC and ETH – forever.
This means the window in time for the average non rich person to get generational exposure to BTC and ETH is closing, very rapidly

Essentially, most people will be priced out of owning 10 ETH or 1 BTC.
I also believe that going forward alts will be less appealing each cycle as people just prefer the concensus trade of BTC and ETH that are guaranteed to go up due to ETF flows + because of new market participants size, you could still get 20-50% per year, with way less downside risk.
As such I think people will be less interested in altcoins.
This mimics how the S&P500 works, with basically 4-6 massive tech firms, like Google, apple, amazon, meta etc. Propping up the entire thing

Hugh Howey (on Tim Ferriss): I’ll write 2 books a year for 10 years. And at the end of that 10 years I’ll know if I’m a writer.

The trouble with Xi Jinping is that he is 60 percent correct on all the problems he sees, while his government’s brute force solutions reliably worsen things. Are housing developers taking on too much debt? Yes, but driving many of them to default and triggering a collapse in the confidence of homebuyers hasn’t improved matters. Does big tech have too much power? Fine, but taking the scalps of entrepreneurs and stomping out their businesses isn’t boosting sentiment. Does the government need to rein in official corruption? Definitely, but terrorizing the bureaucracy has also made the policymaking apparatus more paralyzed and risk averse. It’s starting to feel like the only thing scarier than China’s problems are Beijing’s solutions.

“When you cook for yourself there’s love in there”

“resilience matters in success…I don’t know how to teach it to you except for, ‘I hope suffering happens to you’..greatness comes from character & character…is formed out of people who suffered..I wish upon you ample doses of pain & suffering” – Jensen Huang

We are in a “Tower of Babel” moment of AI research, where hundreds of thousands of scientists, engineers, and technologists are collectively using the same language to tackle every engineering problem under the sun.

As I usually do, I’ve appended our 1997 letter, our first letter to shareholders. It gets more interesting every year that goes by, in part because so little has changed. I especially draw your attention to the section entitled ‘‘It’s All About the Long Term.’’

that an effective technique of conversion consists basically in the inculcation and fixation of proclivities and responses indigenous to the frustrated mind.

A counterculture is blowback. It’s intentionally offensive to establishment beliefs. Find it repellent? Good, it’s meant to gatekeep you.

Norwegian endurance training hack: high volume lactate threshold training. Train just below lactate threshold so you can do a lot more volume instead of at or above which requires a lot more recovery

More than a thousand years before Christ, Zarathustra preached the existence of a heaven and a hell, the idea of a bodily resurrection, the promise of a universal savior who would one day be miraculously born to a young maiden, and the expectation of a final cosmic battle that would take place at the end of time between the angelic forces of good and the demonic forces of evil.

in 2016, Google DeepMind’s AlphaGo AI challenged 14-time world champion Lee Sedol and won four out of five games. The next revision of AlphaGo was completely out of reach for human players: it won 60 straight games, taking down just about every notable Go player in the process.

the Bell Labs patent lawyers wanted to know why some people were so much more productive (in terms of patents) than others. After crunching a lot of data, they found that the only thing the productive employees had in common (other than having made it through the Bell Labs hiring process) was that “Workers with the most patents often shared lunch or breakfast with a Bell Labs electrical engineer named Harry Nyquist. It wasn’t the case that Nyquist gave them specific ideas. Rather, as one scientist recalled, ‘he drew people out, got them thinking'”

Once you make a decision, go all in.
Commit fully to your choices. Half-hearted efforts yield half-hearted results.
Indecision only leads to stagnation and missed opportunities.
Stay committed to your goals, even when faced with obstacles and setbacks. Perseverance is single-handedly the most important key to achieving a goals.

we’ll see Software 2.0 subsume more and more of the existing Software 1.0 stacks, resulting in more compact human-written codebases with the bulk of engineering complexity offloaded to data and learning. One of the most profound benefits of end-to-end machine learning is that it can drastically reduce the amount of code needed. Before deep learning, the AI backing Google Translate was roughly a 500,000-line codebase. After deep learning, a single neural network could be expressed in about 500 lines of TensorFlow code, with the bulk of “translation knowledge” now replaced with data.

Bezos shareholder letters

I invite you to please read the section entitled It’s All About the Long Term, as it is the best way I know to help make sure we’re the kind of company you want to be invested in. As we wrote there, we don’t claim it’s the right philosophy, we just claim it’s ours!

We are doubly-blessed. We have a market-size unconstrained opportunity in an area where the underlying foundational technology we employ improves every day. That is not normal.

Hayek would in particular focus on the function and effect of prices. Prices, he went on to explain in the following years, are the market’s decentralized and socially scalable means of communication. Although established as a simple function of supply and demand for goods and services in an economy, Hayek described how prices actually embed a wide array of relevant information that individuals require to make economic decisions.

Bitcoin is the most successful financial meme since gold and even at today’s all-time high, all the bitcoin in the world is still only worth about 1/14 of all the gold in the world.
Unlike the gold meme, which has infected about as many minds as it ever will, the bitcoin meme is growing — and it’s growing in a time when 1) people have more money than ever to invest and 2) people are more than ever looking for lottery-ticket type investments

Financial Nihilism goes hand in hand with Populism – a political approach that strives to appeal to ordinary people who feel that their concerns are disregarded by established elite groups

The dirty secret of influencer marketing: ~80%+ of influencers DO NOT CARE about anything but $
I see this happen 24/7 in my space. They don’t care about product quality, brand (theirs or the brand they’re repping), their audience, etc. They just want $$$
The reasons why are simple:
– They don’t make a lot of $ (even large accounts)
– This is usually their 1st business venture
– They suffer from extreme short-term thinking / high time preference
– They don’t understand how brand is built
– They can be quite entitled

Peter Thiel on The Power Law of Distribution:
“One distribution method is likely to be far more powerful than every other for any given business:
Distribution follows a power law of its own.
This is counterintuitive for most entrepreneurs, who assume that more is more. But the kitchen sink approach—employ a few salespeople, place some magazine ads, and try to add some kind of viral functionality to the product as an afterthought—doesn’t work. Most businesses get zero distribution channels to work. Poor sales rather than bad product is the most common cause of failure. If you can get just one distribution channel to work, you have a great business.”

Perhaps the most important insight NASA has gleaned from studying team dynamics—in space and on Earth—is the preciousness of one trait in particular: a sense of humour. Studies of crews overwintering at the South Pole show that a confined group needs people to fulfil various roles, including leader, storyteller and social secretary. But the most important task by far is that of the clown, a person who is funny and also wise enough to understand each member of the group and defuse tensions. Laughter, as much as courage, will sustain astronauts on their long quest to Mars.

The guy I know who is the best at friendships (also a spectacular salesman) keeps proposing plans. I asked him why once & he told me:
People get busy. If you want to be their friend, don’t take it personally & keep asking.
He did this with me & he eventually became one of the few genuine, lifelong friends I’ve made in adulthood.

Studies show that by adding physical activity to our lives, we become more socially active—it boosts our confidence and provides an opportunity to meet people. The vigor and motivation that exercise brings helps us establish and maintain social connections.

That’s why mottoes such as Google’s “Don’t be evil” and Facebook’s “Make the world more open and connected” mattered; they instilled a sense of mission in workers

Nothing is Something: “The most underutilized parenting strategy is doing nothing.”– Dr. Becky Kennedy

When Facebook was telling MySpace users they needed to escape Murdoch’s crapulent Australian social media panopticon, it didn’t just say to those Myspacers, “Screw your friends, come to Facebook and just hang out looking at the cool privacy policy until they get here.” It gave them a bot. You fed the bot your MySpace username and password, and it would login to MySpace and pretend to be you, scraping everything waiting in your inbox and copying it to your Facebook inbox

When Microsoft was choking off Apple’s market oxygen by refusing to ship a functional version of Microsoft Office for the Mac in the 1990s — so that offices were throwing away their designers’ Macs and giving them PCs with upgraded graphics cards and Windows versions of Photoshop and Illustrator — Steve Jobs didn’t beg Bill Gates to update Mac Office. He got his technologists to reverse-engineer Microsoft Office and make a compatible suite, the iWork Suite, whose apps, Pages, Numbers and Keynote could read and write Microsoft’s Word, Excel and PowerPoint files

Obviously the most exciting story to write will be the one you want to read. The reason I mention this case explicitly is that so many people get it wrong. Instead of making what they want, they try to make what some imaginary, more sophisticated audience wants. And once you go down that route, you’re lost

The signals have changed over the years: After horse equipage, it was Hermès trunks for traveling by rail, then large Hermès bags for day trips by automobile, and then small Hermès handbags for everyday use (originally sized to fit in the overhead bin of an airplane

The first modern LLM, Jeremy Howard’s ULMFit, was trained on Wikipedia. GPT was trained on a corpus of books. GPT-2 was trained on the reddit-curated “WebText,” corpus, i.e., a crawl of websites linked on Reddit. GPT-3 expanded the dataset scope to web text from CommonCrawl. Data selectivity trended downward as data volume and diversity requirements went up.

It is one of the main tasks of a real leader to mask the grim reality of dying and killing by evoking in his followers the illusion that they are participating in a grandiose spectacle…

Puzzlingly though, despite facing an increased risk of skin cancer, people who are exposed to lots of sun appear to have longer life expectancies, on average, than sun avoiders.

Prior editions:

Podcast notes – Demis Hassabis (CEO of DeepMind) – Lex Fridman

This podcast made me feel very stupid, and very inspired.

Turing test – in 1950s, Turing didn’t mean it to be a rigorous formal test, more of a philosophy experiment, didn’t specify things like parameters of test, how long test should last, etc

More modalities than just language to express intelligence eg physical movement

Played chess at 4, earnings from winning a chess competition let him buy a computer
Bought programming books, started making games, felt they were a magical extension of your mind

“AI is ultimate expression of what a machine can do or learn”

At 12yo he got to chess masters level, the process of learning chess makes him think a lot about thinking and about brains

“Chess computer handbook” by David Levy – explained how chess programs were made

First AI program he built was on his Amiga, programmed Othello

Wrote game called “Theme Park” with a core AI, sandbox game, reacted to players, every game was unique

He designed and wrote AI for games in 90s – at the time, game industry was cutting edge of tech (GPUs for game graphics, AI, John Carmack)

“Black and white” game – train a pet, and depending on how you train it, it would be more or less kind to others, powerful example of reinforcement learning

DeepMind – core part of strategy from start was to use games to test how well AI is doing, if the ideas are working
Eg, Go – clear rules and win conditions, humans have played for thousands of years, easy to test how good is your system vs human players
Part of why their AI has progressed so quickly – by developing against games

“Chess is drosophila of intelligence” – Gary Kasparov
Many AI researchers have all wrote chess AI programs

DeepBlue beating Kasparov was a huge moment – he was in college at time – came away more impressed with Kasparov’s mind than with DeepBlue (because Kasparov could play almost at the AI level, but could also do all these other things as a human, while DeepBlue at that time couldn’t even play tic-tac-toe)

What makes chess compelling as a game?
Creative tension between bishop and knight – leads to a lot of dynamism
Chess has evolved to balance those two more or less equally (worth 3 points each)
Balanced by humanity over hundreds of years

Different levels of creativity
1. Lowest level is interpolation – averaging everything you see (eg, “an average looking cat”)
2. Next is extrapolation – AI coming up with a new move in Go that no one’s seen
3. Out of the box innovation – coming up with a new game entirely – AI nowhere close to this yet

Currently AI can do 1 and 2 but not 3
For 3, if you were to instruct an AI to create a game, you’d say “come up with a game that takes 5 minutes to learn, but lifetimes to master, aesthetically beautiful, and can be completed in 3-4 hours”
We can’t abstract high level notions like that to AIs (yet)

AI could be used to make current games better by taking game system, playing millions of times, and then improving the balance of rules and parameters – give it a base set + Monte Carlo tree search – takes humans many years and thousands of testers to do it

His first big game was theme park, amusement park – then whole cities – and Will Wright’s made SimEarth simulating the whole earth

“Simulation theory” – doesn’t believe it, in sense that we’re in a computer simulation / game, but does think best way to understand physics and universe is from computation perspective – information as fundamental unit of reality instead of energy or matter
Understanding physics as information theory could be valuable

Roger Penrose – Emperor’s New Mind – he believes we need quantum, something more, to explain consciousness in the brain
Most neuroscientists / mainstream biologists haven’t found any evidence of this
While continually classic Turing machines keep improving – and DeepMind / Demis work is champion of this
Thinks universal Turing machines can eventually mimic human brain without Penrose need for something more

Something profoundly beautiful and amazing about our brains – incredibly efficient machines, in awe of it
Building AI and comparing to human mind will help us unlock what’s truly unique about our minds – consciousness, dreaming, creativity
Philosophy of mind – there haven’t been the tools, but today we increasingly have them

Lex – Universe built human mind which built computers to help us understand universe and human minds

Protein folding – AlphaFold 2 solved it
Proteins = essential to all life – workhorses of biology, amazing bio-nano machines, specified by genetic sequence, in the body they fold into 3D structure (like string of beads folded into a ball)
The 3D structure determines what it does – and drugs must understand this to interact with it
Structure maps to function, and is specified by amino acid sequence
Unique mapping for every protein – but it’s not obvious – and almost infinite possibilities
Can you by studying the sequence, predict the 3D structure?
Takes 1 PhD student an entire PhD to predict one protein
But AlphaFold 2 can do it in seconds now – over Christmas can do it over entire human proteome space (!!)
Biologists can now lookup protein 3D structure in a google search

AlphaFold was most complex and meaningful system they’ve built so far
Started on games (AlphaGo, AlphaZero), to bootstrap general learning systems
His passion is scientific challenges – AlphaFold is first proof point
30 component algorithms needed to crack protein folding
About 150K protein structures had been found – that was their training set
Would put some of AF’s best predictions back into training set to accelerate training
AF2 was truly end to end – from amino acid sequence directly to 3D structure, without needing all the intermediary steps – system is better at learning the constraints on its own instead of guiding it

AlphaGo – learning system but trained only to learn Go
AlphaZero – removed need to learn from human games – just play with itself
MuZero – didn’t even need to give rules, just let it learn on its own

Started DeepMind in 2010 – back then no one was talking about AI, people mostly thought it doesn’t work (even at MIT)
If all professors tell you you’re mad, at least you know you’re on a unique track
Founding tenets / trends
-Algorithmic advances (reinforcement learning)
-Understanding about human brain (architectures, algos) improving
-Compute and GPUs improving
-Mathematical and theoretical definitions of intelligence

Early days – ideas were most important – deep reinforcement learning, transformers, scaling those up
As we get closer to AGI, engineering and data become more important
**For large models – scale is clearly necessary but perhaps not sufficient

DeepMind – purposely built multi-disciplinary organization – neuroscience + machine learning + mathematics + gaming, and now philosophers and ethicists too
“A new type of Bell Labs”
DeepMind itself is a learning machine building a learning machine

Top things to apply AI – biology and curing diseases (AlphaFold), but it’s just beginning
Eventually simulate a virtual cell (maybe in 10 years) – “that’s my dream”
Drugs take 10 years – target to drug candidate – maybe it can be shortened to 1 year with this, AlphaFold as first proof point

Math is perfect description language for physics
AI as perfect description language for biology (!)

Open-sourced AlphaFold (including data) – max benefit to humanity – so many downstream applications, better to accelerate research and discovery, used by 500K researchers (almost every biologist in the world!), amazing fundamental research, almost every pharma company is using it, “gateway drug to biology”

Also open-sourced MuJoCo – purchased it explicitly to open source it

One day an AI system could come up with something like General Relativity (!)

Big new breakthroughs will come at intersection of different subject areas (DeepMind = neuroscience + AI engineering)
We just don’t understand what it’d be like to hold the entire internet in your head (imagine reading all of Wikipedia, but much much greater) – no one knows what will result

Nuclear fusion – believe AI can help
In any new field, talk to domain experts for collaboration
What are all the bottleneck problems? Think from 1st principles
Which AI methods can help
Problem of plasma control is great example – plasma is unstable (mini-sun in a reactor), want to predict what plasma will do next, to best model and control it
They’ve largely solved it with AI, and now looking for other problems in fusion

Simulating properties of electrons – if you do it, you can describe how elements and materials work (fundamental to materials science)
Would like to simulate large materials – approximate Schrodinger’s equation

His ultimate aim for AI – to build a tool to help us understand the universe – to test the limits of physics
A true scientist – the more you find out, the more you realize you don’t know
Time, consciousness, gravity, life – fundamental things of nature – we don’t really know what they are
We treat them as fact and box them off – but there’s a lot of uncertainty about what it is
Use of AI is to accelerate science to the maximum – imagine a tree of all knowledge – we’ve barely scratched surface, and AI will turbocharge all of it – understanding and finding patterns, and then building tools

If you’re good at chess, you still can’t come up with a move like Garry Kasparov, but he can explain the move to you – potentially AI systems could understand things we could never by ourselves, and then explain it and make it useful for us

We’re already symbiotic with our phones and computers, Neuralink, and could augment / integrate with these AI

His current feeling is we are alone (no aliens)
We could easily be a million years ahead or behind in our evolution, eg, if meteor that destroyed dinosaurs came earlier or later – and in a few hundred years, imagine where we’ll be, AI, space traveling – we’ll be spreading across the stars; will only take ~1M years for Von Neumann systems to populate across the galaxy with that tech
We should have heard a cacophony of voices – but we haven’t heard anything
“We’ve searched enough – it should be everywhere”
If we’re alone, somewhat comforting re: Great Filter (maybe we’ve passed it)

Wouldn’t be surprised if we found single cell alien life – but multi-cellular seems incredibly hard
Another large leap is conscious intelligence
General intelligence is costly to begin with – 20% of body’s energy – a game of professional chess is same as F1 racer
Hard to justify evolutionarily – which is why it’s only been done once (on Earth)

AI systems – easy to craft specific solutions, but hard to do generally – at first general systems are way worse

Do AGI systems need consciousness?
Consciousness and intelligence are double dissociable – can have one without the other in both ways
Eg, Dogs have consciousness and self-aware but not very intelligent, most animals are pretty specialized
Eg, some AI are amazingly smart at playing certain games or doing certain tasks, but don’t seem conscious

May be our responsibility to build systems that are not sentient
None of our systems today have one iota of consciousness or sentience – way too premature
Re: Google engineer who believed their language system was sentient – Demis believes it’s more a projection of our own minds, our desire to construct narrative and agency even within inanimate systems
Eliza AI chat bots in 1960s – already fooled some people

Neuroscience – certain pre-reqs may be required for consciousness, like self-awareness, coherent preferences over time

Turing test is important, but there’s second that differ in machines: we’re not running on same substrate (humans are carbon based squishy life forms)

Language models – we don’t understand them well enough yet to deploy them at-scale
Should AI be required to announce that it is AI?

re: AI ethics, important to look at theology, philosophy, arts & humanities
Heading into an area of radical abundance and knowledge breakthroughs if we do it right – but also huge risks
Need careful controlled testing instead of just releasing into the wild, the harms could be fast and huge

Better to first build these AI systems as tools – carefully experiment and understand – before we really focus on sentience

How to prevent being corrupted by this AI power:
-Important to remain grounded and humble
-Being multi-disciplinary keeps you humble – because always better experts
-Have good colleagues who are also grounded

AI can learn for itself most of its knowledge, but will have residue of culture / values from who builds it

Globally we can’t seem to cooperate well eg, climate change
Need to remove scarcity to help promote world peace – radical abundance

AI should belong to the world and humanity, everyone should have a say

Advice for young
-what are your true passions? explore as many things as possible; find connections between things
-understand yourself – how do you deal with pressure, hone your uniqueness and skills

Perfect day in Demis’ life, habits
-10 years ago: whole day of research + programming, reading lots of papers, reading sci-fi at night or playing games
-today: very structured, complete night-owl, 11-7pm work (back to back meetings, meet as many people as possible), go home and spend time with family, 10pm-4am do individual work, long stretches of thinking and planning and some email
-quiet hours of morning – love that time (1-3am), inspiring music, think deep thoughts, read philosophy books, do all his creative thinking, get into flow, sometimes will go to 6am next day, and pay for it the next day (but it’s worth it)

Always been a generalist – too many interesting things to spend time on just one

Lex: Why are we here?
Demis: To gain knowledge and understand the universe, understand world around us, humanity, and all these things flow from it: compassion, self-knowledge

Feel like universe is almost structured to let itself be understood and learned – why are computers even possible?

If Demis could ask one question of true AGI: “What’s true nature of reality?”
Answer could be a more fundamental explanation of physics, and how to prove them out
A deeper, simpler explanation of things – leading to consciousness, dreaming, life, gravity