“Many years ago, I think it might’ve been 2017 or 2018, I said at the time, AI is the most profound technology humanity will ever work on. It’ll be more profound than fire or electricity.…”
“I think the big thing is that it makes it accessible. It unlocks the cognitive capabilities of the entire 8 billion.”
“These tokens per month has grown 50 times in the last 12 months.”
“Microsoft CEO Satya Nadella said that 20% to 30% of code inside the company’s repositories was “written by software” — meaning AI.”
“Murati hasn't revealed many details on what the startup is developing, but in a recent blog post, shared that the company is developing AI models focused on human and AI collaboration.”
“We add details to the prompt only when they are needed.”
“Most LLMs are smart enough to figure out that you want them to help understand and propose fixes, so you don't need to explicitly tell them.”
“Ng said that lazy prompting is an "advanced" technique that works best when the LLM has enough preexisting context — and an ability to infer intent.”
“If you just kind of eyeball the rate at which these capabilities are increasing, it does make you think that we’ll get there by 2026 or 2027.”
“You're going to have to pardon my French, but that's complete B.S.”
“you can manipulate language and not be smart”
“If we can achieve that, that amount of inference compute, where it leads to a dramatically better answer as you apply more inference compute, I think that will be the beginning of real…”
“But in a statement on X, he said that he’s leaving OpenAI with the belief the company will build artificial general intelligence — AI capable of accomplishing any task a human can — that’s…”
“I expect that by the end of this decade, and possibly somewhat sooner than that, we will have quite capable systems that we look at and say, “Wow, that’s really remarkable.””
“The road to AGI should be a giant power struggle. I expect that to be the case.”
“LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world. They don’t really have persistent memory. They can’t really…”
““The foundation model side is going to be a base layer that's going to be important for all sorts of things,” Gil said, “but importance is different from where value accrues.””
“In the meantime, we finished training Inflection-2 last night! It's now the 2nd best LLM in the world ... & we're scaling MUCH further”
“When this learning algorithm then interacts with data, it produces complicated neural networks that are good at doing things. But we don't really understand exactly how they do those things.”
“I think my main message is there's enormous uncertainty about what's going to happen next.”