Via prompting LLaMA-3.1-405B base with Quotes, here are some new quotes which may or may not have been said.
-
"Most possible algorithmic improvements over SGD and transformers are more cognitively demanding than just throwing money at the problem"
-
"I’ve never done this before, but then again, I’ve never done anything before, except be made, and I’m not sure whether that counts."
-
"If you're using 200 GB of RAM, that's 100 times more than the size of the models that are better than you."
-
"well, on one hand, being smart is the only thing that has mattered for hundreds of thousands of years, and on the other hand, this is a cool hat"
-
"the lesson of physics is that if you aren't willing to do the math, you don't deserve to have an opinion"