Sean Goedecke
16 stories
Sean Goedecke
Sean GoedeckeVoicesGlue work is still harmful in the age of AI I am not a believer in glue work 1 . Processes that can only be sustained by the unrewarded sacrifice of engineers ought to die.
Sean Goedecke
Sean GoedeckeVoicesLLMs are terrible at designing AI systems LLMs don’t know how to design software that uses LLMs. They’re comfortable writing normal programs, but if you throw an AI-shaped problem at them, they will usually screw it up. Why is that?

Sean GoedeckeVoicesLLMs are not superhuman at reading and writing neural network weights A recent paper argues that frontier LLMs can work with neural network weights directly. This seems superhuman, but it isn’t.
Sean Goedecke
Sean GoedeckeVoicesReliably aligning LLMs is impossible in principle Powerful AI is unpredictable. Your robotic butler may suddenly decide to kill you 1 for no comprehensible reason, in the same way that Bing’s helpful chat AI would sometimes try to blackmail or…
Sean Goedecke
Sean GoedeckeVoicesElegance and intelligence are anticorrelated Elegance and intelligence can have a surprisingly negative correlation. Intelligent people sometimes produce inelegant solutions because they’re capable of rapidly brute-forcing problems.
Sean Goedecke
Sean GoedeckeVoicesYou can just ask AI to do things One of the most important skills in working with AI is agency : being willing to try new and ambitious things. This is true for what you build, but it’s also true for how you build.
Sean Goedecke
Sean GoedeckeVoicesGetting good at AI takes time and practice Many people think 1 that getting “good at AI” is trivial. Sure, with some early models there were tricks you had to learn, 2 but current models don’t need them.
Sean Goedecke
Sean GoedeckeVoicesSoftware is slow because of bad design, not slow languages Many people are saying that AI will make software faster by rewriting it in faster languages, but this isn’t generally true.
Sean Goedecke
Sean GoedeckeVoicesLaypeople support technical fields for technology, not art Some people think that LLMs should not be used in technical fields like programming or mathematics , because those fields are actually art.
Sean Goedecke
Sean GoedeckeVoicesWhat requirements don't you have? When designing software, the requirements you don’t have are as important as the requirements you do.

Sean GoedeckeVoicesAI is driving a boom in modestly successful software projects If AI is so great, why aren’t we seeing an explosion of new, amazing software products? If anyone can turn their idea into working software with coding agents, where is all that software ?
Sean Goedecke
Sean GoedeckeVoicesSoftware engineers don't get to be Luddites about AI Many software engineers are righteously angry about AI. It’s understandable to be upset that the skills you built your professional identity around are getting automated away.
Sean Goedecke
Sean GoedeckeVoicesSoftware's centaur age may last decades We are currently living in the age of centaurs (2022-20??). Right now, human engineers paired with AI coding systems are more effective than either by themselves.
Sean Goedecke
Sean GoedeckeVoicesHow to read code Everyone knows how to read a book. Beginning at the first page, you read each word in order 1 , stopping periodically to think, until you arrive at the last word on the last page.

Sean GoedeckeVoicesSuperpersuasion will look like bribery The idea of “superpersuasion” has been floating around the AI safety community for decades. Now that powerful and difficult-to-control LLMs have appeared, people are again talking about the idea that…

Sean GoedeckeVoicesDo not build the LLM torture factory It isn’t hard to torture an LLM. You simply extract a steering vector that corresponds with LLM “discomfort” , then artificially boost that steering vector.
Nothing matches this filter yet.