People are obsessed with prompts and prompt engineering. Sure, what you say is important, but what the model knows when you say it is the difference between a stateless text generator and an intelligent AI system.
In short, context is the most crucial component. Karpathy’s viral tweet called it