How to Replace Your Manager With an LLM