LLMs are not the black box you were promised