Deterministic Programming with LLMs