Compress Better, Compute Bigger