Reasoning in Granite 3.2 using inference scaling

Inference scaling is an active and exciting area of research in AI. Essentially, it’s the concept of using more compute at inference time to dramatically improve the performance of an LLM. At IBM, we’ve been developing innovative new inference…