Buying Tokens vs Building an AI Factory with Sadeepa Wijesekara - #785
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) | Nov 17 2026 | 00:58:17

An AI agent can make many model calls to finish a single job. Some need frontier reasoning. Others can run on an open-weight model, and some involve data that has to stay in-house. How do you decide which inference to buy and which to run yourself?
Sadeepa Wijesekara, who leads engineering for HPE Private Cloud AI, joins Sam Charrington to discuss how enterprises make those decisions. They get into what it takes to see the cost of individual calls, how teams route work between hosted and local models, and when running your own GPUs makes economic sense. Sadeepa shares how HPE routes coding requests through a single internal endpoint that can send work to a frontier provider or serve it locally.
🗒️ Full show notes: https://twimlai.com/go/785.
Sadeepa Wijesekara, who leads engineering for HPE Private Cloud AI, joins Sam Charrington to discuss how enterprises make those decisions. They get into what it takes to see the cost of individual calls, how teams route work between hosted and local models, and when running your own GPUs makes economic sense. Sadeepa shares how HPE routes coding requests through a single internal endpoint that can send work to a frontier provider or serve it locally.
🗒️ Full show notes: https://twimlai.com/go/785.
