Combine pumpkin pie spice, sugar, and cornstarch together in a sauce pan.
Add milk and stir together. The spices probably won’t mix in well until the milk gets hot, but you should stir it until the cornstarch is well incorporated.
Stir in pumpkin purée.
Heat over medium heat, stirring, until thick and bubbling.