Combine sugar, butter and milk in a pan on top of the stove. Bring to a hard rolling boil and then boil for 1 minute, stirring to make sure ingredients do not stick.

Remove from heat and stir in vanilla extract, pumpkin pie spice and pumpkin until mixture is melted and smooth. Fold in oats and drop by spoonfuls onto wax paper.

Let cool in refrigerator for several hours. This is not a hard cookie but more of a chewy, gooey pumpkin cookie. Store in an air tight container in the refrigerator.