In a saucepan, mix sugar, cocoa, butter and milk. Bring to a boil and boil for 1 minute. Remove from heat.
Add peanut butter and stir until melted. Add vanilla. Add oatmeal and mix well. Drop spoonfuls on parchment or wax paper and refrigerate until set.