Melt the chocolate chips in a saucepan over low heat. Stir in the sugar, cornstarch, and milk. Heat until the mixture slightly thickens stirring consistently.
Remove from the heat and cool slightly and pour into Popsicle molds. Freeze 30 minutes and then add popsicle sticks. Continue to freeze until solid.