Never too young as long they aren't being allowed to stuff their faces with candy. I started going as early as 2 years old because I wanted to be out with my older siblings and wear a costume!