You might find that adding the oats before heating the milk helps, and heating gently. But a lot of stirring is needed. Traditional Scottish recipes I've seen call for nonstop stirring.
Even a little water added to your milk also helps. If they start to thicken too much before they're fully cooked, a dash of cold water stirred in will help.