Should I register for My Service when I transition out?

Yes, for sure!

Apply for a MyGov account and create a MyService account at the same time if not already done: my.gov.au.