Remote-controlling your computer from your phone: the security traps that worry me

Remote-controlling the agent on your computer from your phone: what security traps worry you...