How do I handle distractions in prayer?

I have been trying to pray more regularly, but I keep getting so distracted. It is really frustrating. What am I doing wrong?