Sadly I was doing it the way you do! I can only just reach the fret at the moment with no hope of reaching beyond it to play the note. But, I tried doing it with my left hand (as I used to) and could do it quite easily that way around. Practice, practice!
One good thing about music is that when it hits you, you feel no pain - Bob Marley