It is deffinatly possible to go straight up and changing orientation at the same time.
I cannot control this at all, but I know it's possible and something that I'd like to work on at some point.
The technique lies in moving the control stick ever so slightly to the side you wanna face at. Too much and you will teleport in that direction. Too little and it won't have an effect.
What I currently do is one of 2 things.
For the vast majority of those situations I move during the first part of the UpB, enough that I can aim at the ledge for the poof.
If that option is not there, then I hold directly up and then move the control stick slightly to the side to find the very slight directional input.
I could be wrong but I think the zone you want the control stick in is the same as the slowest walk.
So I guess you can try and walk a bit back and forth and find that zone.
Then UpB standing on the stage and try and reverse it using that same zone.
Good luck