The only speed that should be relevant is the object's speed relative to the portal. Anything else is a distraction. The physics don't care if you are hurtling at it or it is flying at you, both scenarios are equivalent. The only way to maintain conservation of momentum is to assume your exit speed relative to the exit portal equals your entrance speed relative to the entry portal.

If it did work the other way, well it wouldn't assuming your exit speed is equal to your initial speed, relative to the exit. That means your speed is 0 as you "exit." This leaves us with two possibilities. Either you are smashed into a 2d plane and physics gets very concerned, likely forming a teeeeeny tiny black hole. Or the incoming matter behind the first bits will push the first layers through, which, will just wind up back at the starting point, as they will cascade into each other at a speed defined by the speed of the blue portal, being indistinguishable from the projectile interpretation.