A problem of most handheld applications is that the digital con-tent is not rendered from the user’s viewpoint, but rather from an arbitrary perspective. In this work, we propose an easy-to-use user-perspective rendering algorithm which can be applied to general handheld mobile devices. We present a smartphone App that can enhance the sense of presence when perceiving the virtual objects, by adjusting the 2D projections, lighting conditions, and spatial sound effects according to the user’s viewpoint in real time.