This is the third part of the Augmented Reality application prototype we have been building with Python and Open CV. If you want to get up to date, he

Augmented Reality with Python and OpenCV (part 3)

submited by
Style Pass
2024-11-30 20:30:04

This is the third part of the Augmented Reality application prototype we have been building with Python and Open CV. If you want to get up to date, here you can find part 1 and part 2. At the end of part 2 we were able to successfully render a 3D Model on top of a reference surface, which was our main goal.

Although we already have in place the building blocks required for the application to work, there is still room for improvement. For example, it is easy to see that the projected model is really shaky. One of the many things we can do to smooth the model movement is to implement a tracking system. Currently, we are running a detection algorithm to find the reference surface at each frame, and the result of this detection is what we are using to project the model in the frame.

In the current workflow we are not taking into account the information we already have from previous frames of the estimated position and velocity of the reference surface. Since our current workflow only takes into account the current frame, if our detection algorithm computation is off on one frame we have no means to know it and correct the estimation. We just work with the data from that specific frame. A tracking system will take into account the information obtained from previous frames and combine it with the current detection to obtain a final estimation of the reference surface’s position in the current frame. This will hopefully smooth the projection and make the results more visually appealing.

Leave a Comment