JP-2022514031-A5 -

Dates

Publication Date

20221209

Application Date

20190930

Description

When viewers of panoramic video want to view the original direction of motion in the video and want to prevent the impact of human-induced camera shake on the video, it is necessary for the original changing field of view in the shooting direction to be preserved and kept stable in the video. Therefore, it is necessary to consider a panoramic video image stabilization method that can preserve the changing state of the shooting direction of the original shooting equipment. References can be cited as Chinese Utility Model Publication No. 206274111 (CN206274111U) as Reference 1 and Chinese Patent Application Publication No. 106594466 (CN106594466B) as Reference 2. The present invention aims to provide a panoramic image stabilization method, a computer-readable storage medium, and a mobile terminal that can generate stable images by solving the problem of losing the original lens focus when acquiring a panoramic image field of view, decomposing the camera's movement, preserving the camera's original shooting field of view, and generating virtual lens movement. In the first aspect, the present application is: The system acquires the world coordinates of a reference point in the world coordinate system in real time, and simultaneously acquires the camera coordinates corresponding to the reference point on the mobile device, as well as the current angular velocity value of the gyroscope on the mobile device. Smoothing camera motion using an extended Kalman filter, The process involves decomposing the motion into smoothed components to generate virtual lens motion in free lens mode, and calculating the amount of rotation of the virtual lens. The present invention provides a panoramic image stabilization method that includes generating a stable image by reprojecting the original image based on the amount of rotation of the virtual lens and a rotation matrix that converts camera coordinates to world coordinates. In this invention, stable images can be generated by decomposing the camera's movement, preserving the camera's original field of view, and generating virtual lens movement. This method maintains smooth rendering lens movement to generate stable images and preserves the camera's original field of view, resulting in very strong robustness against noisy scenes and scenes with a large amount of motion. In S103, the motion is decomposed into smoothed motion to generate virtual lens motion in free lens mode, and the amount of rotation of the virtual lens is calculated. The process of decomposing the motion into smoothed components, generating a virtual lens motion in free lens mode, and calculating the amount of rotation of the virtual lens is specifically as follows: In this invention, stable images can be generated by decomposing the camera's movement, preserving the camera's original field of view, and generating virtual lens movement. Therefore, this method can produce stable images by keeping the rendering lens movement smooth and preserving the camera's original field of view. When a user views a panoramic image, artificial image jitter can be avoided, and the original directional changes in the field of view of the panoramic image can also be preserved. As a result, this method preserves the camera's original field of view and has very strong robustness against noisy scenes and scenes with a lot of movement.