Motion key point video analysis model training method and device and electronic equipment

An analysis model and video analysis technology, applied in the computer field, can solve the problem of low accuracy of analysis results of key motion points, and achieve the effect of avoiding transition fitting problems and optimizing analysis performance.

Pending Publication Date: 2022-05-06
ALIBABA DAMO (HANGZHOU) TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

This patented technology allows for precise tracking over time when playing videos on their own device (such as smartphones). It involves analyzing specific points within each frame or section of frames during playback based upon how well they were captured from previous scenes. By combining this analysis into an estimate of future content consumption, it becomes possible to predict what will happen next - even if there may have been any sudden changes like those happening around us shortly after being shown off-screen. Overall, this technology helps improve understanding about users engagement and behavioral patterns through visual media such as streaming movies.

Problems solved by technology

This patented technology describes how different types of movements affect our bodies differently during exercise testing or other activity that requires monitoring certain parts of the person's body for specific actions such as walking up stairs at an elevated height overlooking them from behind while sitting down on one side. Existing methods are often poorly effective due to limitations with computational resources and storage capacity.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Motion key point video analysis model training method and device and electronic equipment
  • Motion key point video analysis model training method and device and electronic equipment
  • Motion key point video analysis model training method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0078] as Figure 8 It is the flow chart of a motion key point video analysis model training method provided by the first embodiment of the application. The method comprises the following steps.

[0079] Step s801: provide the annotated video to the target key point analysis model to obtain the first result of motion key point analysis.

[0080]In this embodiment, it is used to obtain a target key point analysis model. As the premise of obtaining the target key point analysis model, first obtain the original training sample data for training the target key point analysis model. Annotated video refers to the video frame containing the target object and the key points of the human posture presented by the target object during motion have been identified and annotated. The target object can refer to the user who performs the preset movement. The preset movement can refer to sports. The human posture presented in the process of movement includes standing posture or horizontal posture. The

no. 2 example

[0119]Corresponding to the application scenario embodiment of the motion key point video analysis model training method provided by the application and the motion key point video analysis model training method provided by the first embodiment, the second embodiment of the application also provides a motion key point video analysis model training device. Since the device embodiment is basically similar to the application scenario embodiment and the first embodiment, the description is relatively simple. For relevant parts, please refer to the partial description of the application scenario embodiment and the first embodiment. The device embodiments described below are only schematic.

[0120] Please refer to Figure 9 , which is a schematic diagram of a motion key point video analysis model training device provided in the second embodiment of the application.

[0121] The motion key point video analysis model training device includes:

[0122] A first result obtaining unit 901 for prov

no. 3 example

[0134] In the above first embodiment, a training method of motion key point video analysis model is provided. The training method of motion key point video analysis model is mainly to train the first result of motion key point analysis obtained by the target key point analysis model based on the second result of motion key point analysis obtained by the trained teacher key point analysis model, Make the accuracy of the analysis results of the target key point analysis model on the mobile terminal equipment reach the predetermined threshold. Correspondingly, the third embodiment of the application provides another motion key point video analysis model training method. Since the motion key point video analysis model training method has been described in detail in the first embodiment, please refer to the description of the first embodiment for relevant parts, which will not be repeated here.

[0135] The third embodiment of the application provides another training method of motion key

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a motion key point video analysis model training method, and the method comprises the steps: providing a labeled video for a target key point analysis model, and obtaining a first result of motion key point analysis; and providing the labeled video to the trained teacher key point analysis model to obtain a second result of motion key point analysis, comparing the first result with a labeling result of labeled video data to obtain a first loss, and comparing the first result with a second result to obtain a second loss; synthesizing the first loss and the second loss according to a predetermined processing method to obtain a first synthesis loss; and training the target key point analysis model according to the first synthesis loss. According to the method, the trained teacher key point analysis model and the annotation result of the annotated video data are adopted to train the target key point analysis model. Therefore, the mobile client with the limited operational capability can obtain better analysis performance on the premise that the operational capability is not increased.

Description

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Owner ALIBABA DAMO (HANGZHOU) TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products