The invention provides a behavior recognition method and system based on an attention mechanism double-flow network, and belongs to the technical field of behavior recognition, and the method comprises the steps: dividing an obtained whole video segment into a plurality of video segments with the same length, extracting an RGB image and an optical flow gray-scale image of each frame of each videosegment, and carrying out the preprocessing of the RGB images and the optical flow gray-scale images; carrying out random sampling on the preprocessed image to obtain an RGB image and an optical flowgrayscale image of each video clip; extracting appearance features and time dynamic features of the sampled images by using a double-flow network model introducing an attention mechanism, fusing the appearance features and the time dynamic features according to the types of a time domain network and a space domain network respectively, and performing weighted fusion on a fusion result of the timedomain network and a fusion result of the space domain network to obtain an identification result of the whole video. According to the invention, the video data can be fully utilized, the local key features of the video frame image can be better extracted, the foreground area where the action occurs is highlighted, the influence of irrelevant information in the background environment is inhibited,and the behavior recognition accuracy is improved.