The invention discloses a compact optical structure for light field display. The compact optical structure comprises an imaging assembly comprising: a polarizing beam splitter that completely reflectsan incident beam in an S-state polarizing state and completely transmits an incident beam in a P-state polarizing state, a display screen composed of M sub-screens, and enabling light information emitted by all the sub-screens to enter the polarizing beam splitter respectively, two wave plates used for changing the polarization state of the incident light beam, and two reflection modulation devices used for carrying out phase modulation on the light. The compact optical structure further comprises a small-spacing aperture array, a control unit and a diaphragm. According to the compact opticalstructure for light field display, a compact optical structure capable of realizing monocular multi-view presentation is designed by virtue of the regulation and control of the polarization spectroscope and the wave plate on the polarization state, so that the three-dimensional visual comfort is improved by virtue of three-dimensional display capable of being naturally focused. The compact optical structure can be used as an eyepiece of a head-mounted VR/AR alone.