On the upper level southeast side, Cave 3 has rather deep a courtyard in front that is set back from the cliff face above Cave 1. It is a small cave with shallow niches around three walls. There are no sculpted images remaining in their original locations in the cave. On the exterior, there are architectural details carved in stone—the remains of columns, and a stone eave with a bird standing on it in front of the roof. Part of the roof has been cut down because of later construction of a wooden temple building above the caves. From these remains, however, and their similarity to the features of Northern Qi Buddhist caves, it is evident that Cave 3 also had a carved domed roof.