Banteay Srei is built largely of red sandstone, a medium that lends itself to the elaborate decorative wall carvings which are still observable today. The buildings themselves are miniature in scale, unusually so when measured by the standards of Angkorian construction. These factors have made the temple extremely popular with tourists, and have led to its being widely praised as a "precious gem", or the "jewel of Khmer art."
The site consists of three concentric rectangular enclosures constructed on an east–west axis. A causeway situated on the axis leads from an outer gopura, or gate, to the third or outermost of the three enclosures. The inner enclosure contains the sanctuary, consisting of an entrance chamber and three towers, as well as two buildings conventionally referred to as libraries.
The sanctuary is entered from the east by a doorway only 1.08 m in height: inside is an entrance chamber (or maṇḍapa) with a corbelled brick roof, then a short corridor leading to three towers to the west: the central tower is the tallest, at 9.8 m. Glaize notes the impression of delicacy given the towers by the antefixes on each of their tiers. The six stairways leading up to the platform were each guarded by two kneeling statues of human figures with animal heads; most of those now in place are replicas, the originals having been stolen or removed to museums.
