The monastery sat on a hill overlooking what is now the village of Ortaköy and consisted of several structures, of which the main church was a domed structure faced with smoothly finished small blocks.
In the 19th century, the remaining edifice was converted into a mosque and a minaret was added to it.
The ruins of a large rectangular refectory have survived to the north of the former church.
Two important Georgian manuscripts known as the Berta Gospels have survived.
One, dating from 988, is preserved at the Museum of Andover Newton Theological School in the United States; the other (Q-906) dates from the 12th century and is kept at the National Center for Manuscripts in Tbilisi, Georgia.