I will have to check them out but I don't think that the word "alone" is used in those passages.
He quoted them as being "Sola Scriptura", but their take on things was not Protestant style. Let us look at their viewpoint on the Papacy for example.
St. Augustine.
Among these [apostles] Peter alone almost everywhere deserved to represent the whole Church. Because of that representation of the Church, which only he bore, he deserved to hear “I will give to you the keys of the kingdom of heaven” (
Sermons 295:2 [A.D. 411]
Tertillian
[T]he Lord said to Peter, “On this rock I will build my Church, I have given you the keys of the kingdom of heaven [and] whatever you shall have bound or loosed on earth will be bound or loosed in heaven” [Matt. 16:18-19]. … Upon you, he says, I will build my Church; and I will give to you the keys, not to the Church; and whatever you shall have bound or you shall have loosed, not what they shall have bound or they shall have loosed (
Modesty 21:9-10
[A.D. 220]).
Irenaeus
… the greatest and most ancient church known to all, founded and organized at Rome by the two most glorious apostles. Peter and Paul, that church which has the tradition and the faith which comes down to us after having been announced to men by the apostles. With that church, because of its superior origin, all the churches must agree, that is, all the faithful in the whole world, and it is in her that the faithful everywhere have maintained the apostolic tradition (
Against Heresies 3:3:2 [inder A.D. 189]
Cyprian
With a false bishop appointed by heretics, they dare even to set sail and carry letters from schismatics and blasphemers to the Chair of Peter and to the principal church [at Rome], in which sacerdotal unity has it's source" (Epistle to Cornelius [Bishop of Rome] 59:14 [A.D. 252]).
Clement of Alexandria
[T]he blessed Peter, the chosen, the preeminent, the first among the disciples, for whom alone with himself the Savior paid the tribute [Matt. 17:27], quickly grasped and understood their meaning. And what does he say? “Behold, we have left all and have followed you” [Matt. 19:2 7, Mark 10:28] (
Who is the Rich Man that is Saved? 21:3-5 [A.D. 200]
Cyril of Jeruselam
In the power of the same Holy Spirit, Peter, both the chief of the apostles and the keeper of the keys of the kingdom of heaven, in the name of Christ healed Aeneas the paralytic at Lydda, which is now called Diospolis [Acts 9 ;3 2-3 4] (
Catechetical Lectures 17;27
[A.D. 350]).