Species phylogenetics using intraprotein residue dependence inferred with protein foundation models

Abstract

Traditional molecular phylogenetic inference uses multiple sequence alignments and amino acid substitution models that generally assume that sites evolve independently. In contrast, protein foundation models (pFMs) are deep learning models that reveal residue dependence patterns within sequences. There are two types of pFMs: Evolutionary Scale Models (esm-pFM) for analyzing individual protein sequences, and MSA Transformer (msat-pFM) models for analyzing MSAs. Using pFMs to analyze sequences produces residue attention matrices (RAMs) and sequence attention matrices (SAMs), respectively. RAMs and SAMs can be used to estimate pairwise distances and, thus, reconstruct phylogenies using the Neighbor-Joining (NJ) method. Here, we compare the performance of RAM-NJ and SAM-NJ phylogenies in reconstructing established species relationships across different proteins and taxon sets. Surprisingly, RAM-NJ phylogenies were generally as accurate as SAM-NJ phylogenies even though RAM inference does not require construction or analysis of an MSA. Our results show that pFM-based analyses can recover species relationships without conventional substitution models or, in the case of RAMs, a multiple sequence alignment. These results suggest that evolutionary relationships are reflected not only in primary sequence differences between species, but also in the sequence-specific patterns of inter-residue dependence produced by pFM analysis of individual sequences. However, pFM phylogenies are less accurate than those obtained with standard maximum likelihood approaches, underscoring the need to further develop methods to harness RAMs and SAMs more effectively.