In Marks11PlosOne, my understanding is that M1 is the conservation of the marginal probability. M2 is the information entropy. M3 is to find the maximum of M2 with constraint of M1 using Lagrange multipliers (a vector) in theory. It seems to me M1, M2, M3 are what supposed to work in theory. The author then proposed an approximation method to solve M3.
The calculation approach for e_ij are indicated in Text S1 based on mean-field approximation:
The authors then calculated "residue pair coupling" using direction information (DI)
matlab code for DI:
Question: I thought e_ij describe all pairwise coupling strength? Why "DI"?
A: The authors seem to suggest that "DI" "reduced the set of empirically correlated residue pairs to the minimal set of pairs most likely to co-vary due to evolution constraints.
Shanon's information entropy