@Gabogonzalez515 are these models are basically a big homology search with some local energy minimization (naaaah) https://t.co/86I4EvbUdH ? they are encoding mostly evolutionary features (even in the absence of a MSA) and it seems that chemical feature…
321 followers
721 followers
RT @nkwang24: 2/ We extend the categorical Jacobian approach in https://t.co/MEPf1npb9k to extract a layerwise readout of ESM-C's predicted…
81 followers
2/ We extend the categorical Jacobian approach in https://t.co/MEPf1npb9k to extract a layerwise readout of ESM-C's predicted contacts, i.e. which sequence positions are likely to be close physically. Remarkable concordance with known structures despite…
401 followers
@GuiveAssadi @NinaPanickssery @tszzl mech interp in those contexts will find hypotheses / patterns, its then our job to check if the mech a performant model is using is 1) known 2) spurrious correlation 3) novel. for (1) see https://t.co/eIaQN6WtiE wher…