natural language processing, bioinformatics

 

BERT-GT: cross-sentence n-ary relation extraction with BERT and Graph Transformer

https://academic.oup.com/bioinformatics/article-abstract/36/24/5678/6069538

LBERT: Lexically aware Transformer-based Bidirectional Encoder Representation model for learning universal bio-entity relations

https://academic.oup.com/bioinformatics/article-abstract/37/3/404/5893949

Attention-Based Transformers for Instance Segmentation of Cells in Microstructures

https://ieeexplore.ieee.org/abstract/document/9313305?casa_token=88kTMDn2LIUAAAAA:LxNIoFl-o24XoXV5PHpJ1T67-atx7ScUVKONPNGwKvPP6skEt4E99z1LmF6-8pGKSuuXtnCTSzo

transformer protein lanugage models are unsupervised structure learners

https://openreview.net/pdf?id=fylclEqgvgd 

BERTology meets biology: interpreting attention in protein language models

https://arxiv.org/abs/2006.15222

Burris Wheeler transformation