Katikapalli Subramanyam Kalyan

Katikapalli Subramanyam Kalyan

NLP Researcher

Publications

I’m reviewer for popular a) journals like PLOS ONE, Computers in Biology and Medicine and b) conferences like EMNLP and workshops like ML4H@NeurIPS.

Preprints

  1. AMMUS: A Survey of Transformer-based Pretrained Language Models in Natural Language Processing (Paper)
    Katikapalli Subramanyam Kalyan, Ajit Rajasekharan and Sivanesan Sangeetha

Conference / Workshop Publications

  1. Target Concept Guided Medical Concept Normalization in Noisy User-Generated Texts
    Katikapalli Subramanyam Kalyan, Sivanesan Sangeetha
    EMNLP’20 (Deep Learning Inside Out (DeeLIO): The First Workshop on Knowledge Extraction and Integration for Deep Learning Architectures)
  2. Medical Concept Normalization in User-Generated Texts by Learning Target Concept Embeddings
    Katikapalli Subramanyam Kalyan, Sivanesan Sangeetha
    EMNLP’20 (LOUHI 2020 - 11th International Workshop on Health Text Mining and Information Analysis)
  3. Social Media Medical Concept Normalization using RoBERTa in Ontology Enriched Text Similarity Framework
    Katikapalli Subramanyam Kalyan, S Sangeetha
    AACL-IJCNLP’20 (Knowledgeable NLP: the First Workshop on Integrating Structured Knowledge and Neural Networks for NLP)

Journal Publications

  1. AMMU – A Survey of Transformer-based Biomedical Pretrained Language Models
    Katikapalli Subramanyam Kalyan, Ajit Rajasekharan and Sivanesan Sangeetha
    Journal of Biomedical Informatics (SCI, IF=8, ranked #8 in medical informatics)
  2. SECNLP: A survey of embeddings in clinical natural language processing
    Katikapalli Subramanyam Kalyan, Sivanesan Sangeetha
    Journal of Biomedical Informatics (SCI, IF=8, ranked #8 in medical informatics)
  3. BertMCN: Mapping colloquial phrases to standard medical concepts using BERT and highway network
    Katikapalli Subramanyam Kalyan, Sivanesan Sangeetha
    Artificial Intelligence in Medicine (SCI, IF=7.01, ranked #9 in medical informatics)

Shared Task Publications

  1. Want to Identify, Extract and Normalize Adverse Drug Reactions in Tweets? Use RoBERTa
    Katikapalli Subramanyam Kalyan, S Sangeetha
    COLING’20 (SMM4H 2020 - 5th Social Media Mining for Health Research and Applications Workshop)
    Achieved 3rd place in shared tasks 2 and 3.

A big thanks to Ajit Rajasekharan for his encouragement and support. I have learnt a lot by interacting with Ajit sir. For example, how to stay update with research without which it wouldn’t have been possible for me to write two top class survey papers on transformer-based pretrained language models.