High Accuracy Resolution of Medical Entities to Standard Codes Using Novel Sentence Embeddings

The release of Spark NLP for Healthcare 3.1 brings significant speed and accuracy improvements for the task of entity resolution, also known as entity linking: the ability to map a medical entity to a standard code. This release supports the SNOMED-CT, ICD-10-CM, ICD-10-PCS, CPT, LOINC, RxNorm, UMLS, HPO, and ICD-O terminologies. The accuracy gains have been vetted by several customers already using real-world data.

New John Snow Labs SBert Sentence Embeddings

One challenge with resolving medical entities to codes is that very often, multiple similar codes exist for a term, and the most appropriate one depends on context. For example, “bladder cancer” may be mapped to any of the following ICD-10-CM standard terms:

        Cancer in situ of urinary bladder
    
        Carcinoma in situ of bladder
        Tumor of bladder neck
    
        Neoplasm of unspecified behavior of bladder
    
        Malignant tumour of bladder neck
    
        Secondary malignant neoplasm of bladder
    
        Malignant tumor of urinary bladder
    
        Malignant neoplasm of bladder, unspecified

Ranking these options – or picking the most relevant one – depends heavily on the context. To provide a better understanding of medical context, we’ve developed a set of new healthcare-specific sentence embeddings, including the first medical sentence embeddings available in different sizes. These embeddings (and the entity resolution models that leverage them) are not availble anywhere else, and result in better accuracy than other embeddings which are now outdated such as BioBERT and ClinicalBERT, for 3 reasons:

• They’re based on a newer deep learning architecture (SBERT).

• We augmented the training data beyond what’s available in public academic datasets.

• They’re more current, because we just retrained them. In contrast, for example, BioBERT was trained in 2019 – before any mention of COVID-19 on PubMed.

The new sBERT models delivered with the 3.1 release are fined tuned on MedNLI, NLI, and UMLS datasets with various parameters to cover common NLP tasks in medical domain:

• sbiobert_jsl_cased
• sbiobert_jsl_umls_cased
• sbert_jsl_medium_uncased
• sbert_jsl_medium_umls_uncased
• sbert_jsl_mini_uncased
• sbert_jsl_mini_umls_uncased
• sbert_jsl_tiny_uncased
• sbert_jsl_tiny_umls_uncased

6X Faster Load Times for Sentence Resolver Models

Sentence resolver models now have faster load times, with an average six-fold speedup when compared to previous versions. Also, the load process now is more memory friendly meaning that the maximum memory required during load time is lower, reducing the chances of out-of-memory exceptions, and thus relaxing hardware requirements.

John Snow Labs SBert Model Speed Benchmark

Get Started

• Live demos & Python notebooks of clinical entity resolution
• Start a free trial of Spark NLP for Healthcare