Harnessing Unstructured Data in Radiology: NLP, RadLex & AIM
This paper explores methods for mining unstructured data in radiology reports, focusing on Natural Language Processing (NLP), RadLex, and Annotation and Image Markup (AIM). It traces the historical and theoretical background of each approach, compares their respective strengths and weaknesses, and evaluates their intended impact on clinical decision support and research analysis. While NLP excels at processing structured text and categorizing images, its accuracy with free-form unstructured data remains unreliable. RadLex offers a unifying lexicon across healthcare organizations, and AIM addresses the critical gap of making image data retrievable and meaningful. The paper concludes that combining these methods holds the most promise, though further development is needed before unstructured radiology data can be mined safely and systematically.
- Introduction: Radiology data gap and paper scope
- Historical and Theoretical Background: Origins and theory of NLP, RadLex, AIM
- Use and Intended Impact: Clinical applications and patient care benefits
- Interaction with Other Topics and Themes: Data mining within broader health informatics
- Comparison and Contrast: Side-by-side evaluation of three methods
- Strengths, Weaknesses, and Risks: Accuracy limits and organizational risk factors
- Conclusion: Combined approach needed; further development required
✍️ How to write this paper — guide, tools & examples ▾
What makes this paper effective
- The paper systematically evaluates three distinct technologies — NLP, RadLex, and AIM — against a consistent set of criteria (background, use, strengths, weaknesses, and risks), giving the comparison clear structure and fairness.
- It grounds technical claims in a solid citation base drawn from peer-reviewed biomedical informatics journals, lending credibility to evaluative claims about accuracy and reliability.
- The paper maintains a practical focus throughout, consistently returning to patient safety and clinical decision support as the ultimate standard for evaluating each method.
Key academic technique demonstrated
The paper demonstrates comparative analysis across multiple technologies within a single domain. Rather than advocating for one method, it maps where each tool excels and where it falls short, then argues that a combined approach is superior. This "compare, contrast, synthesize" structure is a reliable model for technology review papers in applied health sciences.
Structure breakdown
The paper opens with an introduction framing the problem of unstructured data in radiology, then provides historical and theoretical background on each of the three methods. A dedicated section covers use and intended impact, followed by a discussion of how data mining intersects with broader health informatics themes. The comparison and contrast section evaluates the methods against each other, leading into a combined strengths-and-weaknesses and risk analysis. The conclusion synthesizes findings and recommends further development before widespread deployment of unstructured data mining in clinical settings.
Introduction
Radiology is the use of imaging to look into the human body and observe disease processes (Chapman et al., 2011). Both diagnosis and treatment can be improved through radiology. Radiologists employ a number of techniques, including CT scans, X-rays, ultrasounds, MRIs, and PET scans, among others (Hong et al., 2013). There are also interventional radiology techniques that are generally minimally invasive but that work well in diagnosing and treating specific ailments (Chapman et al., 2011). However, radiology is severely lacking in one critical area: the mining of unstructured data in order to present a clearer picture of patients' issues and provide more information about what those patients may be facing. A great deal of data is provided within radiology reports, but without collecting and processing that data it remains of no real use to patients or physicians.
The collection and processing of unstructured data found in radiology reports can be difficult and is not without its own pitfalls (Chapman et al., 2011). Several different types of programs can be used to perform this mining successfully. Natural Language Processing (NLP) is one of the most commonly used options for collecting data, but it does not always work well with unstructured data. Errors are frequent when it is applied this way, so it has not been found to be completely reliable. With that in mind, this paper explores NLP, RadLex, and Annotation and Image Markup (AIM) as tools for unstructured data mining in radiology reports, evaluating which method is most effective and how they might be used in conjunction with one another for greater overall success.
Historical and Theoretical Background
Natural Language Processing
Natural Language Processing (NLP) is used to mine unstructured data (Gerstmair et al., 2012; Hong et al., 2013). This concept is based on human-computer interaction and provides a way for computers to learn natural human language in order to process information provided by humans. The more computers understand about language, the more they can process information without barriers (Johnson et al., 1997). That can be highly beneficial in medicine, because it provides doctors, nurses, radiologists, and other medical professionals with more information than they would previously have been able to collect. However, NLP is not without its downsides, which must also be addressed in order to determine whether NLP should be used in radiology and what adjustments could make it more viable.
Generally, complex sets of hand-written rules were used to allow machines to translate language, but in the 1980s programmers began to write complex algorithms that allowed machines to learn and process language (Demner-Fushman, Chapman, & McDonald, 2009; Torres et al., 2012). This was a major breakthrough, and interest in machine translation was renewed. The original algorithms were relatively primitive and not much better than hand-written rules, but they demonstrated that algorithms were possible and that they could function for translation purposes (Chapman et al., 2011; Weiss & Langlotz, 2008). As computing power grew stronger, greater success was seen with translation and data mining, allowing computers to actually "learn" language in ways that had not been possible previously. Algorithms today can be semi-supervised, meaning they can derive some information from other information with which they are supplied (Chapman et al., 2011).
The theory underlying NLP is that computers can be "taught" to translate language in the same way a person can (Reiner, 2009; Torres et al., 2012). Once machines are able to do this, computers will be able to handle a number of tasks currently reserved for humans. That frees human beings for other tasks and results in much faster translations, given that computers are capable of rapid calculations that far exceed what humans can achieve. However, there are issues with this theory that must be considered. The main concern is that the goals of NLP are not entirely realistic (Gerstmair et al., 2012; Weiss & Langlotz, 2008). Computers are not people, and because they do not "think" in the same way human beings do, they can only follow sets of rules and use those rules to process information (Demner-Fushman, Chapman, & McDonald, 2009).
RadLex
RadLex is another approach to unstructured data mining. Several different methods are currently in use, and the main problem with them is that they are all different from one another. When healthcare organizations use different methods for extracting, categorizing, and storing data, confusion arises when information must be transferred from one organization to another (Gerstmair et al., 2012). RadLex is designed to resolve this through the creation of a single lexicon usable by all healthcare organizations and agencies (Gerstmair et al., 2012). It contains more than 68,000 terms, so it can be applied across the entire field of radiology. DICOM and SNOMED-CT are two of the current standards and lexicons in use, but RadLex is able to work with both in order to unify the experience (Weiss & Langlotz, 2008).
The idea behind RadLex originated with a group of committees formed to find a better way to mine data from radiology reports. The RSNA formed these committees in 2005; they comprised individuals from more than 30 organizations focused on radiology and standards (Chapman et al., 2011). In 2007, six additional committees were formed to continue RadLex development and to ensure that as many terms as possible were included (Chapman et al., 2011). Without that breadth of coverage, RadLex would not have surpassed the other lexicons it was intended to replace, nor would it have been able to integrate those earlier data mining options into one convenient package usable by radiologists everywhere. The underlying theory was to create a solution that would allow all other programs to be merged, and RadLex appears to be succeeding at that goal.
Annotation and Image Markup
Annotation and Image Markup (AIM) is another approach to mining unstructured data in radiology reports. As the name suggests, it is focused on the images found in reports. However, there is much more to the issue than simply identifying pictures — captions and tags can be attached to these images, supplying readers of the report with a great deal of data that might otherwise be lost (Chapman et al., 2011). AIM is not a new concept; its planning stages go back a number of years. It is not focused on the same types of unstructured data as systems like NLP, however. AIM's focus remains on the images themselves, because failing to provide usable, translatable data alongside these images can cause them to be overlooked (Chapman et al., 2011).
The theory behind AIM for radiology report mining is that a great deal of information is lost within the pictures and images themselves (Chapman et al., 2011). When a report is "read" by a computer program mining its data, the software processes the language within the report text — it makes sense of words, terms, sentences, and other written information. However, the images themselves also contain information, and radiology is fundamentally image-based. Being able to quickly access and interpret these pictures is very important, because they can provide extra insight into the disease or condition of the patient, which can make a significant difference in the speed and accuracy of diagnosis and treatment (Chapman et al., 2011).
References
Chapman, W. W., Nadkarni, P. M., Hirschman, L., D'Avolio, L. W., Savova, G. K., & Uzuner, O. (2011). Overcoming barriers to NLP for clinical text: The role of shared tasks and the need for additional creative solutions. Journal of the American Medical Information Association, 18(5), 540–543.
Demner-Fushman, D., Chapman, W. W., & McDonald, C. J. (2009). What can natural language processing do for clinical decision support? Journal of Biomedical Informatics, 42, 760–772.
Do, B. H., Wu, A. S., Maley, J., & Biswal, S. (2013). Automatic retrieval of bone fracture knowledge using natural language processing. Journal of Digital Imaging, 26, 709–713.
Gerstmair, A., Daumke, P., Simon, K., Langer, M., & Kotter, E. (2012). Intelligent image retrieval based on radiology reports. European Radiology, 22, 2750–2758.
Hong, Y., Zeng, M. L., Zhang, J., Dimitroff, A., & Kahn, C. E., Jr. (2013). Application of standardized biomedical terminologies in radiology reporting templates. Information Services and Use, 33(3–4), 309–323.
Johnson, D. B., Taira, R. K., Cardenas, A. F., & Aberle, D. R. (1997). Extracting information from free text radiology reports. International Journal of Digital Libraries, 1, 297–308.
Reiner, B. (2009). The challenges, opportunities, and imperative of structured reporting in medical imaging. Journal of Digital Imaging, 22(6), 562–568.
Torres, J. S., Quilis, J. D. S., Espert, I. B., & Garcia, V. H. (2012). Improving knowledge management through the support of image examination and data annotation using DICOM structured reporting. Journal of Biomedical Informatics, 45, 1066–1074.
Weiss, D. L., & Langlotz, C. P. (2008). Structured reporting: Patient care enhancement or productivity nightmare? Radiology, 249, 739–747.
Bibliography
Huang, Y., & Lowe, H. J. (2007). A novel hybrid approach to automated negation detection in clinical radiology reports. Journal of the American Medical Information Association, 14, 304–311.
McLoughlin, R. F., So, C. B., & Gray, R. R., et al. (1995). Radiology reports: How much descriptive detail is enough? AJR: American Journal of Roentgenology, 165, 803–806.
Mendonca, E. A., Haas, J., Shagina, L., Larson, E., & Friedman, C. (2005). Extracting information on pneumonia in infants using natural language processing of radiology reports. Journal of Biomedical Informatics, 38, 314–321.
Reiner, B. I., Siegel, E. L., & Knight, N. (2007). Radiology reporting: Past, present, and future: The radiologist perspective. Journal of the American College of Radiology, 5, 313–319.
Rubin, D. L., & Desser, T. S. (2008). A data warehouse for integrating radiologic and pathologic data. Journal of the American College of Radiology, 5, 210–217.
Create your account
Always verify citation format against your institution’s current style guide requirements.