Top 5 Tips for Reading a Veterinary Scientific Study

Results from scientific research can help provide optimal care. Daily decisions should lead to effective diagnostic procedures and therapeutic interventions with optimal risk:benefit ratios. It is therefore important to be able to select and evaluate scientific literature relevant to the field and/or patient. Critical evaluation aids in identification of strengths and weaknesses of a study and its relevance and validity in the clinic¹; relevant information for critical evaluation is typically found in the methods and results sections.

The following are the authors’ top 5 tips for evaluating a scientific study.

1. Determining Relevance

For ease of application, the circumstances (eg, patient and condition being evaluated) and available resources (eg, therapies, equipment, required skills) in the study should be similar to those in the clinic. Other important considerations include compliance with local legal requirements, ethics, and wishes of the pet owner.² For example, the study may recommend a surgical procedure, but surgery may not be the best course of action in a patient with high anesthetic risk; therefore, the recommendations from the study are less applicable to the case.

2. Identifying Study Design

Different study designs are best suited to address different questions (Table 1).³ Regardless of whether the study concerns diagnostics, therapeutic procedures or treatments, disease prevention, transmission, or another type of research, the evidence can be ranked based on the methodology used.⁴ Methodology most likely to minimize systematic errors is considered to have the least bias, and methodology with the most systematic errors results in the most bias. Systematic errors are not based on chance; they are the result of problems with the study design or methods used to obtain data.⁵ Increased levels of bias increase the likelihood of distorted results. Clinical decision-making should be based on evidence from the least-biased, but most applicable, study design available.

^{Common Study Types}

*Study types are listed in order from lowest to highest risk for bias.^1,2

3. Considering Potential Bias

The level of evidence (eg, meta-analysis, randomized clinical trial, case report, expert opinion or experience) in a study indicates how prone it is to bias.⁶ The quality of the study, which is determined by an appraisal process, can also be an indicator of bias. Appraisal should include investigating factors, such as the type, age, sex, and number of study participants (ie, sample size); enrollment criteria; definitions of conditions; which and how examinations were performed; how participants were allocated to different groups; and whether the study was blinded (i.e., humans involved in the study did not know which treatment group participants were allocated to). Assessment for potential bias should also include whether clear inclusion and exclusion criteria are given and whether outcome measures are reasonable and relevant. Questions asked during the appraisal process depend on the study design and research question of interest (Tables 2-4). 

A common flaw in veterinary publications is not including a sufficient number of subjects or samples to draw robust conclusions.⁷ A sample size calculation or reasoning regarding the number of participants included in the study should be included in the methods, results, and discussion sections. 

In some studies, patients with a specific disease are enrolled without a clear case definition or a documented diagnostic procedure (including which test results indicated physiologic/not physiologic conditions) that can be used to confidently identify the presence of disease, making it difficult to draw a conclusion. How participants are allocated to different groups is important because unequal distribution (eg, including more severely ill patients in one group compared with another) can distort outcomes.⁸ In addition, a lack of blinding can influence recorded outcomes, as researchers may be (consciously or unconsciously) biased in the conduction or interpretation of a study when they know which patients received specific treatments.

Evaluation Guide For Intervention Trials

Evaluation Guide For Research On Diagnostic Tests

Evaluation Guide For Literature Reviews

*Hand searching is the examination of reference lists of included studies in order to identify other relevant citations.

4. Identifying Appropriate Results

Presentation of crucial information (eg, patient age and medical history, case or control definitions, diagnoses) should be examined.¹ Lack of clarity on whether specific aspects of study design, methods, and results were not considered or just not reported by authors,³ and journal word count restrictions leading to fewer details provided, can cause difficulties for the reader. Special attention should be given to conclusions, as they may be based on weak or absent scientific data or go beyond the stated research question.³ 

Transparent reporting is crucial; several reporting guidelines have been developed to ensure important details are not missed.⁹ Quality of a study decreases when critical appraisal is not possible due to poor reporting. 

Authors should include whether ethical approval was sought, as well as conflicts of interest and sources of research funding, as these may influence study design or interpretation.¹

5. Evaluating Literature Guides

Several tools are available to guide critical assessment of a scientific study, including evaluation guides,¹⁰ which can help assess key features and quality. Summarizing rating points can provide confidence in recommendations based on study results, although additive scores may not always be necessary. Some tools are included here, but these do not cover all possible scientific research approaches, and some items may not be helpful or easily assessed in every case. 

The study design should be determined first, so the appropriate evaluation guide can be chosen. Additional criteria, including information content and objectivity, should be assessed using the appropriate guide. Determining whether the right statistics have been used may be challenging, but focusing on the design features that should be present can help determine study quality.

Conclusion

Critical reading of scientific studies can be time-consuming, but practice can make it easier to decide whether a study is relevant and valid and can be applied in the clinic.¹ Identifying limitations can help results be interpreted and applied appropriately.