Critical Evaluation

# **Critical Evaluation of Existing Research**

_________________________________________________________________________________________________
> **🎯 Goal:** Conduct a systematic critique of recent research, evaluating quality, validity, and identifying systemic flaws or patterns to position new work effectively.
_________________________________________________________________________________________________

#### **1. Original Prompt Block (English)**

> "Perform a critical evaluation of recent research on [topic] published in the last 3 years. Analyze: 1) methodological strengths and weaknesses across studies, 2) common limitations and their impact on findings, 3) contradictory results and potential explanations, 4) evolving research trends and methodological innovations, and 5) the overall quality of evidence in this area. Include specific examples from high-impact studies and organize the evaluation by research aspects rather than individual studies."

#### **2. Analysis & Strategy**

| Phase | Insight |
| :--- | :--- |
| **Analysis** | This prompt moves beyond summarization to **Synthesis and Critique**. It asks the AI to act like a peer reviewer, looking for systemic flaws or patterns in the body of knowledge. |
| **Review** | The original prompt is strong on organization but "Critical Evaluation" is often interpreted by AI as just summarizing "Limitations". |
| **Brainstorming** | To get a PhD-level critique, ask for specific quality indicators: **validity** (did they measure what they intended?), **reliability**, and **sampling bias**. Identify the "Elephant in the room"—what is everyone ignoring? |

#### **3. PRO / CONTRA Analysis**

| **PRO (Advantages)** | **CONTRA (Risks)** |
| :--- | :--- |
| ✅ **Meta-Analysis Feel:** Simulates a mini meta-analysis without doing the math. | ⚠️ **Generalization:** AI might generalize a weakness found in one paper to the whole field. |
| ✅ **Defense Prep:** Helps identify weak points of the field, allowing the student to position their own work as the "solution." | ⚠️ **Depth:** Might struggle to critique complex statistical methods without access to raw data. |

#### **4. Upgraded Prompt**

**Changes Made:** Adopted the persona of a "Critical Peer Reviewer," added specific criteria for evaluation (Sampling Bias, Measurement Validity), and requested a "Quality of Evidence" rating.

> **Copy & Paste this Prompt:**
>
> "Act as a Critical Peer Reviewer. Conduct a systematic critique of the top research published on [topic] in the last 3-5 years.
>
> **Do not just summarize; evaluate the quality and validity of the evidence. Structure your critique into these categories:**
>
> **1. Methodological Flaws & Patterns:**
> *   Are there recurring sampling biases (e.g., WEIRD populations - Western, Educated, Industrialized, Rich, Democratic)?
> *   Are sample sizes generally sufficient for the claims made?
> *   Is there an over-reliance on self-reported data versus objective measures?
>
> **2. Theoretical Stagnation:**
> *   Are researchers recycling old theories without innovation? Identify the dominant dogma.
>
> **3. Contradictory Findings:**
> *   Highlight a specific debate where Study A disagrees with Study B. Propose a reason for this discrepancy (e.g., different methodologies).
>
> **4. The 'Blind Spot':**
> *   What is the one critical variable or perspective that this field is consistently ignoring?
>
> **5. Conclusion:**
> *   Rate the overall **'Maturity'** of this research field (Nascent, Developing, or Mature) and justify your rating."

#### **5. Hungarian Summary & Best Usage**

| Kategória | Leírás |
| :--- | :--- |
| **Mire a legjobb?**<br>*(Best Usage)* | Ez a prompt a **kritikai gondolkodás** (Critical Thinking) demonstrálására való. A "Szakirodalmi Áttekintés" fejezetben nem elég felsorolni a cikkeket, értékelni is kell őket. Ez a prompt segít megtalálni a "nagyok" hibáit, és ezzel megágyazni a saját kutatásunknak. |
| **Valós példa**<br>*(Real Life Example)* | Egy táplálkozástudományi hallgató, aki a *"Mesterséges édesítőszerek hatását"* vizsgálja. |
| **A probléma** | A szakirodalom tele van ellentmondással (rákot okoz vs. biztonságos). A hallgató elveszik az információban. |
| **A megoldás** | A prompt rávilágít a **módszertani torzításra**:<br>1. A "káros" eredmények gyakran egereken, nagy dózissal születtek.<br>2. A "biztonságos" eredmények gyakran iparilag finanszírozottak.<br>Így a hallgató leírhatja: *"A bizonyítékok minősége alacsony, szükség van független, emberi vizsgálatra."* |

_________________________________________________________________________________________________