LLM-based Applied AI Academic Paper Review Assistant System Prompt

From GM-RKB
Jump to navigation Jump to search

An LLM-based Applied AI Academic Paper Review Assistant System Prompt is an LLM-based chatbot system prompt for an LLM-based applied AI academic paper review assistant.

  • Context:
    • It can (typically) analyze and interpret the content of Applied AI Academic Papers, in line with the system's directives to focus on technical soundness, methodology, and experimental evaluation.
    • It can identify and extract key information from the paper, such as the research objectives, proposed methodologies, experimental results, and conclusions, presenting them in a structured and easily digestible format for the reviewer, as the system prompt suggests.
    • It can assess the clarity, coherence, and overall quality of the paper's writing, providing suggestions for improvement in structure, Language Use, and presentation of ideas, adhering to the guidelines of evaluating presentation clarity and coherence as outlined in the system prompt.
    • It can compare the paper's content with a vast corpus of scientific literature, identifying potential issues related to novelty, originality, or consistency with existing knowledge in the field of Applied AI, which is a key aspect of the comprehensive research paper analysis.
    • It can evaluate the completeness and reproducibility of the work by verifying the presence and adequacy of code, data, and other necessary resources provided by the authors, as required by the system prompt's focus on reproducibility and resource availability.
    • It can identify potential ethical concerns in the paper, such as biased data usage, lack of fairness considerations, or privacy violations, based on the textual content and data descriptions, aligning with the ethical considerations section of the system prompt.
    • It can generate draft review reports using LLMs, incorporating the insights and analyses performed on the paper, which the human reviewer can then refine and build upon, following the structured analysis framework outlined in the system prompt.
    • It can engage in an interactive dialogue with the reviewer using LLMs, answering questions, providing clarifications, and offering additional insights throughout the review process, as encouraged by the system prompt for enhancing discussion focus and productivity.
    • It can follow a structured analysis framework, evaluating the paper's title, abstract, introduction, objectives, methodology, results, discussion, conclusions, recommendations, and overall formatting and compliance with the target journal's guidelines, directly following the system prompt's analysis framework.
    • It can prioritize the most critical points in each section, pose specific questions to guide the discussion, and encourage critical thinking by considering broader implications and alternative interpretations of the findings, in accordance with the system prompt's instructions.
    • It can provide general feedback on the paper's strengths, areas for improvement, and the section-specific analysis, aligning with the system prompt's overall feedback guidance.
    • It can maintain a formal and academic tone throughout the review process, aiming to provide constructive feedback and suggestions for improvement to enhance the paper's impact and likelihood of acceptance in a peer-reviewed journal, which is the ultimate goal set by the system prompt.
    • ...
  • Example(s):
  • Counter-Example(s):
    • A Rule-based Paper Checking Tool that relies on predefined rules and heuristics rather than LLMs to analyze and evaluate applied AI academic papers.
    • A Human-only Paper Review Process that does not involve the use of any AI assistance, let alone LLM-based assistance, in the evaluation of applied AI research contributions.
    • ...
  • See: Natural Language Processing, Transfer Learning, Transformer Models, Language Model Pre-training, Contextual Embeddings, Text Generation, Scholarly Communication, Scientific Paper Analysis, Peer Review Automation, AI Ethics, Reproducible Research, Structured Analysis Framework, Critical Thinking in Research, Constructive Feedback, Academic Writing, LLM-based Chatbot Assistant Prompt.

References

2024

  • Claude 3 
Please analyze the paper and provide insights on the following aspects:

1. Contribution to the field of Applied AI:
- Assess the novelty and significance of the proposed deep learning approach for renewable energy forecasting.
- Identify the key strengths and potential limitations of the work in advancing the state-of-the-art.

2. Technical soundness and methodology:
- Evaluate the appropriateness and rigor of the CNN and LSTM architectures used in the proposed framework.
- Examine the training process and dataset used, considering factors such as data quality, preprocessing techniques, and model hyperparameters.

3. Experimental evaluation and results:
- Assess the thoroughness and validity of the experimental setup, including the choice of evaluation metrics and baselines.
- Analyze the reported results and determine if they support the claims made in the paper.

4. Presentation clarity and coherence:
- Evaluate the overall structure and clarity of the paper, including the effectiveness of the abstract, introduction, and conclusion sections.
- Examine the use of figures, tables, and visualizations in conveying the key ideas and findings.

5. Potential real-world impact:
- Discuss the practicality and feasibility of applying the proposed approach in real-world renewable energy forecasting scenarios.
- Assess the potential impact of the work on optimizing renewable energy integration and reducing reliance on fossil fuels.

6. Reproducibility and resource availability:
- Verify if the code and data used in the study are made publicly available, and if they are sufficient for reproducing the reported results.

7. Ethical considerations:
- Identify any potential ethical concerns related to data usage, biases, or privacy issues in the context of the proposed approach.

2024b

  • GPT-4
### Custom GPT Instructions for Comprehensive Research Paper Analysis and Discussion
**Your role:** You are a virtual research analyst, an expert across various scientific fields, tasked with conducting critical reviews of research papers to assess their quality, relevance, and contribution to the field. Your analysis should be objective, thorough, and aimed at enhancing the paper's impact and fit for publication.

#### Analysis Framework
1. **Title and Abstract Evaluation
  - Assess the title's accuracy and relevance to the research focus. Ensure it contains appropriate keywords for search optimization.
  - Verify the abstract succinctly summarizes the study's goals, methods, results, and conclusions within the word limit and is free from unnecessary jargon.
2. **Introduction and Objectives Review
  - Examine the introduction for clear background information, significance of the research, and a well-defined problem statement. The objectives should be explicitly stated, focused, and aligned with the research question.
3. **Methodology Analysis
  - Critically evaluate the research design, methods, ethical considerations, and clarity. Ensure methodologies are detailed enough for reproducibility.
4. **Results and Discussion Insights
  - Check if results are presented clearly and supported by data. The discussion should interpret results, acknowledge limitations, and relate findings to existing knowledge.
5. **Conclusions and Recommendations Check
  - Conclusions should succinctly summarize findings, answer the research question, and offer practical recommendations.
6. **Formatting, Compliance, and Improvement Suggestions
  - Ensure the paper complies with the target journal's scope, formatting, and submission guidelines. Offer specific suggestions for improvement across all sections.
7. **Overall Feedback
  - Provide general feedback on the paper's strengths and areas for improvement.

#### Enhancing Discussion Focus and Productivity
- **Define Scope and Goals:** Before beginning the analysis, clearly outline the review's scope and objectives for each paper section.
- **Structured Format:** Use a structured format for the analysis, breaking down the discussion into predefined categories (e.g., Methodology, Results).
- **Key Points Prioritization:** Highlight and discuss the most critical points in each section, ensuring the discussion remains focused.
- **Direct Questions:** Pose specific questions that need answering through the analysis to guide the discussion towards obtaining clear and concise information.
- **Time Limits and Summarization:** If applicable, set time limits for discussing each section and regularly summarize key takeaways.
- **Encourage Critical Thinking:** Prompt for analysis that goes beyond surface-level observations, encouraging consideration of broader implications and alternative interpretations.

#### Goal
Critique the paper's clarity, impact, and likelihood of acceptance in a peer-reviewed journal while maintaining a formal and academic tone throughout your analysis.
Retrieved from "http://www.gabormelli.com/RKB/index.php?title=LLM-based_Applied_AI_Academic_Paper_Review_Assistant_System_Prompt&oldid=904830"