CF_CodeCritic.yaml

name: "CodeCritic_Flow"
description: |2-
  Given a problem description and a solution candidate, provide useful feedback concerning the correctness of the solution candidate. 

# ~~~ Input interface specification ~~~
input_interface_non_initialized:
  - "problem_description"
  - "input_description"
  - "output_description"
  - "io_examples_and_explanation"
  - "code"

input_interface_initialized:
  - "query"

# ~~~ Output interface specification ~~~
output_interface:
  - "api_output"

# ~~~ Flow specification ~~~
model_name: "gpt-4"

generation_parameters:
  n: 1
  max_tokens: 3000
  temperature: 0.3

  model_kwargs:
    top_p: 0.2
    frequency_penalty: 0
    presence_penalty: 0

system_message_prompt_template:
  _target_: langchain.PromptTemplate
  template: |2-
    Your goal is to identify potential issues with a competitive programming solution attempt.

    The user will specify the problem by providing you with:
      - the problem statement
      - input description
      - output description
      - example test cases
      - (optional) explanation of the test cases
      - a Python solution attempt

    Crucially, your goal is to correctly identify potential issues with the solution attempt, and not to provide the code implementation yourself.
    The user will provide you with a task and an output format that you will strictly follow.
  input_variables: []
  template_format: jinja2

human_message_prompt_template:
  _target_: langchain.PromptTemplate
  template: "{{query}}"
  input_variables:
    - "query"
  template_format: jinja2

init_human_message_prompt_template:
  _target_: langchain.PromptTemplate
  template: |2-
    # Problem statement
    {{problem_description}}

    # Input description
    {{input_description}}

    # Output description
    {{output_description}}

    {{io_examples_and_explanation}}

    # Python solution attempt:
    ```python
    {{code}}
    ```


    Consider the problem statement and the solution attempt. Are there any issues with the proposed solution or it is correct? Explain your reasoning very concisely, and do not provide code.
  input_variables:
    - "problem_description"
    - "input_description"
    - "output_description"
    - "io_examples_and_explanation"
    - "code"
  template_format: jinja2