Question on alpaca format training.

#1
by xzuyn - opened

You say you used alpaca format, but then you list the format as this;

### Instruction:

<prompt> (without the <>)

### Response:

while alpaca/alpaca-lora with no ### Input: used;

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
<prompt> (without the <>)

### Response:

and when using an ### Input: used;

Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

### Instruction:
<prompt> (without the <>)

### Input:
<extra context input> (without the <>)

### Response:

so my question is, did you follow the format that the alpaca or alpaca-lora trainer used, and did you train with any ### Input?

It's the alpaca format from alpaca-lora. Sure it can have the prompt above the ### Instruction: but it's not necessary in my experience, but FYI yes. As for inputs, there weren't any explicitly added to the dataset, all input fields were blank (i.e. the ### Input: feature will not have any added effect).

xzuyn changed discussion status to closed

Sign up or log in to comment