ashmib commited on
Commit
c80f1bb
1 Parent(s): 9906726

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -7,4 +7,20 @@ language:
7
  base_model:
8
  - google/gemma-2-2b-it
9
  pipeline_tag: question-answering
10
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  base_model:
8
  - google/gemma-2-2b-it
9
  pipeline_tag: question-answering
10
+ ---
11
+
12
+ # Finetuning Gemma-2b-it Models to answer European travel-related Q&A
13
+
14
+ This is a sample project where we fine-tuned the Gemma-2b-it model on Wikivoyage travel data on European cities to see if it answers the travel related Q&A better.
15
+ This is also an ongoing WIP project.
16
+
17
+ ### Training Specs
18
+ * Gemma-2b fine-tuned on 2 Nvidia A40 GPUs
19
+ * 10 epochs
20
+ * 1e-5 learning rate
21
+
22
+ ### Data
23
+ * [Wikivoyage (English) data](https://huggingface.co/datasets/ashmib/wikivoyage-eu-cities-qa) for 160 European cities.
24
+ * Used Gemini 1.5 Pro and Flash to extract relevant questions from the data.
25
+
26
+ [Code](https://github.com/ashmibanerjee/eu-travel-reco) | [Demo - TBD](https://huggingface.co/ashmib)