[INFO|configuration_utils.py:675] 2024-10-15 09:55:50,267 >> loading configuration file config.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/config.json [INFO|configuration_utils.py:742] 2024-10-15 09:55:50,272 >> Model config PaliGemmaConfig { "_name_or_path": "google/paligemma-3b-pt-448", "_vocab_size": 257216, "architectures": [ "PaliGemmaForConditionalGeneration" ], "bos_token_id": 2, "eos_token_id": 1, "hidden_size": 2048, "image_token_index": 257152, "model_type": "paligemma", "pad_token_id": 0, "projection_dim": 2048, "text_config": { "hidden_size": 2048, "intermediate_size": 16384, "model_type": "gemma", "num_attention_heads": 8, "num_hidden_layers": 18, "num_image_tokens": 1024, "num_key_value_heads": 1, "torch_dtype": "float32", "vocab_size": 257216 }, "torch_dtype": "float32", "transformers_version": "4.45.2", "vision_config": { "hidden_size": 1152, "image_size": 448, "intermediate_size": 4304, "model_type": "siglip_vision_model", "num_attention_heads": 16, "num_hidden_layers": 27, "num_image_tokens": 1024, "patch_size": 14, "projection_dim": 2048, "projector_hidden_act": "gelu_fast", "vision_use_head": false } } [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:52,043 >> loading file tokenizer.model from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/tokenizer.model [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:52,043 >> loading file tokenizer.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/tokenizer.json [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:52,043 >> loading file added_tokens.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/added_tokens.json [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:52,043 >> loading file special_tokens_map.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/special_tokens_map.json [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:52,043 >> loading file tokenizer_config.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/tokenizer_config.json [INFO|image_processing_base.py:375] 2024-10-15 09:55:53,563 >> loading configuration file preprocessor_config.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/preprocessor_config.json [INFO|image_processing_base.py:375] 2024-10-15 09:55:53,659 >> loading configuration file preprocessor_config.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/preprocessor_config.json [INFO|image_processing_base.py:429] 2024-10-15 09:55:53,660 >> Image processor SiglipImageProcessor { "do_convert_rgb": null, "do_normalize": true, "do_rescale": true, "do_resize": true, "image_mean": [ 0.5, 0.5, 0.5 ], "image_processor_type": "SiglipImageProcessor", "image_seq_length": 1024, "image_std": [ 0.5, 0.5, 0.5 ], "processor_class": "PaliGemmaProcessor", "resample": 3, "rescale_factor": 0.00392156862745098, "size": { "height": 448, "width": 448 } } [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:53,755 >> loading file tokenizer.model from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/tokenizer.model [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:53,756 >> loading file tokenizer.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/tokenizer.json [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:53,756 >> loading file added_tokens.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/added_tokens.json [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:53,756 >> loading file special_tokens_map.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/special_tokens_map.json [INFO|tokenization_utils_base.py:2206] 2024-10-15 09:55:53,756 >> loading file tokenizer_config.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/tokenizer_config.json [INFO|processing_utils.py:744] 2024-10-15 09:55:57,151 >> Processor PaliGemmaProcessor: - image_processor: SiglipImageProcessor { "do_convert_rgb": null, "do_normalize": true, "do_rescale": true, "do_resize": true, "image_mean": [ 0.5, 0.5, 0.5 ], "image_processor_type": "SiglipImageProcessor", "image_seq_length": 1024, "image_std": [ 0.5, 0.5, 0.5 ], "processor_class": "PaliGemmaProcessor", "resample": 3, "rescale_factor": 0.00392156862745098, "size": { "height": 448, "width": 448 } } - tokenizer: GemmaTokenizerFast(name_or_path='google/paligemma-3b-pt-448', vocab_size=257152, model_max_length=1000000000000000019884624838656, is_fast=True, padding_side='left', truncation_side='right', special_tokens={'bos_token': '', 'eos_token': '', 'unk_token': '', 'pad_token': '', 'additional_special_tokens': ['']}, clean_up_tokenization_spaces=False), added_tokens_decoder={ 0: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 1: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 2: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 3: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 4: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 5: AddedToken("<2mass>", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 6: AddedToken("[@BOS@]", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 7: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 8: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 9: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 10: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 11: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 12: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 13: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 14: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 15: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 16: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 17: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 18: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 19: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 20: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 21: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 22: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 23: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 24: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 25: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 26: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 27: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 28: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 29: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 30: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 31: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 32: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 33: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 34: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 35: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 36: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 37: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 38: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 39: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 40: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 41: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 42: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 43: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 44: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 45: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 46: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 47: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 48: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 49: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 50: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 51: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 52: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 53: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 54: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 55: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 56: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 57: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 58: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 59: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 60: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 61: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 62: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 63: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 64: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 65: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 66: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 67: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 68: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 69: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 70: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 71: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 72: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 73: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 74: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 75: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 76: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 77: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 78: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 79: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 80: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 81: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 82: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 83: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 84: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 85: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 86: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 87: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 88: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 89: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 90: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 91: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 92: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 93: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 94: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 95: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 96: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 97: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 98: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 99: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 100: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 101: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 102: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 103: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 104: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 105: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 106: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 107: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 108: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 109: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 110: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 111: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 112: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 113: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 114: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 115: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 116: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 117: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 118: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 119: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 120: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 121: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 122: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 123: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 124: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 125: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 126: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 127: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 128: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 129: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 130: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 131: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 132: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 133: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 134: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 135: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 136: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 137: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 138: AddedToken(" ", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 139: AddedToken("▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 140: AddedToken("▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 141: AddedToken("▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 142: AddedToken("▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 143: AddedToken("▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 144: AddedToken("▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 145: AddedToken("▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 146: AddedToken("▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 147: AddedToken("▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 148: AddedToken("▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 149: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 150: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 151: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 152: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 153: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 154: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 155: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 156: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 157: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 158: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 159: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 160: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 161: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 162: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 163: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 164: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 165: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 166: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 167: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 168: AddedToken("▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 169: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 170: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 172: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 173: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 174: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 175: AddedToken("
", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 171: AddedToken("
", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 176: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 177: AddedToken("
", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 178: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 179: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 180: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 181: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 182: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 183: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 184: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 185: AddedToken("

", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 186: AddedToken("

", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 187: AddedToken("

", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 188: AddedToken("

", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 189: AddedToken("

", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 190: AddedToken("
", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 191: AddedToken("
", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 192: AddedToken("
", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 193: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 194: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 195: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 196: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 197: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 198: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 199: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 200: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 201: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 202: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 203: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 204: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 205: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 206: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 207: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 208: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 209: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 210: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 211: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 212: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 213: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 214: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 215: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 216: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256000: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256001: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256002: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256003: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256004: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256005: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256006: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256007: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256008: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256009: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256010: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256011: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256012: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256013: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256014: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256015: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256016: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256017: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256018: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256019: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256020: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256021: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256022: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256023: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256024: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256025: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256026: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256027: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256028: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256029: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256030: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256031: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256032: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256033: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256034: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256035: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256036: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256037: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256038: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256039: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256040: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256041: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256042: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256043: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256044: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256045: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256046: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256047: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256048: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256049: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256050: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256051: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256052: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256053: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256054: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256055: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256056: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256057: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256058: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256059: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256060: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256061: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256062: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256063: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256064: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256065: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256066: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256067: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256068: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256069: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256070: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256071: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256072: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256073: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256074: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256075: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256076: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256077: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256078: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256079: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256080: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256081: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256082: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256083: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256084: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256085: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256086: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256087: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256088: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256089: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256090: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256091: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256092: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256093: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256094: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256095: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256096: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256097: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256098: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256099: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256100: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256101: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256102: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256103: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256104: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256105: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256106: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256107: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256108: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256109: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256110: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256111: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256112: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256113: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256114: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256115: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256116: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256117: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256118: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256119: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256120: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256121: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256122: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256123: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256124: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256125: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256126: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256127: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256128: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256129: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256130: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256131: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256132: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256133: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256134: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256135: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256136: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256137: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256138: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256139: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256140: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256141: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256142: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256143: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256144: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256145: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256146: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256147: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256148: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256149: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256150: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256151: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256152: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256153: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256154: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256155: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256156: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256157: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256158: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256159: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256160: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256161: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256162: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256163: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256164: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256165: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256166: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256167: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256168: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256169: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256170: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256171: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256172: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256173: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256174: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256175: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256176: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256177: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256178: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256179: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256180: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256181: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256182: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256183: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256184: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256185: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256186: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256187: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256188: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256189: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256190: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256191: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256192: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256193: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256194: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256195: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256196: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256197: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256198: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256199: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256200: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256201: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256202: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256203: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256204: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256205: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256206: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256207: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256208: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256209: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256210: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256211: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256212: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256213: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256214: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256215: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256216: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256217: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256218: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256219: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256220: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256221: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256222: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256223: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256224: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256225: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256226: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256227: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256228: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256229: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256230: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256231: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256232: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256233: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256234: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256235: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256236: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256237: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256238: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256239: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256240: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256241: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256242: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256243: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256244: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256245: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256246: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256247: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256248: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256249: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256250: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256251: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256252: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256253: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256254: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256255: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256256: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256257: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256258: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256259: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256260: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256261: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256262: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256263: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256264: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256265: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256266: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256267: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256268: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256269: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256270: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256271: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256272: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256273: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256274: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256275: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256276: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256277: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256278: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256279: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256280: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256281: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256282: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256283: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256284: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256285: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256286: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256287: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256288: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256289: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256290: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256291: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256292: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256293: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256294: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256295: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256296: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256297: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256298: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256299: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256300: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256301: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256302: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256303: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256304: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256305: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256306: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256307: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256308: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256309: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256310: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256311: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256312: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256313: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256314: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256315: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256316: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256317: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256318: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256319: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256320: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256321: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256322: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256323: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256324: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256325: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256326: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256327: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256328: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256329: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256330: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256331: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256332: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256333: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256334: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256335: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256336: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256337: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256338: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256339: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256340: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256341: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256342: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256343: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256344: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256345: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256346: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256347: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256348: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256349: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256350: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256351: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256352: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256353: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256354: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256355: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256356: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256357: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256358: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256359: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256360: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256361: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256362: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256363: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256364: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256365: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256366: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256367: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256368: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256369: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256370: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256371: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256372: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256373: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256374: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256375: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256376: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256377: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256378: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256379: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256380: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256381: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256382: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256383: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256384: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256385: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256386: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256387: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256388: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256389: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256390: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256391: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256392: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256393: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256394: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256395: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256396: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256397: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256398: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256399: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256400: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256401: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256402: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256403: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256404: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256405: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256406: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256407: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256408: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256409: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256410: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256411: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256412: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256413: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256414: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256415: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256416: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256417: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256418: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256419: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256420: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256421: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256422: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256423: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256424: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256425: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256426: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256427: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256428: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256429: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256430: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256431: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256432: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256433: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256434: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256435: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256436: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256437: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256438: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256439: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256440: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256441: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256442: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256443: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256444: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256445: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256446: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256447: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256448: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256449: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256450: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256451: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256452: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256453: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256454: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256455: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256456: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256457: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256458: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256459: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256460: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256461: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256462: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256463: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256464: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256465: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256466: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256467: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256468: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256469: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256470: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256471: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256472: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256473: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256474: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256475: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256476: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256477: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256478: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256479: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256480: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256481: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256482: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256483: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256484: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256485: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256486: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256487: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256488: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256489: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256490: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256491: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256492: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256493: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256494: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256495: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256496: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256497: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256498: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256499: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256500: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256501: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256502: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256503: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256504: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256505: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256506: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256507: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256508: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256509: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256510: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256511: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256512: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256513: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256514: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256515: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256516: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256517: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256518: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256519: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256520: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256521: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256522: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256523: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256524: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256525: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256526: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256527: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256528: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256529: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256530: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256531: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256532: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256533: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256534: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256535: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256536: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256537: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256538: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256539: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256540: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256541: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256542: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256543: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256544: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256545: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256546: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256547: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256548: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256549: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256550: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256551: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256552: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256553: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256554: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256555: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256556: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256557: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256558: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256559: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256560: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256561: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256562: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256563: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256564: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256565: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256566: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256567: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256568: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256569: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256570: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256571: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256572: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256573: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256574: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256575: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256576: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256577: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256578: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256579: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256580: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256581: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256582: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256583: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256584: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256585: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256586: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256587: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256588: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256589: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256590: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256591: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256592: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256593: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256594: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256595: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256596: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256597: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256598: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256599: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256600: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256601: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256602: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256603: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256604: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256605: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256606: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256607: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256608: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256609: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256610: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256611: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256612: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256613: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256614: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256615: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256616: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256617: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256618: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256619: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256620: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256621: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256622: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256623: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256624: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256625: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256626: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256627: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256628: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256629: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256630: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256631: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256632: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256633: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256634: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256635: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256636: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256637: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256638: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256639: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256640: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256641: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256642: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256643: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256644: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256645: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256646: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256647: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256648: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256649: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256650: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256651: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256652: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256653: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256654: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256655: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256656: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256657: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256658: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256659: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256660: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256661: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256662: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256663: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256664: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256665: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256666: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256667: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256668: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256669: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256670: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256671: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256672: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256673: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256674: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256675: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256676: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256677: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256678: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256679: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256680: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256681: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256682: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256683: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256684: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256685: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256686: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256687: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256688: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256689: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256690: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256691: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256692: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256693: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256694: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256695: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256696: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256697: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256698: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256699: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256700: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256701: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256702: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256703: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256704: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256705: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256706: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256707: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256708: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256709: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256710: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256711: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256712: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256713: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256714: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256715: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256716: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256717: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256718: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256719: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256720: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256721: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256722: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256723: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256724: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256725: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256726: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256727: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256728: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256729: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256730: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256731: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256732: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256733: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256734: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256735: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256736: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256737: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256738: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256739: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256740: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256741: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256742: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256743: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256744: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256745: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256746: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256747: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256748: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256749: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256750: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256751: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256752: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256753: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256754: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256755: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256756: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256757: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256758: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256759: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256760: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256761: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256762: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256763: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256764: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256765: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256766: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256767: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256768: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256769: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256770: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256771: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256772: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256773: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256774: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256775: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256776: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256777: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256778: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256779: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256780: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256781: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256782: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256783: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256784: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256785: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256786: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256787: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256788: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256789: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256790: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256791: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256792: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256793: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256794: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256795: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256796: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256797: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256798: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256799: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256800: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256801: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256802: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256803: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256804: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256805: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256806: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256807: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256808: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256809: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256810: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256811: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256812: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256813: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256814: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256815: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256816: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256817: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256818: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256819: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256820: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256821: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256822: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256823: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256824: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256825: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256826: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256827: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256828: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256829: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256830: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256831: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256832: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256833: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256834: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256835: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256836: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256837: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256838: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256839: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256840: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256841: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256842: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256843: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256844: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256845: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256846: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256847: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256848: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256849: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256850: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256851: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256852: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256853: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256854: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256855: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256856: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256857: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256858: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256859: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256860: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256861: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256862: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256863: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256864: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256865: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256866: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256867: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256868: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256869: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256870: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256871: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256872: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256873: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256874: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256875: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256876: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256877: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256878: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256879: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256880: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256881: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256882: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256883: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256884: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256885: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256886: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256887: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256888: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256889: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256890: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256891: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256892: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256893: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256894: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256895: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256896: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256897: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256898: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256899: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256900: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256901: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256902: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256903: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256904: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256905: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256906: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256907: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256908: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256909: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256910: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256911: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256912: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256913: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256914: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256915: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256916: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256917: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256918: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256919: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256920: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256921: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256922: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256923: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256924: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256925: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256926: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256927: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256928: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256929: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256930: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256931: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256932: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256933: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256934: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256935: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256936: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256937: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256938: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256939: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256940: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256941: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256942: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256943: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256944: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256945: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256946: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256947: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256948: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256949: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256950: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256951: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256952: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256953: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256954: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256955: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256956: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256957: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256958: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256959: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256960: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256961: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256962: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256963: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256964: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256965: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256966: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256967: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256968: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256969: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256970: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256971: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256972: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256973: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256974: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256975: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256976: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256977: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256978: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256979: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256980: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256981: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256982: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256983: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256984: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256985: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256986: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256987: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256988: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256989: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256990: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256991: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256992: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256993: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256994: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256995: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256996: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256997: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256998: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 256999: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257000: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257001: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257002: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257003: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257004: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257005: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257006: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257007: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257008: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257009: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257010: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257011: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257012: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257013: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257014: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257015: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257016: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257017: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257018: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257019: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257020: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257021: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257022: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257023: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257024: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257025: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257026: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257027: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257028: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257029: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257030: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257031: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257032: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257033: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257034: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257035: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257036: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257037: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257038: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257039: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257040: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257041: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257042: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257043: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257044: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257045: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257046: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257047: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257048: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257049: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257050: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257051: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257052: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257053: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257054: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257055: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257056: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257057: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257058: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257059: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257060: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257061: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257062: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257063: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257064: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257065: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257066: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257067: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257068: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257069: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257070: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257071: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257072: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257073: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257074: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257075: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257076: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257077: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257078: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257079: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257080: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257081: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257082: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257083: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257084: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257085: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257086: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257087: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257088: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257089: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257090: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257091: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257092: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257093: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257094: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257095: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257096: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257097: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257098: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257099: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257100: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257101: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257102: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257103: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257104: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257105: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257106: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257107: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257108: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257109: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257110: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257111: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257112: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257113: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257114: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257115: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257116: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257117: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257118: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257119: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257120: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257121: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257122: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257123: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257124: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257125: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257126: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257127: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257128: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257129: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257130: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257131: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257132: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257133: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257134: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257135: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257136: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257137: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257138: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257139: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257140: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257141: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257142: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257143: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257144: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257145: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257146: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257147: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257148: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257149: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257150: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257151: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=True, special=False), 257152: AddedToken("", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), } { "processor_class": "PaliGemmaProcessor" } [INFO|configuration_utils.py:675] 2024-10-15 09:56:10,355 >> loading configuration file config.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/config.json [INFO|configuration_utils.py:742] 2024-10-15 09:56:10,358 >> Model config PaliGemmaConfig { "_name_or_path": "google/paligemma-3b-pt-448", "_vocab_size": 257216, "architectures": [ "PaliGemmaForConditionalGeneration" ], "bos_token_id": 2, "eos_token_id": 1, "hidden_size": 2048, "image_token_index": 257152, "model_type": "paligemma", "pad_token_id": 0, "projection_dim": 2048, "text_config": { "hidden_size": 2048, "intermediate_size": 16384, "model_type": "gemma", "num_attention_heads": 8, "num_hidden_layers": 18, "num_image_tokens": 1024, "num_key_value_heads": 1, "torch_dtype": "float32", "vocab_size": 257216 }, "torch_dtype": "float32", "transformers_version": "4.45.2", "vision_config": { "hidden_size": 1152, "image_size": 448, "intermediate_size": 4304, "model_type": "siglip_vision_model", "num_attention_heads": 16, "num_hidden_layers": 27, "num_image_tokens": 1024, "patch_size": 14, "projection_dim": 2048, "projector_hidden_act": "gelu_fast", "vision_use_head": false } } [INFO|modeling_utils.py:3732] 2024-10-15 09:56:10,844 >> loading weights file model.safetensors from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/model.safetensors.index.json [INFO|modeling_utils.py:1622] 2024-10-15 09:57:32,738 >> Instantiating PaliGemmaForConditionalGeneration model under default dtype torch.bfloat16. [INFO|configuration_utils.py:1099] 2024-10-15 09:57:32,740 >> Generate config GenerationConfig { "bos_token_id": 2, "eos_token_id": 1, "pad_token_id": 0 } [INFO|configuration_utils.py:1099] 2024-10-15 09:57:32,922 >> Generate config GenerationConfig { "bos_token_id": 2, "eos_token_id": 1, "pad_token_id": 0 } [WARNING|logging.py:328] 2024-10-15 09:57:32,959 >> `config.hidden_act` is ignored, you should use `config.hidden_activation` instead. Gemma's activation function will be set to `gelu_pytorch_tanh`. Please, use `config.hidden_activation` if you want to override this behaviour. See https://github.com/huggingface/transformers/pull/29402 for more details. [INFO|modeling_utils.py:4574] 2024-10-15 09:57:37,152 >> All model checkpoint weights were used when initializing PaliGemmaForConditionalGeneration. [INFO|modeling_utils.py:4582] 2024-10-15 09:57:37,152 >> All the weights of PaliGemmaForConditionalGeneration were initialized from the model checkpoint at google/paligemma-3b-pt-448. If your task is similar to the task the model of the checkpoint was trained on, you can already use PaliGemmaForConditionalGeneration for predictions without further training. [INFO|configuration_utils.py:1054] 2024-10-15 09:57:37,402 >> loading configuration file generation_config.json from cache at /root/.cache/huggingface/hub/models--google--paligemma-3b-pt-448/snapshots/b714490ff582c78fb13d35175505831497970a75/generation_config.json [INFO|configuration_utils.py:1099] 2024-10-15 09:57:37,403 >> Generate config GenerationConfig { "bos_token_id": 2, "eos_token_id": 1, "pad_token_id": 0 } [INFO|trainer.py:667] 2024-10-15 09:57:38,204 >> Using auto half precision backend [INFO|trainer.py:2243] 2024-10-15 09:57:39,186 >> ***** Running training ***** [INFO|trainer.py:2244] 2024-10-15 09:57:39,186 >> Num examples = 2,850 [INFO|trainer.py:2245] 2024-10-15 09:57:39,186 >> Num Epochs = 2 [INFO|trainer.py:2246] 2024-10-15 09:57:39,186 >> Instantaneous batch size per device = 2 [INFO|trainer.py:2249] 2024-10-15 09:57:39,186 >> Total train batch size (w. parallel, distributed & accumulation) = 16 [INFO|trainer.py:2250] 2024-10-15 09:57:39,186 >> Gradient Accumulation steps = 8 [INFO|trainer.py:2251] 2024-10-15 09:57:39,186 >> Total optimization steps = 356 [INFO|trainer.py:2252] 2024-10-15 09:57:39,191 >> Number of trainable parameters = 9,805,824 [WARNING|logging.py:328] 2024-10-15 09:57:40,936 >> `use_cache=True` is incompatible with gradient checkpointing. Setting `use_cache=False`. [WARNING|logging.py:328] 2024-10-15 09:57:41,331 >> Starting from v4.46, the `logits` model output will have the same type as the model (except at train time, where it will always be FP32) [INFO|trainer.py:3705] 2024-10-15 11:07:36,763 >> Saving model checkpoint to saves/PaliGemma-3B-pt-448-Chat/lora/train_2024-10-15-09-54-06/checkpoint-356 [INFO|tokenization_utils_base.py:2641] 2024-10-15 11:07:37,004 >> tokenizer config file saved in saves/PaliGemma-3B-pt-448-Chat/lora/train_2024-10-15-09-54-06/checkpoint-356/tokenizer_config.json [INFO|tokenization_utils_base.py:2650] 2024-10-15 11:07:37,005 >> Special tokens file saved in saves/PaliGemma-3B-pt-448-Chat/lora/train_2024-10-15-09-54-06/checkpoint-356/special_tokens_map.json [INFO|image_processing_base.py:258] 2024-10-15 11:07:37,668 >> Image processor saved in saves/PaliGemma-3B-pt-448-Chat/lora/train_2024-10-15-09-54-06/checkpoint-356/preprocessor_config.json [INFO|trainer.py:2505] 2024-10-15 11:07:37,668 >> Training completed. Do not forget to share your model on huggingface.co/models =) [INFO|image_processing_base.py:258] 2024-10-15 11:07:37,670 >> Image processor saved in saves/PaliGemma-3B-pt-448-Chat/lora/train_2024-10-15-09-54-06/preprocessor_config.json [INFO|trainer.py:3705] 2024-10-15 11:07:37,671 >> Saving model checkpoint to saves/PaliGemma-3B-pt-448-Chat/lora/train_2024-10-15-09-54-06 [INFO|tokenization_utils_base.py:2641] 2024-10-15 11:07:37,877 >> tokenizer config file saved in saves/PaliGemma-3B-pt-448-Chat/lora/train_2024-10-15-09-54-06/tokenizer_config.json [INFO|tokenization_utils_base.py:2650] 2024-10-15 11:07:37,877 >> Special tokens file saved in saves/PaliGemma-3B-pt-448-Chat/lora/train_2024-10-15-09-54-06/special_tokens_map.json [INFO|trainer.py:4021] 2024-10-15 11:07:38,574 >> ***** Running Evaluation ***** [INFO|trainer.py:4023] 2024-10-15 11:07:38,574 >> Num examples = 150 [INFO|trainer.py:4026] 2024-10-15 11:07:38,574 >> Batch size = 2 [INFO|modelcard.py:449] 2024-10-15 11:08:15,728 >> Dropping the following result as it does not have all the necessary fields: {'task': {'name': 'Causal Language Modeling', 'type': 'text-generation'}}