[INFO|configuration_utils.py:672] 2024-09-20 08:02:19,621 >> loading configuration file config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/config.json [WARNING|modeling_rope_utils.py:379] 2024-09-20 08:02:19,623 >> Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'} [INFO|configuration_utils.py:739] 2024-09-20 08:02:19,626 >> Model config Qwen2VLConfig { "_name_or_path": "Qwen/Qwen2-VL-2B-Instruct", "architectures": [ "Qwen2VLForConditionalGeneration" ], "attention_dropout": 0.0, "bos_token_id": 151643, "eos_token_id": 151645, "hidden_act": "silu", "hidden_size": 1536, "image_token_id": 151655, "initializer_range": 0.02, "intermediate_size": 8960, "max_position_embeddings": 32768, "max_window_layers": 28, "model_type": "qwen2_vl", "num_attention_heads": 12, "num_hidden_layers": 28, "num_key_value_heads": 2, "rms_norm_eps": 1e-06, "rope_scaling": { "mrope_section": [ 16, 24, 24 ], "rope_type": "default", "type": "default" }, "rope_theta": 1000000.0, "sliding_window": 32768, "tie_word_embeddings": true, "torch_dtype": "bfloat16", "transformers_version": "4.45.0.dev0", "use_cache": true, "use_sliding_window": false, "video_token_id": 151656, "vision_config": { "hidden_size": 1536, "in_chans": 3, "model_type": "qwen2_vl", "spatial_patch_size": 14 }, "vision_end_token_id": 151653, "vision_start_token_id": 151652, "vision_token_id": 151654, "vocab_size": 151936 } [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:24,743 >> loading file vocab.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/vocab.json [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:24,743 >> loading file merges.txt from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/merges.txt [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:24,743 >> loading file tokenizer.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/tokenizer.json [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:24,743 >> loading file added_tokens.json from cache at None [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:24,744 >> loading file special_tokens_map.json from cache at None [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:24,744 >> loading file tokenizer_config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/tokenizer_config.json [INFO|tokenization_utils_base.py:2479] 2024-09-20 08:02:24,951 >> Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. [INFO|image_processing_base.py:375] 2024-09-20 08:02:25,880 >> loading configuration file preprocessor_config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/preprocessor_config.json [INFO|image_processing_base.py:375] 2024-09-20 08:02:26,112 >> loading configuration file preprocessor_config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/preprocessor_config.json [INFO|image_processing_base.py:429] 2024-09-20 08:02:26,112 >> Image processor Qwen2VLImageProcessor { "do_convert_rgb": true, "do_normalize": true, "do_rescale": true, "do_resize": true, "image_mean": [ 0.48145466, 0.4578275, 0.40821073 ], "image_processor_type": "Qwen2VLImageProcessor", "image_std": [ 0.26862954, 0.26130258, 0.27577711 ], "max_pixels": 12845056, "merge_size": 2, "min_pixels": 3136, "patch_size": 14, "processor_class": "Qwen2VLProcessor", "resample": 3, "rescale_factor": 0.00392156862745098, "size": { "max_pixels": 12845056, "min_pixels": 3136 }, "temporal_patch_size": 2 } [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:26,340 >> loading file vocab.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/vocab.json [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:26,340 >> loading file merges.txt from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/merges.txt [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:26,340 >> loading file tokenizer.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/tokenizer.json [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:26,340 >> loading file added_tokens.json from cache at None [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:26,340 >> loading file special_tokens_map.json from cache at None [INFO|tokenization_utils_base.py:2215] 2024-09-20 08:02:26,340 >> loading file tokenizer_config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/tokenizer_config.json [INFO|tokenization_utils_base.py:2479] 2024-09-20 08:02:26,572 >> Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. [INFO|processing_utils.py:738] 2024-09-20 08:02:27,603 >> Processor Qwen2VLProcessor: - image_processor: Qwen2VLImageProcessor { "do_convert_rgb": true, "do_normalize": true, "do_rescale": true, "do_resize": true, "image_mean": [ 0.48145466, 0.4578275, 0.40821073 ], "image_processor_type": "Qwen2VLImageProcessor", "image_std": [ 0.26862954, 0.26130258, 0.27577711 ], "max_pixels": 12845056, "merge_size": 2, "min_pixels": 3136, "patch_size": 14, "processor_class": "Qwen2VLProcessor", "resample": 3, "rescale_factor": 0.00392156862745098, "size": { "max_pixels": 12845056, "min_pixels": 3136 }, "temporal_patch_size": 2 } - tokenizer: Qwen2TokenizerFast(name_or_path='Qwen/Qwen2-VL-2B-Instruct', vocab_size=151643, model_max_length=32768, is_fast=True, padding_side='left', truncation_side='right', special_tokens={'eos_token': '<|im_end|>', 'pad_token': '<|endoftext|>', 'additional_special_tokens': ['<|im_start|>', '<|im_end|>', '<|object_ref_start|>', '<|object_ref_end|>', '<|box_start|>', '<|box_end|>', '<|quad_start|>', '<|quad_end|>', '<|vision_start|>', '<|vision_end|>', '<|vision_pad|>', '<|image_pad|>', '<|video_pad|>']}, clean_up_tokenization_spaces=False), added_tokens_decoder={ 151643: AddedToken("<|endoftext|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151644: AddedToken("<|im_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151645: AddedToken("<|im_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151646: AddedToken("<|object_ref_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151647: AddedToken("<|object_ref_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151648: AddedToken("<|box_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151649: AddedToken("<|box_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151650: AddedToken("<|quad_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151651: AddedToken("<|quad_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151652: AddedToken("<|vision_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151653: AddedToken("<|vision_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151654: AddedToken("<|vision_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151655: AddedToken("<|image_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), 151656: AddedToken("<|video_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True), } { "processor_class": "Qwen2VLProcessor" } [INFO|configuration_utils.py:672] 2024-09-20 08:03:29,135 >> loading configuration file config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/config.json [WARNING|modeling_rope_utils.py:379] 2024-09-20 08:03:29,135 >> Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'} [INFO|configuration_utils.py:739] 2024-09-20 08:03:29,139 >> Model config Qwen2VLConfig { "_name_or_path": "Qwen/Qwen2-VL-2B-Instruct", "architectures": [ "Qwen2VLForConditionalGeneration" ], "attention_dropout": 0.0, "bos_token_id": 151643, "eos_token_id": 151645, "hidden_act": "silu", "hidden_size": 1536, "image_token_id": 151655, "initializer_range": 0.02, "intermediate_size": 8960, "max_position_embeddings": 32768, "max_window_layers": 28, "model_type": "qwen2_vl", "num_attention_heads": 12, "num_hidden_layers": 28, "num_key_value_heads": 2, "rms_norm_eps": 1e-06, "rope_scaling": { "mrope_section": [ 16, 24, 24 ], "rope_type": "default", "type": "default" }, "rope_theta": 1000000.0, "sliding_window": 32768, "tie_word_embeddings": true, "torch_dtype": "bfloat16", "transformers_version": "4.45.0.dev0", "use_cache": true, "use_sliding_window": false, "video_token_id": 151656, "vision_config": { "hidden_size": 1536, "in_chans": 3, "model_type": "qwen2_vl", "spatial_patch_size": 14 }, "vision_end_token_id": 151653, "vision_start_token_id": 151652, "vision_token_id": 151654, "vocab_size": 151936 } [INFO|modeling_utils.py:3702] 2024-09-20 08:03:30,297 >> loading weights file model.safetensors from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/model.safetensors.index.json [INFO|modeling_utils.py:1621] 2024-09-20 08:06:23,372 >> Instantiating Qwen2VLForConditionalGeneration model under default dtype torch.bfloat16. [INFO|configuration_utils.py:1097] 2024-09-20 08:06:23,376 >> Generate config GenerationConfig { "bos_token_id": 151643, "eos_token_id": 151645 } [WARNING|logging.py:328] 2024-09-20 08:06:23,439 >> `Qwen2VLRotaryEmbedding` can now be fully parameterized by passing the model config through the `config` argument. All other arguments will be removed in v4.46 [INFO|modeling_utils.py:4544] 2024-09-20 08:06:24,942 >> All model checkpoint weights were used when initializing Qwen2VLForConditionalGeneration. [INFO|modeling_utils.py:4552] 2024-09-20 08:06:24,942 >> All the weights of Qwen2VLForConditionalGeneration were initialized from the model checkpoint at Qwen/Qwen2-VL-2B-Instruct. If your task is similar to the task the model of the checkpoint was trained on, you can already use Qwen2VLForConditionalGeneration for predictions without further training. [INFO|configuration_utils.py:1052] 2024-09-20 08:06:25,462 >> loading configuration file generation_config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/generation_config.json [INFO|configuration_utils.py:1097] 2024-09-20 08:06:25,463 >> Generate config GenerationConfig { "bos_token_id": 151643, "do_sample": true, "eos_token_id": [ 151645, 151643 ], "pad_token_id": 151643, "temperature": 0.01, "top_k": 1, "top_p": 0.001 } [INFO|trainer.py:667] 2024-09-20 08:06:25,968 >> Using auto half precision backend [INFO|trainer.py:2212] 2024-09-20 08:06:26,242 >> ***** Running training ***** [INFO|trainer.py:2213] 2024-09-20 08:06:26,242 >> Num examples = 1,891 [INFO|trainer.py:2214] 2024-09-20 08:06:26,242 >> Num Epochs = 3 [INFO|trainer.py:2215] 2024-09-20 08:06:26,242 >> Instantaneous batch size per device = 2 [INFO|trainer.py:2218] 2024-09-20 08:06:26,242 >> Total train batch size (w. parallel, distributed & accumulation) = 16 [INFO|trainer.py:2219] 2024-09-20 08:06:26,242 >> Gradient Accumulation steps = 8 [INFO|trainer.py:2220] 2024-09-20 08:06:26,242 >> Total optimization steps = 354 [INFO|trainer.py:2221] 2024-09-20 08:06:26,247 >> Number of trainable parameters = 9,232,384 [INFO|trainer.py:3674] 2024-09-20 08:21:08,107 >> Saving model checkpoint to saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-100 [INFO|configuration_utils.py:672] 2024-09-20 08:21:08,640 >> loading configuration file config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/config.json [WARNING|modeling_rope_utils.py:379] 2024-09-20 08:21:08,640 >> Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'} [INFO|configuration_utils.py:739] 2024-09-20 08:21:08,643 >> Model config Qwen2VLConfig { "architectures": [ "Qwen2VLForConditionalGeneration" ], "attention_dropout": 0.0, "bos_token_id": 151643, "eos_token_id": 151645, "hidden_act": "silu", "hidden_size": 1536, "image_token_id": 151655, "initializer_range": 0.02, "intermediate_size": 8960, "max_position_embeddings": 32768, "max_window_layers": 28, "model_type": "qwen2_vl", "num_attention_heads": 12, "num_hidden_layers": 28, "num_key_value_heads": 2, "rms_norm_eps": 1e-06, "rope_scaling": { "mrope_section": [ 16, 24, 24 ], "rope_type": "default", "type": "default" }, "rope_theta": 1000000.0, "sliding_window": 32768, "tie_word_embeddings": true, "torch_dtype": "bfloat16", "transformers_version": "4.45.0.dev0", "use_cache": true, "use_sliding_window": false, "video_token_id": 151656, "vision_config": { "hidden_size": 1536, "in_chans": 3, "model_type": "qwen2_vl", "spatial_patch_size": 14 }, "vision_end_token_id": 151653, "vision_start_token_id": 151652, "vision_token_id": 151654, "vocab_size": 151936 } [INFO|tokenization_utils_base.py:2650] 2024-09-20 08:21:08,716 >> tokenizer config file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-100/tokenizer_config.json [INFO|tokenization_utils_base.py:2659] 2024-09-20 08:21:08,717 >> Special tokens file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-100/special_tokens_map.json [INFO|image_processing_base.py:258] 2024-09-20 08:21:09,010 >> Image processor saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-100/preprocessor_config.json [INFO|trainer.py:3674] 2024-09-20 08:35:43,125 >> Saving model checkpoint to saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-200 [INFO|configuration_utils.py:672] 2024-09-20 08:35:43,653 >> loading configuration file config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/config.json [WARNING|modeling_rope_utils.py:379] 2024-09-20 08:35:43,654 >> Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'} [INFO|configuration_utils.py:739] 2024-09-20 08:35:43,657 >> Model config Qwen2VLConfig { "architectures": [ "Qwen2VLForConditionalGeneration" ], "attention_dropout": 0.0, "bos_token_id": 151643, "eos_token_id": 151645, "hidden_act": "silu", "hidden_size": 1536, "image_token_id": 151655, "initializer_range": 0.02, "intermediate_size": 8960, "max_position_embeddings": 32768, "max_window_layers": 28, "model_type": "qwen2_vl", "num_attention_heads": 12, "num_hidden_layers": 28, "num_key_value_heads": 2, "rms_norm_eps": 1e-06, "rope_scaling": { "mrope_section": [ 16, 24, 24 ], "rope_type": "default", "type": "default" }, "rope_theta": 1000000.0, "sliding_window": 32768, "tie_word_embeddings": true, "torch_dtype": "bfloat16", "transformers_version": "4.45.0.dev0", "use_cache": true, "use_sliding_window": false, "video_token_id": 151656, "vision_config": { "hidden_size": 1536, "in_chans": 3, "model_type": "qwen2_vl", "spatial_patch_size": 14 }, "vision_end_token_id": 151653, "vision_start_token_id": 151652, "vision_token_id": 151654, "vocab_size": 151936 } [INFO|tokenization_utils_base.py:2650] 2024-09-20 08:35:43,733 >> tokenizer config file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-200/tokenizer_config.json [INFO|tokenization_utils_base.py:2659] 2024-09-20 08:35:43,733 >> Special tokens file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-200/special_tokens_map.json [INFO|image_processing_base.py:258] 2024-09-20 08:35:44,038 >> Image processor saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-200/preprocessor_config.json [INFO|trainer.py:3674] 2024-09-20 08:50:40,570 >> Saving model checkpoint to saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-300 [INFO|configuration_utils.py:672] 2024-09-20 08:50:41,112 >> loading configuration file config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/config.json [WARNING|modeling_rope_utils.py:379] 2024-09-20 08:50:41,113 >> Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'} [INFO|configuration_utils.py:739] 2024-09-20 08:50:41,116 >> Model config Qwen2VLConfig { "architectures": [ "Qwen2VLForConditionalGeneration" ], "attention_dropout": 0.0, "bos_token_id": 151643, "eos_token_id": 151645, "hidden_act": "silu", "hidden_size": 1536, "image_token_id": 151655, "initializer_range": 0.02, "intermediate_size": 8960, "max_position_embeddings": 32768, "max_window_layers": 28, "model_type": "qwen2_vl", "num_attention_heads": 12, "num_hidden_layers": 28, "num_key_value_heads": 2, "rms_norm_eps": 1e-06, "rope_scaling": { "mrope_section": [ 16, 24, 24 ], "rope_type": "default", "type": "default" }, "rope_theta": 1000000.0, "sliding_window": 32768, "tie_word_embeddings": true, "torch_dtype": "bfloat16", "transformers_version": "4.45.0.dev0", "use_cache": true, "use_sliding_window": false, "video_token_id": 151656, "vision_config": { "hidden_size": 1536, "in_chans": 3, "model_type": "qwen2_vl", "spatial_patch_size": 14 }, "vision_end_token_id": 151653, "vision_start_token_id": 151652, "vision_token_id": 151654, "vocab_size": 151936 } [INFO|tokenization_utils_base.py:2650] 2024-09-20 08:50:41,203 >> tokenizer config file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-300/tokenizer_config.json [INFO|tokenization_utils_base.py:2659] 2024-09-20 08:50:41,203 >> Special tokens file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-300/special_tokens_map.json [INFO|image_processing_base.py:258] 2024-09-20 08:50:41,492 >> Image processor saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-300/preprocessor_config.json [INFO|trainer.py:3674] 2024-09-20 08:58:18,572 >> Saving model checkpoint to saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-354 [INFO|configuration_utils.py:672] 2024-09-20 08:58:19,972 >> loading configuration file config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/config.json [WARNING|modeling_rope_utils.py:379] 2024-09-20 08:58:19,972 >> Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'} [INFO|configuration_utils.py:739] 2024-09-20 08:58:19,975 >> Model config Qwen2VLConfig { "architectures": [ "Qwen2VLForConditionalGeneration" ], "attention_dropout": 0.0, "bos_token_id": 151643, "eos_token_id": 151645, "hidden_act": "silu", "hidden_size": 1536, "image_token_id": 151655, "initializer_range": 0.02, "intermediate_size": 8960, "max_position_embeddings": 32768, "max_window_layers": 28, "model_type": "qwen2_vl", "num_attention_heads": 12, "num_hidden_layers": 28, "num_key_value_heads": 2, "rms_norm_eps": 1e-06, "rope_scaling": { "mrope_section": [ 16, 24, 24 ], "rope_type": "default", "type": "default" }, "rope_theta": 1000000.0, "sliding_window": 32768, "tie_word_embeddings": true, "torch_dtype": "bfloat16", "transformers_version": "4.45.0.dev0", "use_cache": true, "use_sliding_window": false, "video_token_id": 151656, "vision_config": { "hidden_size": 1536, "in_chans": 3, "model_type": "qwen2_vl", "spatial_patch_size": 14 }, "vision_end_token_id": 151653, "vision_start_token_id": 151652, "vision_token_id": 151654, "vocab_size": 151936 } [INFO|tokenization_utils_base.py:2650] 2024-09-20 08:58:20,050 >> tokenizer config file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-354/tokenizer_config.json [INFO|tokenization_utils_base.py:2659] 2024-09-20 08:58:20,051 >> Special tokens file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-354/special_tokens_map.json [INFO|image_processing_base.py:258] 2024-09-20 08:58:20,359 >> Image processor saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/checkpoint-354/preprocessor_config.json [INFO|trainer.py:2474] 2024-09-20 08:58:20,360 >> Training completed. Do not forget to share your model on huggingface.co/models =) [INFO|image_processing_base.py:258] 2024-09-20 08:58:20,362 >> Image processor saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/preprocessor_config.json [INFO|trainer.py:3674] 2024-09-20 08:58:20,362 >> Saving model checkpoint to saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22 [INFO|configuration_utils.py:672] 2024-09-20 08:58:21,257 >> loading configuration file config.json from cache at /home/.cache/huggingface/hub/models--Qwen--Qwen2-VL-2B-Instruct/snapshots/3c86da475a9bcc0876910f022ecdd476e621e636/config.json [WARNING|modeling_rope_utils.py:379] 2024-09-20 08:58:21,257 >> Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'} [INFO|configuration_utils.py:739] 2024-09-20 08:58:21,259 >> Model config Qwen2VLConfig { "architectures": [ "Qwen2VLForConditionalGeneration" ], "attention_dropout": 0.0, "bos_token_id": 151643, "eos_token_id": 151645, "hidden_act": "silu", "hidden_size": 1536, "image_token_id": 151655, "initializer_range": 0.02, "intermediate_size": 8960, "max_position_embeddings": 32768, "max_window_layers": 28, "model_type": "qwen2_vl", "num_attention_heads": 12, "num_hidden_layers": 28, "num_key_value_heads": 2, "rms_norm_eps": 1e-06, "rope_scaling": { "mrope_section": [ 16, 24, 24 ], "rope_type": "default", "type": "default" }, "rope_theta": 1000000.0, "sliding_window": 32768, "tie_word_embeddings": true, "torch_dtype": "bfloat16", "transformers_version": "4.45.0.dev0", "use_cache": true, "use_sliding_window": false, "video_token_id": 151656, "vision_config": { "hidden_size": 1536, "in_chans": 3, "model_type": "qwen2_vl", "spatial_patch_size": 14 }, "vision_end_token_id": 151653, "vision_start_token_id": 151652, "vision_token_id": 151654, "vocab_size": 151936 } [INFO|tokenization_utils_base.py:2650] 2024-09-20 08:58:21,310 >> tokenizer config file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/tokenizer_config.json [INFO|tokenization_utils_base.py:2659] 2024-09-20 08:58:21,310 >> Special tokens file saved in saves/Qwen2VL-2B-Instruct/lora/train_2024-09-20-07-59-22/special_tokens_map.json [INFO|modelcard.py:449] 2024-09-20 08:58:21,602 >> Dropping the following result as it does not have all the necessary fields: {'task': {'name': 'Causal Language Modeling', 'type': 'text-generation'}}