Phi Model Updates · hiyouga LLaMA-Factory · Discussion #2178

Due to Microsoft's modification of the Phi-1.5/2 model files, for Phi models downloaded after 2024/1/11, the default modules (i.e. --lora_target) should be q_proj,v_proj instead of Wqkv. Please be ...