Investigating fine-tuning limitations for VLMs with three case studies

Hello, this is Aurélie, working as an Artificial Intelligence Engineer at Ridge-i. Today I would like to share some insights about fine-tuning vision language models (VLMs)! Introduction To fine-tune or not to fine-tune Which modules to keep frozen in a VLM when fine-tuning Internal experiments The…