Understanding Parameter-Efficient LLM Finetuning: Prompt Tuning And Prefix Tuning

Last week, I shared an overview of different Large Language Model (LLM) finetuning techniques. In a series of short articles, I am planning to discuss a selection of the most relevant techniques one by one. Let's start with a selection of parameter-efficient finetuning