Multitask Prompt Tuning - What is multi prompt tuning?

We have created a mechanism called multitask prompt tuning (MPT). To start, it learns a single generalizable prompt by synthesising information from several task-specific source prompts. Then, in order to efficiently tailor the shared prompt to each target task, we learn multiplicative low rank updates.