Checkout
Personalized AI apps
Build multi-agent systems without code and automate document search, RAG and content generation
Start free trial
Question

Instruction Tuning - Why is fine-tuning a problem?

Answer

Without a recognized mechanism to explain why the parameters happen to have exactly the observed values that they return, theories that need fine-tuning are seen as problematic. Naturalness is the heuristic rule that states parameters in a basic physical theory shouldn't be overly fine-tuned.