Rlhf - Is RLHF more difficult than standard RL?

In contrast to traditional RL, which learns directly from reward signals, RLHF (Reinforcement Learning from Human Feedback) also considers preference signals. Since preferences don't necessarily communicate as much information as incentives, preference-based RL may appear more challenging.