Interesting - I can sort of intuit why it might help. Feeding the model bad data and instructing training it to identify it as such would be advantageous compared to being entirely unaware of it.
- Posts
- 11
- Comments
- 93
- Joined
- 3 yr. ago
- Posts
- 11
- Comments
- 93
- Joined
- 3 yr. ago
- JumpDeleted
Permanently Deleted
This is obviously subjective depending on what you want to achieve with your llm, but "Bad" data in that it showcases the opposite of what is desirable output. Think bunk conspiracies, hostility, deception, racism, religious extremism etc.