"If cats and dogs are equally easy to draw, and if the model gets diminishing returns on capacity in both categories, and if the categories are equally common, then we should expect it to spend a"
Mode collapse is an issue where AI models often produce outputs from their training distribution, leading to repetitive patterns. It was initially observed in early image generating AI, where models often produced just the training distribution. It became a concern for AI industry experts, but has since been shown that training on AI-generated inputs can be done effectively.
Read at Lesswrong
Unable to calculate read time
Collection
[
|
...
]