stopthatgirl7@kbin.social to Technology@lemmy.world · 1 year agoEverything Made By an AI Is In the Public Domaindoctorow.medium.comexternal-linkmessage-square137fedilinkarrow-up1641arrow-down130file-text
arrow-up1611arrow-down1external-linkEverything Made By an AI Is In the Public Domaindoctorow.medium.comstopthatgirl7@kbin.social to Technology@lemmy.world · 1 year agomessage-square137fedilinkfile-text
minus-squareillusoryMechanist@lemmy.worldlinkfedilinkEnglisharrow-up2·1 year agoDoes this mean we can, indeed, train AI on ChatGPT/other AI outputs?
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up8·1 year agoFYI there’s studies showing that repeatedly training ML on ML outputs degrades quality sharply after 4-5 cycles
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up5·1 year agoMachine Learning in this context
minus-squarePrager_U@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down1·1 year agoThat is a used method for training other LLMs, I believe OpenAssistant did this.
minus-squareassassin_aragorn@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down1·1 year agoDoesn’t that break the models?
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up2·1 year agoIt does after 4-5 cycles yeah, built in algorithmic biases gets amplified to a degree that it breaks the model
Does this mean we can, indeed, train AI on ChatGPT/other AI outputs?
FYI there’s studies showing that repeatedly training ML on ML outputs degrades quality sharply after 4-5 cycles
What does ml stand for
Machine Learning in this context
That is a used method for training other LLMs, I believe OpenAssistant did this.
Doesn’t that break the models?
It does after 4-5 cycles yeah, built in algorithmic biases gets amplified to a degree that it breaks the model