Can I assume AI are continuing their training as they interact with people when deployed? Are ChatGPT, Claude, learning from my interactions with them? I do, BTW, correct them when they unknowingly (I assume) steer me wrong.
One wonders, if that's the case, how quickly an AI might improve if it has something close to Google's search site throughput. I mean fielding several billion queries a day, for a year — that would be some pretty stellar training right there I would think.
They don't train as they go. Training is incredibly expensive.
They do take your feedback and presumably do something with it. Your actual queries are only indirectly useful since they might have private info in them.
> Can I assume AI are continuing their training as they interact with people when deployed?
Yes, you can. Some of the big providers are fairly clear on where in their products this happens, and all offer a way out (mostly when paying for api access)
> One wonders, if that's the case, how quickly an AI might improve if it has something close to Google's search site throughput
Indeed. Another possibility is that user input will turn out to be increasingly less important for upcoming state of the art models.
One wonders, if that's the case, how quickly an AI might improve if it has something close to Google's search site throughput. I mean fielding several billion queries a day, for a year — that would be some pretty stellar training right there I would think.