It can work for some things, but you have to be careful AF.
Most of the ‘reasoning’ models are already doing this or web searches to make sure answers are sane. Hallucinations are still all over the place, but they’re processing the request multiple times on multiple models and only giving you back answers that don’t have too many red flags.
I was told to test out what it could do for translation. Single model translate was in the ballpark but rarely really great. translate your shipment has arrived to french.
Then take the suggested output to a local model, say i was told this was the proper translation for “your shipment has arrived” in French where the context is it’s an airdrop from a plane and it’s a crate full of food.
rate this translation from 1 to 5, 1 being poor and 5 being excellent and give me examples why you thing it’s rated that way
take that back to the first model,
I was told that this was an acceptable translation, but a better one might be …
Then i took the output and put it up against our professional translations.
both models spitballing off each other were at least acceptable 99% of the time, and once in a while the output was more accurate than the professional service we were paying to do it.
We still use the professional service, but I vet their output now.
We’ve gone through tons of vendors. We’ve spent tons on well known vendors, we’ve spent pittances on shitty vendors, in the end, they all outsource to some random polyglot who either doesn’t quite have a grasp on one language or the other or maybe doesn’t have the whole context. For some reason, they fail to give us a good translation some percentage of the time and the communities bitch. It’s a mix really and if they would do the job right the first time, it would be awesome. We’re translating into a dozen languages and on a busy month, we might send out 1200 names/paragraphs to be translated.
For someone fluent in all involved languages, sure.
But from the sounds of it, OP’s company outsources the translation but doesn’t fully trust the output they get back. They’re back to square one for verifying it, because if they knew both languages enough to verify, they could do the translations themselves.
The problem AI is trying to solve is “how do I access a skill I don’t have cheaply?” It’s only because it’s bad at that problem that it has shifted to “how can we use AI to get more production out of the skilled workers we still need to babysit the AI that is unreliable at everything?”
It can work for some things, but you have to be careful AF.
Most of the ‘reasoning’ models are already doing this or web searches to make sure answers are sane. Hallucinations are still all over the place, but they’re processing the request multiple times on multiple models and only giving you back answers that don’t have too many red flags.
I was told to test out what it could do for translation. Single model translate was in the ballpark but rarely really great. translate your shipment has arrived to french.
Then take the suggested output to a local model, say i was told this was the proper translation for “your shipment has arrived” in French where the context is it’s an airdrop from a plane and it’s a crate full of food.
rate this translation from 1 to 5, 1 being poor and 5 being excellent and give me examples why you thing it’s rated that way
take that back to the first model,
I was told that this was an acceptable translation, but a better one might be …
Then i took the output and put it up against our professional translations.
both models spitballing off each other were at least acceptable 99% of the time, and once in a while the output was more accurate than the professional service we were paying to do it.
We still use the professional service, but I vet their output now.
Why not just do the job correctly in the first place? Honestly this sounds like fucking exhausting busywork.
We’ve gone through tons of vendors. We’ve spent tons on well known vendors, we’ve spent pittances on shitty vendors, in the end, they all outsource to some random polyglot who either doesn’t quite have a grasp on one language or the other or maybe doesn’t have the whole context. For some reason, they fail to give us a good translation some percentage of the time and the communities bitch. It’s a mix really and if they would do the job right the first time, it would be awesome. We’re translating into a dozen languages and on a busy month, we might send out 1200 names/paragraphs to be translated.
For someone fluent in all involved languages, sure.
But from the sounds of it, OP’s company outsources the translation but doesn’t fully trust the output they get back. They’re back to square one for verifying it, because if they knew both languages enough to verify, they could do the translations themselves.
The problem AI is trying to solve is “how do I access a skill I don’t have cheaply?” It’s only because it’s bad at that problem that it has shifted to “how can we use AI to get more production out of the skilled workers we still need to babysit the AI that is unreliable at everything?”