In our case, the biggest problem is to deploy, monitor and view the track of the model in the production. Most problem is that it is not well fit to our platform that DS use for their model deployments,and we need to change it for gpt like models. The most important problem is that, you need to have unified schema for saving inputs, outputs and then calculate metrics on them vor further development and alerting.
In our case, the biggest problem is to deploy, monitor and view the track of the model in the production. Most problem is that it is not well fit to our platform that DS use for their model deployments,and we need to change it for gpt like models. The most important problem is that, you need to have unified schema for saving inputs, outputs and then calculate metrics on them vor further development and alerting.