Open
Description
Is your feature request related to a problem? Please describe.
For this reference example we would like to have a solution for deployed model monitoring
Describe the solution you'd like
To be discussed.
Ideally we'd like to have a monitoring for both:
- input cases
- model predictions
Additional context
- There may be off-the-shelf tools that we can use
- We may be able to get Vertex monitoring to work in our use-case (it's not suited to computer vision tasks, because it would treat every pixel as an 'independent variable').