Designing adaptable ML systems>>> Which of the following models are susceptible to a feedback loop? Check all that apply >>> Production Machine Learning Systems
Which of the following models are susceptible to a feedback loop? Check all that apply.
Correct! Some beachgoers are likely to base their plans on the traffic forecast. If there is a large beach crowd and traffic is forecast to be heavy, many people may make alternative plans. This may depress beach turnout, resulting in a lighter traffic forecast, which then may increase attendance, and the cycle repeats.
Correct! The model’s rankings may drive additional interest to top-rated schools, increasing the number of applications they receive. If these schools continue to admit the same number of students, selectivity will increase (the percentage of students admitted will go down). This will boost these schools’ rankings, which will further increase prospective student interest, and so on…
Correct! Book recommendations are likely to drive purchases, and these additional sales will be fed back into the model as input, making it more likely to recommend these same books in the future.
Gradual drift is used for which of the following?
Suppose you are building an ML-based system to predict the likelihood that a customer will leave a positive review. The user interface that customers leave reviews on changed a few months ago, but you don’t know about this. Which of these is a potential consequence of mismanaging this data dependency?
Correct! For example, a review might be easier to write, and so your prediction of whether someone will leave a review (whether good or bad) is too low because it was trained on reviews that resulted from the older, harder-to-use user interface
Which component identifies anomalies in training and serving data and can automatically create a schema by examining the data?
What is training skew caused by?
Correct! Different versions may cause predictions to be significantly slower or consume more memory in the training environment than in the development environment. Different code may result in different performance.
Which of the following tools help software users manage dependency issues?
What is the shift in the actual relationship between the model inputs and the output called?