Unit 6: Pipelines, Model Evaluation and Model Deployment - Practice Quiz

INT395 — Supervised Learning 50 Questions
0 Correct 0 Wrong 50 Left
0/50

1 What is the primary purpose of using a Pipeline in machine learning workflows, such as those in Scikit-Learn?

A. To deploy the model directly to a cloud server
B. To visualize the neural network architecture
C. To chain together multiple processing steps (transformers) and a final estimator
D. To automatically select the best algorithm for the dataset

2 When using a Pipeline, how is data leakage prevented during Cross-Validation?

A. By fitting the transformer on the entire dataset before splitting
B. By fitting transformers only on the training folds and applying them to the validation fold
C. By using only the final estimator during cross-validation
D. By shuffling the data repeatedly

3 In a Scikit-Learn Pipeline, which method is called on the intermediate steps during the training phase?

A. score()
B. predict()
C. transform()
D. fit_transform()

4 Which of the following classes allows you to apply different transformers to different columns of an array or pandas DataFrame?

A. ColumnTransformer
B. FeatureUnion
C. FunctionTransformer
D. GridSearchCV

5 In -Fold Cross-Validation, if , what percentage of the data is used for training in each iteration?

A. 20%
B. 80%
C. 100%
D. 50%

6 Which Cross-Validation strategy is recommended for classification problems where the target classes are imbalanced?

A. Leave-One-Out
B. TimeSeriesSplit
C. Stratified K-Fold
D. K-Fold

7 What is a significant drawback of Leave-One-Out Cross-Validation (LOOCV) on large datasets?

A. It has high bias
B. It cannot handle categorical data
C. It is computationally expensive
D. It reduces the variance of the estimator significantly

8 When debugging an algorithm, a Learning Curve plots the model performance (score) against:

A. The number of features
B. The number of training samples
C. The values of a specific hyperparameter
D. The time taken to train

9 If a Learning Curve shows a high training score but a low validation score with a large gap between them, the model is suffering from:

A. Convergence failure
B. High Bias (Underfitting)
C. Data leakage
D. High Variance (Overfitting)

10 If both the training score and validation score converge to a low value (high error) on a Learning Curve, what is the diagnosis?

A. High Bias (Underfitting)
B. High Variance (Overfitting)
C. Need for regularization
D. Optimal performance

11 A Validation Curve is used to evaluate the effect of:

A. Training set size
B. Different random seeds
C. Feature scaling
D. A single hyperparameter

12 In the context of the Bias-Variance tradeoff, increasing the complexity of a model usually leads to:

A. Lower Bias and Higher Variance
B. Higher Bias and Lower Variance
C. Lower Bias and Lower Variance
D. Higher Bias and Higher Variance

13 Which of the following actions is most likely to fix a model suffering from High Variance?

A. Getting more training data
B. Adding more polynomial features
C. Decreasing the regularization parameter
D. Reducing the size of the training set

14 Which of the following actions is most likely to fix a model suffering from High Bias?

A. Increasing the regularization parameter
B. Removing features
C. Adding polynomial features or increasing model complexity
D. Using a simpler algorithm

15 What is Model Serialization?

A. Converting categorical features into serial integers
B. Training a model in a serial sequence rather than parallel
C. Assigning a unique serial number to a model version
D. Converting a trained model into a format that can be stored or transmitted

16 Which Python library is commonly used for serializing Scikit-Learn models, particularly efficient for NumPy arrays?

A. json
B. csv
C. joblib
D. pandas

17 What is the inverse process of serialization called, where a saved model is loaded back into memory?

A. Deserialization
B. Unzipping
C. Decoding
D. Parsing

18 What is a major security risk associated with deserializing data using pickle or joblib?

A. Arbitrary code execution if the file is malicious
B. The file size becomes too large
C. The model accuracy decreases
D. It converts float64 to float32

19 Which format is specifically designed as an open standard for representing machine learning models to allow interoperability between different frameworks (e.g., PyTorch to ONNX Runtime)?

A. HDF5
B. Pickle
C. CSV
D. ONNX (Open Neural Network Exchange)

20 What does Model Deployment generally refer to?

A. Integrating a machine learning model into an existing production environment to make practical business decisions
B. The process of cleaning data
C. Hyperparameter tuning using GridSearch
D. Writing the documentation for the model

21 In a Web Service deployment (e.g., using Flask or FastAPI), how does a client typically request a prediction?

A. By connecting via SSH to the server console
B. By emailing the dataset to the server
C. By downloading the model file and running it locally
D. By sending an HTTP request (usually POST) with data in JSON format

22 What is Containerization (e.g., using Docker) useful for in model deployment?

A. It converts Python code to C++
B. It packages the model with all its dependencies (libraries, OS settings) to ensure consistency across environments
C. It increases the model's accuracy automatically
D. It compresses the model to a smaller file size

23 What characterizes Serverless deployment (e.g., AWS Lambda, Azure Functions)?

A. The model runs without any hardware physically existing anywhere
B. The developer manages the physical servers and operating system updates
C. The cloud provider dynamically manages the allocation of machine resources, and you pay only for the compute time used
D. It requires a dedicated server running 24/7

24 Which of the following is a disadvantage of Local Deployment (running the model on the user's device, e.g., mobile app)?

A. Dependence on internet connectivity
B. High latency due to network transfer
C. Data privacy concerns
D. Limited computational resources (battery, CPU/RAM) on the device

25 In the context of deployment, what is Concept Drift?

A. The loss of floating-point precision during serialization
B. Moving the model from one cloud provider to another
C. The model code changing over time due to git commits
D. The statistical properties of the target variable change over time, making the model less accurate

26 What is Batch Prediction (Offline Inference)?

A. Generating a prediction immediately when a user clicks a button
B. Training the model in batches
C. Grouping multiple models together
D. Generating predictions for a large set of observations at once, often on a schedule

27 Which HTTP method is most appropriate for a REST API endpoint that accepts input features and returns a model prediction?

A. HEAD
B. POST
C. DELETE
D. GET

28 Why is Pipeline serialization preferred over serializing just the model estimator?

A. It ensures that raw data fed into the loaded object undergoes the exact same preprocessing steps as training data
B. Pipelines cannot be serialized
C. It is faster to load
D. It makes the file smaller

29 In Scikit-Learn, how do you perform a Grid Search over parameters inside a Pipeline?

A. Modify the source code of the library
B. You cannot perform Grid Search on a Pipeline
C. Pass the parameters directly to the estimator
D. Use the syntax step_name__parameter_name in the param_grid

30 What is Nested Cross-Validation used for?

A. To reduce the training time
B. To use multiple models simultaneously
C. To visualize the data in 3D
D. To tune hyperparameters without biasing the model evaluation

31 Which cross-validation method is appropriate for time-series data?

A. TimeSeriesSplit (Rolling basis)
B. Random K-Fold
C. ShuffleSplit
D. Leave-One-Out

32 In a validation curve, if the training score is 0.99 and the validation score is 0.60, what should you do regarding the hyperparameter being tested?

A. Adjust the parameter to decrease model complexity (increase regularization)
B. Stop collecting data
C. Keep the parameter as is
D. Adjust the parameter to increase model complexity

33 What is the primary benefit of Microservices architecture for ML deployment?

A. It puts all code into one giant script
B. It removes the need for APIs
C. It eliminates the need for data preprocessing
D. It allows the ML model to be developed, deployed, and scaled independently of the main application

34 Which file extension is commonly associated with a Python pickled model?

A. .html
B. .pkl
C. .css
D. .txt

35 A Canary Deployment strategy involves:

A. Replacing the old model instantly for all users
B. Running the model only on weekends
C. Deploying the model to a coal mine
D. Releasing the model to a small percentage of users first to monitor performance before full rollout

36 In Scikit-Learn, Pipeline(steps=[('scaler', StandardScaler()), ('svc', SVC())]). What object does steps expect?

A. A dictionary of parameters
B. A JSON string
C. A pandas DataFrame
D. A list of (name, transform) tuples

37 Which metric on a learning curve would indicate that obtaining more data is NOT worth the cost?

A. The validation score is fluctuating wildly
B. The gap between training and validation score is widening
C. The validation score has plateaued and converged with the training score
D. The training score is increasing rapidly

38 What is the purpose of make_pipeline in Scikit-Learn compared to the Pipeline class constructor?

A. It only supports regression models
B. It does not support cross-validation
C. It creates a pipeline that runs faster
D. It automatically names the steps based on the class names of the estimators

39 When deploying a model via a REST API, what is Latency?

A. The number of requests the server can handle per second
B. The time taken from sending the request to receiving the prediction
C. The cost of the server
D. The accuracy of the model

40 What is PMML (Predictive Model Markup Language)?

A. A python library for plotting
B. A cloud service provider
C. An XML-based standard for representing predictive models
D. A type of neural network

41 In Repeated K-Fold Cross-Validation:

A. The same K-Fold split is repeated exactly
B. K-Fold CV is run times with different randomization splits
C. The model is trained repeatedly on the same fold
D. Data is duplicated times before splitting

42 What is the formula for Total Error in the context of Bias-Variance decomposition?

A.
B.
C.
D.

43 Which Scikit-Learn utility helps ensure that the training and testing sets have the same distribution of classes?

A. StandardScaler()
B. train_test_split(..., shuffle=False)
C. Pipeline()
D. train_test_split(..., stratify=y)

44 Why might a FunctionTransformer be included in a Pipeline?

A. To execute a custom Python function (like log transformation) as a step
B. To plot the data
C. To debug the pipeline
D. To transform the pipeline into a function

45 When serializing a model that relies on external code files (custom classes), what common issue arises?

A. The file size doubles
B. The pickle file may fail to load if the custom class definition is not available in the loading environment
C. The pickle file works everywhere automatically
D. The model becomes a regression model

46 Which of the following is an example of Online Learning deployment?

A. The model updates its weights incrementally as new data streams in
B. Using a static HTML page
C. Training a model once a year
D. Uploading the model to the internet

47 What is the purpose of the random_state parameter in Cross-Validation splitters?

A. To randomise the hyperparameters
B. To delete random data
C. To ensure reproducibility of the splits
D. To improve accuracy

48 In a pipeline, what happens if you call predict()?

A. It calls transform() on all transformers and predict() on the final estimator
B. It calls predict() on all steps
C. It returns an error
D. It calls fit() on all steps

49 Which tool is commonly used to create an isolated environment for Python dependencies to avoid version conflicts during development and deployment?

A. Notepad
B. Pipenv / Virtualenv / Conda
C. Chrome
D. Excel

50 What is the typical use of A/B Testing in model deployment?

A. Comparing two different models (Model A and Model B) on live traffic to see which performs better
B. Debugging syntax errors
C. Testing the model in Alpha and Beta stages
D. Checking if the model works on inputs A and B