Test
Sin título
Crea una cuenta gratis para terminar este test
Guarda tu progreso y consulta tu resultado final.
¿Ya tienes cuenta? Inicia sesión
Preguntas del test (33)
1In standard SGD with Momentum (SGDM), which statement best describes the update?
- AMomentum changes the gradient computation during backprop by adding a “momentum gradient” term at each layer.
- BBackprop computes gradients normally; momentum accumulates a velocity from past gradients and then updates weights using that velocity.
- CMomentum replaces the local gradient δ at each layer.
- DMomentum performs bias-correction like Adam before applying weight decay.
2Which best matches the meaning of local gradient and weight correction in BP-based training?
- ALocal gradient is the optimizer’s momentum term; weight correction is the raw gradient.
- BLocal gradient refers to per-layer error signals; weight correction refers to parameter updates computed from gradients and optimizer rules.
- CLocal gradient is the loss value; weight correction is the learning rate schedule.
- DLocal gradient exists only in Adam; weight correction exists only in SGDM.
3Which statement best describes the difference between plain SGD and SGD with Momentum (SGDM) during training?
- ASGDM changes backpropagation by modifying the local gradients 𝛿 at each layer, while SGD does not.
- BBoth use the same gradients from backprop; SGDM adds a velocity (momentum) state that accumulates past gradients and uses it to compute the weight update.
- CSGDM updates weights using only the sign of the gradient, while SGD uses the full gradient magnitude.
- DSGDM removes the need for learning rate tuning because momentum fully determines the step size.
4A typical training iteration for a mini-batch is:
- AUpdate weights → forward pass → compute loss → backward pass
- BForward pass → compute loss → backward pass (compute gradients) → optimizer step (update weights)
- CBackward pass → forward pass → compute loss → optimizer step
- DCompute loss → optimizer step → forward pass → backward pass
5For single-label multi-class classification (exactly one correct class per sample), the most standard choice is:
- ASigmoid + Binary Cross-Entropy
- BSoftmax + Categorical Cross-Entropy
- CSoftmax + Mean Squared Error
- DLinear output + Hinge loss only
6For multi-label classification (multiple classes can be true simultaneously), which pairing is most appropriate?
- ASoftmax + Categorical Cross-Entropy
- BSigmoid (per class) + Binary Cross-Entropy (per class)
- CSoftmax + Binary Cross-Entropy
- DSigmoid + Categorical Cross-Entropy
7Many libraries offer "cross-entropy from logits" (i.e., internally applies log-softmax). Which is the best practice for numerical stability?
- AApply softmax in the model, then pass probabilities to a “from logits” loss.
- BDo not apply softmax in the model; pass raw logits to a cross-entropy loss that internally uses log-softmax.
- CAlways apply softmax twice (once in model, once in loss) to improve calibration.
- DReplace softmax with ReLU before the loss.
8Which statement is most correct?
- APadding changes the number of channels; stride changes only the number of filters.
- BIn most deep learning frameworks, “convolution” is implemented as cross-correlation (no kernel flip), but still works for learning.
- CBatchNorm must be placed after the final loss layer to normalize labels.
- DReLU is typically applied before the convolution to “linearize” the input.
9Why do many CNN architectures include max pooling (or downsampling)?
- ATo increase the number of channels while keeping spatial size fixed.
- BTo reduce spatial resolution, increasing receptive field and improving translation robustness, while lowering computation.
- CTo make the network strictly linear so it is easier to optimize.
- DTo ensure gradients are always non-zero.
10Why do CNNs often reduce spatial resolution (downsample) in deeper layers?
- ATo reduce computation/memory and increase the effective receptive field, while improving robustness to small translations.
- BBecause convolution cannot be applied to large feature maps.
- CBecause downsampling guarantees higher accuracy on any task.
- DBecause gradients vanish unless feature maps are small.
11Why do deeper CNN layers often use more channels (more feature maps), especially after downsampling?
- ATo compensate for information loss from reduced spatial resolution by increasing representational capacity, and to produce a compact fixed-length per-sample representation for the classifier head (e.g., global pooling or flatten before an FC layer).
- BTo prevent overfitting mainly by injecting noise through extra channels.
- CBecause more channels automatically reduce the number of parameters.
- DBecause increasing channels removes the need for nonlinear activations.
12CNN Filters and Channels (K_H and K_W for kernel height and width)
In a standard 2D convolution layer with weight tensor shape (C_out, C_in, K_H, K_W), what does C_out control?- ANumber of input channels (depth) consumed by the convolution
- BNumber of output channels (feature maps) produced by the layer
- CSpatial resolution of output (height/width) regardless of stride/padding
- DBatch size
13What is the main goal of pretraining?
- ALearn transferable features for many tasks
- BSolve one downstream task directly well
- CReduce model size for faster inference
- DRemove the need for labeled training
14What best describes fine-tuning?
- AAdapt pretrained weights using downstream labels
- BTrain only the last layer from scratch
- CReplace the backbone with a new one
- DIncrease input size without retraining
15"A better upstream model always transfers better."
- AUsually true, but mismatch can break it
- BAlways true, regardless of domain shift
- CAlways false, because tasks are different
- DTrue only when data size is identical
16When is a frozen-feature linear classifier most useful?
- AFew downstream labels, close to pretrain domain
- BFew downstream labels, far from pretrain domain
- CMany downstream labels, close to pretrain domain
- DMany downstream labels, far from pretrain domain
17Which conditions can cause negative transfer?
- AUpstream and downstream domains differ greatly
- BUpstream cues conflict with downstream cues
- CFull fine-tune uses an oversized learning rate
- DModel width increases by a small amount
18When is domain-adaptive continued pretraining best?
- ADomain differs, but unlabeled data is plenty
- BLabels are abundant, but time is limited
- CHardware is weak, but batch is large
19Discriminative learning rates usually mean:
- ALower LR for early layers than late layers
- BHigher LR for early layers than late layers
- CSame LR for all layers at all times
- DRandom LR chosen anew every epoch
20You have two pretrained models: Object-biased vs Scene-biased.For a scene-classification downstream task, you would pick:
- AThe scene-biased model for stronger context cues
- BThe object-biased model for stronger texture cues
- CEither model; they should match exactly
- DNeither model; start training from scratch
21Downstream has 2k labels and 200k unlabeled same-domain images. Best plan:
- AContinue pretraining on unlabeled, then fine-tune
- BFull fine-tune immediately with a high LR
- CTrain from scratch using only labeled data
- DFreeze backbone and never update features
22Downstream has 3k labels, and you believe domains are very close. Best start:
- ALinear probe first, then gradually unfreeze
- BFull fine-tune first, then try linear probe
- CTrain from scratch first, then do pretrain
- DSkip training and use zero-shot prediction
23If full fine-tuning is unstable (big variance across runs), first try:
- ALower LR, freeze more, and add early stopping
- BRaise LR, unfreeze all, and train longer
- CRemove weight decay and remove augmentation
- DChange label names and keep settings fixed
24Which choices often improve transfer with limited labels?
- AStrong augmentation and conservative learning rates
- BFreezing early layers and tuning later layers
- CEarly stopping and simple hyperparameter sweeps
- DMaximizing LR and eliminating regularization
25Which of the following situations may present an overfitting problem?
- ALimited training samples with a large network without being pre-trained from big datasets
- BLarge training samples with a small network
- CUsing data augmentation on small datasets
- DTraining on pre-trained networks with sufficient data
26Which of the following statements is (absolutely) correct for loss functions?
- AA loss function measures the difference between a model’s predictions and the actual data. The goal is to minimize it to improve performance.
- BA loss function maximizes the difference between predictions and labels to improve performance.
- CA loss function is only used for classification, not regression.
- DA loss function determines the architecture of the network.
27Which of the following strategies may be the best for setting the learning rate in training a deep network?
- ASetting the learning rate relatively high then gradually reducing
- BKeeping the learning rate constant at a very low value
- CIncreasing the learning rate throughout training
- DSetting the learning rate randomly
28For an input image with size 64x64x3, what would be the best appropriate filter size and number of filters?
- AFilter size: 7x7, number of filters: 16
- BFilter size: 3x3, number of filters: 64
- CFilter size: 5x5, number of filters: 128
- DFilter size: 1x1, number of filters: 32
29In a dataset with d dimensions, when using a two-layer network where the first layer has 100 neurons and the second layer has 20 neurons, the shape of the feature extracted from the first layer will be:
- A20
- B100
- C120
- Dd
30An image dataset with input 32x32x3, when using two convolutional layers where the first layer has 16 filters, and the second layer has 20 filters, both with full padding, the shape of the feature extracted from the first layer will be:
- A32x32x3
- B32x32x16
- C16x16x16
- D32x32x20
31T/F: When we have n-samples in training dataset, the network needs at least n iterations to complete one training epoch
- AVerdadero
- BFalso
32T/F: Max-pooling is a regularization technique to avoid overfitting problem
- AVerdadero
- BFalso
33T/F: A CNN cannot handle 1D data unless it uses a very small, 1x1 filter
- AVerdadero
- BFalso
Información
- Descripción
- Student AISE 3010 Test sobre Sin título, creado por Jewella Macabenta el 08/02/2026.
- Autor
- Jewella Macabenta
- Idioma
- English
- Visitas
- 6
- Etiquetas
- Valoración
- Aún sin valoraciones Valora este test