Unit 2: Exploring Large Language Models (LLMs) - Practice Quiz

CSG202 — Generative Ai Fundamentals 60 Questions
0 Correct 0 Wrong 60 Left
0/60

1 What is a Large Language Model (LLM)?

Define Large Language Models (LLMs) Easy
A. A hardware device that speeds up internet connections
B. A type of AI model trained on vast amounts of text data to understand and generate human language
C. A database used only for storing text documents
D. A spreadsheet tool for organizing language rules

2 The word "Large" in Large Language Model mainly refers to which characteristic?

Define Large Language Models (LLMs) Easy
A. The physical size of the computer screen
B. The number of programming languages supported
C. The huge number of parameters and training data used
D. The length of a single input sentence

3 Which architecture is most commonly used as the foundation for modern LLMs?

Define Large Language Models (LLMs) Easy
A. Transformer architecture
B. Decision tree architecture
C. Spreadsheet architecture
D. Linear regression architecture

4 What is a token in the context of LLMs?

Define Large Language Models (LLMs) Easy
A. A small unit of text such as a word or part of a word
B. A payment made to use the model
C. A password used to log into the model
D. A physical chip inside the computer

5 What does an LLM primarily learn to predict during training?

Define Large Language Models (LLMs) Easy
A. The temperature of a room
B. The next token in a sequence of text
C. The price of a stock
D. The color of an image

6 Which of the following is an example of a Large Language Model?

Define Large Language Models (LLMs) Easy
A. GPT
B. MySQL
C. Photoshop
D. Excel

7 Which of the following is a common use case for LLMs?

Describe LLM Use Cases Easy
A. Cooling computer hardware
B. Painting physical walls
C. Text summarization
D. Measuring network speed

8 An LLM that answers customer questions automatically is being used as a:

Describe LLM Use Cases Easy
A. Video editor
B. Web browser
C. File compressor
D. Chatbot

9 Which task involves an LLM converting text from one language to another?

Describe LLM Use Cases Easy
A. Machine translation
B. Data encryption
C. Disk formatting
D. Image recognition

10 Generating computer code from a natural language description is known as:

Describe LLM Use Cases Easy
A. Screen recording
B. Battery charging
C. Code generation
D. File deletion

11 Analyzing whether a product review is positive or negative is an example of:

Describe LLM Use Cases Easy
A. Network routing
B. Memory allocation
C. Sound editing
D. Sentiment analysis

12 Which of the following is NOT a typical use case for an LLM?

Describe LLM Use Cases Easy
A. Physically repairing a broken keyboard
B. Writing an email draft
C. Summarizing an article
D. Answering a factual question

13 What is the main goal of prompt tuning?

Explain Prompt Tuning Easy
A. To improve model outputs by optimizing the prompt given to the model
B. To physically upgrade the computer's memory
C. To reduce the size of the model's hard drive
D. To change the color of the user interface

14 In LLMs, a prompt refers to:

Explain Prompt Tuning Easy
A. The electricity supplied to the server
B. The internal weights of the model
C. The programming language of the model
D. The input text or instruction given to the model

15 How does prompt tuning differ from full model fine-tuning?

Explain Prompt Tuning Easy
A. It adjusts the prompt without changing all the model's weights
B. It rewrites the entire model from scratch
C. It deletes the model's training data
D. It requires more computing power than fine-tuning

16 Giving an LLM a few examples inside the prompt to guide its answer is called:

Explain Prompt Tuning Easy
A. Hard reset
B. Few-shot prompting
C. Zero-training mode
D. Data mining

17 A key benefit of prompt tuning is that it:

Explain Prompt Tuning Easy
A. Adapts a model to a task with relatively little computation
B. Removes the need for any input text
C. Doubles the internet connection speed
D. Permanently deletes unwanted knowledge from the model

18 Which Google platform provides tools for building and deploying generative AI applications on Google Cloud?

Describe Google's Gen AI Development tools Easy
A. Google Sheets
B. Google Maps
C. Google Calendar
D. Vertex AI

19 What is the name of Google's family of large language models?

Describe Google's Gen AI Development tools Easy
A. Claude
B. Gemini
C. Llama
D. Falcon

20 Which Google tool lets developers quickly prototype prompts and test Gemini models?

Describe Google's Gen AI Development tools Easy
A. Google AI Studio
B. Google Docs
C. Google Drive
D. Google Photos

21 A team notices that their LLM can perform a translation task it was never explicitly trained on, simply by being shown a few examples in the prompt. Which characteristic of LLMs does this demonstrate?

Define Large Language Models (LLMs) Medium
A. Batch normalization
B. Data augmentation
C. In-context learning
D. Gradient descent

22 Why are modern LLMs described as "foundation models" rather than task-specific models?

Define Large Language Models (LLMs) Medium
A. They only work on a single fixed task after training
B. They are pretrained broadly and can be adapted to many downstream tasks
C. They cannot be fine-tuned once deployed
D. They require labeled data for every prediction

23 Which architecture is the primary foundation of most contemporary LLMs, enabling them to weigh the relevance of different words in a sequence?

Define Large Language Models (LLMs) Medium
A. The Transformer with self-attention
B. The support vector machine (SVM)
C. The convolutional neural network (CNN)
D. The recurrent neural network (RNN)

24 An LLM is asked to complete the sentence "The capital of France is ___". Fundamentally, what is the model doing to produce the answer?

Define Large Language Models (LLMs) Medium
A. Running a search engine query in real time
B. Predicting the most probable next token given the context
C. Querying a live database of world facts
D. Executing a lookup in a hardcoded fact table

25 The term "large" in Large Language Models most directly refers to which two factors?

Define Large Language Models (LLMs) Medium
A. The number of users and the number of servers
B. The screen resolution and memory of the device
C. The length of the output and the font size
D. The number of parameters and the size of the training data

26 Which phenomenon describes an LLM producing fluent but factually incorrect or fabricated information?

Define Large Language Models (LLMs) Medium
A. Hallucination
B. Tokenization
C. Vanishing gradient
D. Overfitting

27 A company wants to automatically condense long legal documents into short overviews for busy executives. Which LLM use case fits this need?

Describe LLM Use Cases Medium
A. Speech synthesis
B. Named entity masking
C. Image classification
D. Text summarization

28 An online retailer wants to route customer emails automatically as "complaint", "inquiry", or "feedback". Which LLM use case is most appropriate?

Describe LLM Use Cases Medium
A. Text generation
B. Code completion
C. Language translation
D. Text classification

29 A developer uses an LLM-powered tool that suggests function implementations as they type. Which use case does this represent?

Describe LLM Use Cases Medium
A. Optical character recognition
B. Data anonymization
C. Sentiment analysis
D. Code generation and completion

30 A support team wants an LLM to answer questions using their internal knowledge base so responses stay accurate and up to date. Which approach best addresses this?

Describe LLM Use Cases Medium
A. Reducing the number of parameters
B. Increasing the temperature setting
C. Disabling the attention mechanism
D. Retrieval-Augmented Generation (RAG)

31 Which scenario is generally the LEAST suitable standalone use case for an LLM without additional tools?

Describe LLM Use Cases Medium
A. Drafting a marketing email
B. Rewriting a paragraph in a formal tone
C. Guaranteeing precise real-time stock prices from memory
D. Generating brainstorming ideas for a project

32 A media firm wants to convert English articles into Spanish and French for global readers. Which LLM use case applies?

Describe LLM Use Cases Medium
A. Text-to-speech
B. Anomaly detection
C. Clustering
D. Machine translation

33 How does prompt tuning primarily differ from full fine-tuning of an LLM?

Explain Prompt Tuning Medium
A. It retrains all model parameters from scratch
B. It only changes the tokenizer vocabulary
C. It permanently deletes unused layers of the model
D. It learns soft prompt vectors while keeping the base model weights frozen

34 A team has a very large model and limited GPU memory. Why might prompt tuning be preferred over full fine-tuning?

Explain Prompt Tuning Medium
A. It updates far fewer parameters, reducing compute and storage needs
B. It converts the model into a smaller architecture
C. It always produces higher accuracy than any other method
D. It removes the need for any training data

35 In prompt tuning, what are "soft prompts"?

Explain Prompt Tuning Medium
A. Human-written natural language instructions
B. Learnable continuous embeddings prepended to the input
C. Fixed keywords chosen by domain experts
D. Randomly deleted tokens in the training set

36 Which statement best contrasts prompt engineering with prompt tuning?

Explain Prompt Tuning Medium
A. They are identical techniques with different names
B. Prompt engineering crafts text manually; prompt tuning learns embeddings through training
C. Prompt engineering updates weights; prompt tuning uses plain text
D. Both require retraining the entire model

37 Prompt tuning is best categorized as which type of technique?

Explain Prompt Tuning Medium
A. Full model retraining
B. Data preprocessing
C. Parameter-efficient fine-tuning (PEFT)
D. Model quantization

38 A developer wants a unified Google Cloud platform to build, tune, and deploy generative AI models with access to foundation models. Which tool should they use?

Describe Google's Gen AI Development tools Medium
A. Firebase Hosting
B. Google Analytics
C. Google Sheets
D. Vertex AI

39 Within Vertex AI, which environment lets developers quickly test prompts and compare model responses before writing production code?

Describe Google's Gen AI Development tools Medium
A. BigQuery console
B. Compute Engine VM
C. Generative AI Studio
D. Cloud Storage bucket

40 A team wants to integrate Google's Gemini models into their app using a simple developer API and lightweight SDK. Which offering is designed for this?

Describe Google's Gen AI Development tools Medium
A. Google Ads API
B. Google AI Studio / Gemini API
C. Google Maps SDK
D. Google Drive API

41 A researcher observes that a decoder-only transformer LLM shows improved sample efficiency and emergent few-shot capabilities only after crossing a certain parameter count. Which principle best explains why simply increasing depth without scaling data and compute proportionally often fails to produce these gains?

Define Large Language Models (LLMs) Hard
A. Attention heads saturate at a fixed count, making additional parameters inert
B. The Chinchilla scaling laws indicate that compute-optimal models require data and parameters to scale together, so under-training a large model wastes capacity
C. Emergent abilities are purely a function of vocabulary size, independent of data or compute
D. Deeper networks always overfit regardless of data volume, so gains are impossible past a fixed depth

42 In an autoregressive LLM, the training objective maximizes . Which consequence of this factorization most directly explains why such models can suffer from exposure bias at inference?

Define Large Language Models (LLMs) Hard
A. Maximizing the product guarantees the global optimum is reached, removing all inference error
B. During training the model always conditions on ground-truth prior tokens, but at inference it conditions on its own (possibly erroneous) predictions
C. The factorization forces bidirectional attention, which conflicts with generation
D. The objective ignores earlier tokens entirely, so context is never used

43 Two LLMs have identical architectures and parameter counts, but Model A uses a byte-pair encoding (BPE) tokenizer with a 32k vocabulary while Model B uses a 256k vocabulary. Which trade-off is most accurately attributed to Model B?

Define Large Language Models (LLMs) Hard
A. Longer sequences per document and a smaller embedding matrix, reducing memory usage
B. Identical sequence lengths but slower attention due to vocabulary size
C. Shorter sequences per document and a larger embedding/softmax matrix, increasing memory but potentially improving context efficiency
D. No difference in sequence length, only in training loss magnitude

44 An LLM's self-attention has time complexity for sequence length and hidden dimension . A team wants to process documents 4× longer without a 16× compute blowup. Which approach fundamentally changes the complexity class rather than just optimizing constants?

Define Large Language Models (LLMs) Hard
A. Freezing the lower transformer layers during fine-tuning
B. Using mixed-precision (FP16) matrix multiplication for attention scores
C. Sparse or linear attention that reduces complexity toward or
D. Increasing the batch size to amortize the cost

45 Why do LLMs using absolute learned positional embeddings often generalize poorly to sequences longer than those seen during training, whereas rotary (RoPE) or relative embeddings handle length extrapolation better?

Define Large Language Models (LLMs) Hard
A. Learned absolute positions have no defined values beyond the trained range, while relative/rotary schemes encode positional relationships that extend continuously
B. Relative embeddings require fewer parameters, which automatically improves extrapolation
C. Rotary embeddings remove positional information entirely, avoiding the problem
D. Absolute embeddings are added after attention, so they cannot influence long sequences

46 An enterprise deploys an LLM for retrieval-augmented generation (RAG) over proprietary documents. Users report the model still fabricates facts even with correct passages retrieved. Which root cause is the most likely and directly addressable within the RAG pipeline?

Describe LLM Use Cases Hard
A. The prompt does not sufficiently constrain the model to ground answers in retrieved context, allowing parametric knowledge to override it
B. RAG inherently cannot reduce hallucination under any configuration
C. The embedding model is irrelevant to hallucination since generation is separate
D. The vector database returns passages, so grounding is guaranteed automatically

47 A company must choose between fine-tuning an LLM on 500 labeled examples versus using few-shot in-context learning for a specialized classification task. Which consideration most strongly favors fine-tuning in this scenario?

Describe LLM Use Cases Hard
A. The task must run at high volume with low per-request latency and token cost, and the domain style is consistent
B. There is no budget or infrastructure for training, only API access
C. The task requirements change hourly and examples are scarce
D. The labels are ambiguous and change frequently across requests

48 For a code-generation assistant, engineers notice that increasing the sampling temperature from to raises the diversity of solutions but lowers pass rates on unit tests. Which use-case-driven configuration best balances correctness with exploring alternatives?

Describe LLM Use Cases Hard
A. Always use temperature and generate a single deterministic output
B. Sample multiple candidates at moderate temperature and re-rank by test execution (best-of-)
C. Maximize temperature to guarantee at least one correct solution
D. Disable sampling entirely and rely on beam search with width 1

49 A summarization pipeline processes documents far longer than the model's context window. Which strategy preserves global coherence better than naive independent chunk summarization?

Describe LLM Use Cases Hard
A. Hierarchical (map-reduce) summarization that summarizes chunks then summarizes the summaries
B. Randomly sampling sentences until they fit the context window
C. Summarizing only the first chunk as a representative sample
D. Truncating the document to fit the window and discarding the rest

50 An LLM-powered agent chains tool calls (search, calculator, database). Reliability drops sharply as the number of sequential steps grows. If each step succeeds independently with probability , what is the approximate end-to-end success probability over 5 steps, and what does this imply?

Describe LLM Use Cases Hard
A. About , implying step count has negligible effect on reliability
B. About , implying chaining improves reliability multiplicatively
C. About , implying agents can never exceed 50% reliability
D. About , implying step-level reliability must be very high or errors must be caught and retried per step

51 In soft prompt tuning, a set of continuous embedding vectors is prepended to the input and optimized while the base model weights stay frozen. Which statement most accurately distinguishes this from discrete prompt engineering?

Explain Prompt Tuning Hard
A. Soft prompts are natural-language templates chosen by trial and error
B. Soft prompts are learned vectors in embedding space that need not correspond to any real tokens, optimized via gradient descent
C. Soft prompts modify all transformer weights during training
D. Soft prompts are fixed one-hot token vectors selected from the vocabulary

52 Research shows prompt tuning becomes competitive with full fine-tuning primarily as model scale increases. Which explanation best accounts for this scale-dependent effectiveness?

Explain Prompt Tuning Hard
A. Larger models have richer, more general representations that a small set of tunable prompt vectors can steer effectively
B. Prompt tuning only works when the model is small enough to memorize prompts
C. Larger models have fewer parameters to update, making prompt tuning trivial
D. Scale reduces the embedding dimension, shrinking the prompt search space

53 A team compares prompt tuning, prefix tuning, and LoRA for adapting one base model to many tasks. Which property is shared by all three as parameter-efficient fine-tuning (PEFT) methods?

Explain Prompt Tuning Hard
A. They fully retrain the base model weights for each task
B. They keep the large base model weights frozen and train only a small set of additional parameters per task
C. They require discarding the base model after adaptation
D. They can only be applied to encoder-only architectures

54 If a soft prompt of length tokens is prepended to an input of length , how does this affect the self-attention cost during a forward pass, and why is it still efficient overall?

Explain Prompt Tuning Hard
A. Attention cost is unchanged because prompts are outside the attention mechanism
B. Attention scales with , but since typically and no weights update, the added cost and storage are small
C. The forward pass doubles in cost regardless of
D. Attention drops to because soft prompts replace positional encoding

55 A practitioner finds their prompt-tuned model performs well in-distribution but degrades sharply on inputs stylistically different from training data. Which limitation of prompt tuning best explains this brittleness?

Explain Prompt Tuning Hard
A. Soft prompts increase the model's parameter count so much that it overfits everything
B. Prompt tuning overwrites the base model weights, destroying general knowledge
C. Soft prompts steer a frozen model narrowly toward the training distribution and cannot alter the model's underlying knowledge or robustness
D. Prompt tuning disables the attention mechanism for unseen inputs

56 A developer needs to build, tune, and deploy generative models with managed infrastructure, MLOps, and access to foundation models like Gemini. Which Google offering is the most appropriate end-to-end platform?

Describe Google's Gen AI Development tools Hard
A. Colab free tier as the primary production deployment target
B. Vertex AI, which provides Model Garden, tuning, pipelines, and deployment for foundation and custom models
C. Google Sheets with an add-on for text generation
D. TensorBoard used in isolation for visualization only

57 A team wants to rapidly prototype and iterate on prompts for Gemini, test parameters like temperature, and then export code to integrate into an application. Which Google tool is designed for this prompt-iteration workflow?

Describe Google's Gen AI Development tools Hard
A. Google Slides for presenting model results
B. Cloud Storage buckets for holding model checkpoints only
C. BigQuery, primarily for SQL analytics on large datasets
D. Google AI Studio, a browser-based environment for prompt design, tuning parameters, and exporting integration code

58 An enterprise on Vertex AI wants to ground Gemini responses in its own frequently-updated document corpus without retraining the model each time. Which capability most directly supports this requirement?

Describe Google's Gen AI Development tools Hard
A. Full model retraining scheduled nightly on the corpus
B. Disabling safety filters to allow more document access
C. Grounding with retrieval (e.g., Vertex AI Search / RAG) that injects relevant retrieved context at inference time
D. Increasing the model temperature to encourage factual recall

59 When adapting a Gemini model on Vertex AI with limited labeled data and constrained budget, which tuning approach aligns with parameter-efficient adaptation rather than full fine-tuning?

Describe Google's Gen AI Development tools Hard
A. Manually editing the model's internal weights in a text editor
B. Pretraining a new foundation model from scratch on the labeled data
C. Supervised tuning using parameter-efficient techniques (e.g., adapter/LoRA-style) that update few parameters on the managed platform
D. Uploading data to a spreadsheet and averaging the labels

60 A regulated organization must call Gemini from production code with governance controls: IAM permissions, VPC service controls, audit logging, and data residency. Which access path best satisfies these enterprise requirements?

Describe Google's Gen AI Development tools Hard
A. The Vertex AI Gemini API within Google Cloud, which integrates IAM, VPC-SC, audit logs, and regional controls
B. The consumer Gemini app used manually by employees
C. A personal API key shared informally across the team
D. Copy-pasting outputs from a public chatbot into production