← Advanced Data Science
TopBottomDownload Notebook

Week 14 · PBL presentation week

PBL2 Presentations and Course Synthesis

What does the final project demonstrate, and where must its claims stop?

Both 100-minute classes are reserved for final project presentations and synthesis. Projects may use convolutional, recurrent, attention, Transformer, or transfer-learning ideas, but the standard is not architectural novelty. Each group must connect its question, data, baseline, model choice, held-out evidence, failures, reproducibility, and limitations into one defensible argument.

Both 100-minute classes are reserved for presentations, questions, peer learning, and reflection. No additional technical chapter is assigned this week.

By the end

  • Present the final project as an evidence-based argument rather than a model demonstration.
  • Explain why the chosen advanced method fits the data structure and intended use.
  • Defend reproducibility, failure analysis, and source-to-target boundaries.
  • Synthesize one durable workflow that transfers beyond the course.

Low floor

Use one shared evidence spine so presenters and listeners know what to look for.

High ceiling

Defend one modeling decision by comparing it with a credible alternative and identifying evidence that could reverse the decision.

Presentation contract

Three commitments

Method–data fit

An advanced architecture should be chosen because its inductive structure matches images, sequences, attention relationships, or transfer needs—not because it is fashionable.

Reproducible evidence

Another informed reader should be able to reconstruct the split, preprocessing, model, settings, metrics, and limitations from the submitted record.

Boundary of the claim

The conclusion stops at the represented population, observed task, held-out evidence, and tested failure conditions.

Two consecutive classes

Use the full presentation week

First class · 100 minutes

  1. Opening evidence reminder and order check.
  2. First half of group presentations.
  3. Questions distributed across group members.
  4. Listeners record one strength, one limitation, and one constructive question per project.

Second class · 100 minutes

  1. Brief restart and unresolved question.
  2. Remaining group presentations.
  3. Cross-project comparison of baselines, splits, metrics, and failures.
  4. Individual reflection and next-step record.

Presenter path

Five parts of a defensible presentation

  1. 1. State the question, data structure, intended use, and non-use.
  2. 2. Explain the baseline and why the selected advanced method is a plausible fit.
  3. 3. Present held-out results, variability or comparison evidence, and representative failures.
  4. 4. Document reproducibility, provenance, and source-to-target limitations.
  5. 5. Close with what the project supports, does not support, and would test next.

Questions that help

Listen for evidence gaps

Architecture as achievement

What goes wrong: The group treats using a Transformer or pretrained model as the main result.

Ask or check: Ask what held-out comparison justifies the added method.

Unreported source–target mismatch

What goes wrong: Pretraining or external data are assumed to transfer automatically.

Ask or check: Document source objective, target population, overlap risks, and target-domain errors.

Overbroad conclusion

What goes wrong: A small course dataset is used to support a population-wide or causal claim.

Ask or check: Rewrite the conclusion to match the actual sample and evaluation design.

Listener record

Learn across projects

For each project

  • What was the question?
  • What was the strongest evidence?
  • What important limitation remained?
  • What one question would improve the claim?

After both classes

  • Which baseline was most informative?
  • Which failure analysis changed your view?
  • Which design choice would you reuse?
  • What will you change in your next project?

Check your understanding

Ten questions with standard answers

Answer in your own words before opening each panel.

1. What should determine the final model choice?

Standard answer: Held-out decision-relevant evidence, stability, resource cost, failure behavior, and fit to the data structure—not novelty alone.

2. Why retain a simple baseline in the final project?

Standard answer: It shows whether the advanced method contributes enough to justify its complexity.

3. What must be disclosed about pretraining or external models?

Standard answer: Source model and objective, data provenance where known, frozen or updated components, target adaptation, and mismatch or contamination risks.

4. What is a meaningful failure slice?

Standard answer: A subset tied to the intended use or known risk, large enough to interpret cautiously, and defined before viewing final test results when possible.

5. What makes a result reproducible?

Standard answer: Recorded data version, split, preprocessing, seed, code, model configuration, training settings, metric definition, and environment.

6. How should a group report unstable runs?

Standard answer: Show variation across seeds or runs, avoid selecting only the best result, and reduce the strength of the claim.

7. What is the difference between prediction and causation?

Standard answer: Prediction estimates an outcome from patterns; it does not establish that changing an input will cause the outcome to change.

8. What should an oral defense reveal?

Standard answer: Whether each member understands the choices, computations, evidence, failures, and boundaries of the complete project.

9. When should the project abstain from a claim?

Standard answer: When data coverage, evaluation validity, uncertainty, or failure evidence is insufficient for the intended decision.

10. What durable workflow should remain after the course?

Standard answer: Define the problem and data boundary, establish a baseline, build the smallest justified model, evaluate held-out behavior, inspect failures, document provenance, and state a bounded conclusion.

Terminology

Glossary

Inductive bias
Structural assumption built into a model.
Architecture fit
Match between model structure and data/task structure.
Transfer learning
Reuse of representations learned on a source task.
Fine-tuning
Updating pretrained parameters on target data.
Reproducibility
Ability to reconstruct results from recorded inputs and settings.
Provenance
Traceable origin of data and models.
Failure slice
Meaningful subset on which behavior is separately inspected.
Robustness
Stability under relevant variation or disturbance.
Generalization
Performance on unseen cases from the intended setting.
Bounded conclusion
Claim explicitly limited by the evidence and design.

Go further

Key references

Next: The semester closes with a reusable discipline: define the data contract, establish a baseline, train visibly, evaluate held-out behavior, inspect failures, and state a bounded conclusion.