Skip to content

Definition of Shipped

Canvas is the source of truth for this term’s assignments. This page may already show changes Canvas does not have yet.

TeamWinter3% of the winter grade

  • Definition of ShippedSunday of week 3Rubric

A v0 draft is part of Repo Checkpoint 2, in fall week 10.

Up to 48 hours late loses one rubric band on each criterion. After that it scores zero, unless you contacted the instructors before the deadline with a documented reason.

Your spring grade’s largest partner-evaluation facet (Verification and Validation, 40 of the End-of-Term Survey’s 100 points) is scored against outcomes: is the thing in production, merged upstream, reproducible, in real use? This document keeps those bars from being a surprise: a short, explicit agreement with your project partner about what “shipped” means for this project, written while there’s still time to act on it.

Your target level depends on lead times your team doesn’t control: maintainer review latency, app store review, data access, partner IT security review, and real-user recruitment. Each one runs in weeks, and this document gives each one an owner and a start-by date.

The document, one to two pages, is your agreement with your partner, kept with your team’s documents, not as a file in the repository. What the code needs from it goes where your AI tools and a successor will find it: the success metrics and how each is measured in docs/requirements.md or the AI context file, a decision it forces in an ADR, and the instrumentation in the code.

  1. The expectations you agreed: what shipped means for this project, in your own words, and which level of the outcome ladder you are committing to.

    You and your project partner or mentor agree this together, and this document is where you record it. Nobody assigns it to you. A committed level reads like one of these:

    • “The partner’s staff use it in their regular work, running in the partner’s environment.”
    • “Our contributions are merged into the open-source project. Whether a release includes them is the maintainers’ call, so we don’t commit to it.”
    • “A graduate student in the partner’s lab who didn’t build it reproduces our result from the published artifact, without our help.”
    • “People outside the team use it on their own, not as a favor to us, and we can show how many and how often.”
    • A lower level for a stated reason: “Our target level is the partner watching it run on their real inputs. It can’t reach anyone else until an approval outside the project lands, so the partner scores it on the custom scale recorded here.”

    If none of them describes yours, write your own expectations here instead. That costs you nothing, because the rubrics read what you committed to, not which example you resemble.

  2. Success metrics: 2 or 3 measurable signals of “it worked” (users completing a task, benchmark result, uptime, merged PRs), and, for at least one, the tool or mechanism that will collect it and when it starts collecting, before the final release.

  3. Prerequisites and lead times: everything the target level requires that your team does not control (accounts, reviews, approvals, recruitment), each with an owner and a start-by date before the term it is needed; track each one in docs/risks.md until it lands. The Shipping guide sections your target level depends on show the kinds of prerequisites to look for; list the ones your target level needs, whether or not the guide names them.

  4. User access plan: who the real users or evaluators are and how you will reach them by the winter real-user sessions.

  5. Partner agreement: evidence the partner has seen and agreed to this definition (meeting note, email, or survey confirmation).

  6. If other teams work on this project: what your team owns, agreed with your project partner rather than assumed. Which interface, repository, or milestone is yours, and how the teams talk to each other. Skip this item if your team is the only one on the project. It is scored under the target level, because a level you cannot reach without another team delivering its half is not a level you have committed to.

Start from the Definition of Shipped template.

AI use: AI may draft the document from your Lean Canvas, your requirements, and the Shipping guide’s lead-time tables. It must not invent the partner agreement, a named user, or a lead time nobody checked. A fabricated partner confirmation or a made-up start-by date fails the assignment, because this document is a commitment other people will hold you to.

The Definition of Shipped as one PDF, with the cover Submitting Your Work describes.

Rubric: 100 points across 5 criteria
CriterionRatings
Target level: named, specific to this project25 pointsOutcomes: SO2
  • Exceeds Expectations (25)Names the target level on the outcome ladder in the team's own words and says what it means for this project; where other teams work on the project, states the split of work agreed with the partner.
  • Meets Expectations (20)A target level is named, but only in the ladder's words with nothing about this project, more than one level is named or the level is conditional, or, where other teams work on the project, the split is missing or not agreed with the partner.
  • Does Not Meet Expectations (5)No explicit target level, or the stated target does not correspond to the ladder.
Metrics: measurable, with an instrumentation plan25 pointsOutcomes: SO2
  • Exceeds Expectations (25)2 or 3 measurable signals of "it worked" (e.g., users completing a task, benchmark result, uptime, merged PRs), and for at least one, the tool or mechanism that will collect it and when it starts collecting, before the final release.
  • Meets Expectations (20)At least one metric is measurable as stated, but there are fewer than 2 or more than 3, some are not measurable as stated, or no metric says what will collect it and when.
  • Does Not Meet Expectations (5)No success metrics, or none measurable as stated.
Prerequisites and lead times: listed, owned, dated25 pointsOutcomes: SO1
  • Exceeds Expectations (25)Prerequisites are listed, each with an owner and a start-by date before the term it is needed, and none that the team's own Definition of Shipped or docs/risks.md names elsewhere is missing from the list.
  • Meets Expectations (20)Prerequisites are listed and none that the team's own Definition of Shipped or docs/risks.md names elsewhere is missing, but an item has no owner, no start-by date, or a start-by date in or after the term it is needed.
  • Does Not Meet Expectations (5)No prerequisites listed, or a prerequisite the team's own Definition of Shipped or docs/risks.md names elsewhere is missing from the list.
Partner agreement evidenced15 pointsOutcomes: SO3
  • Exceeds Expectations (15)Evidence that the partner has seen and agreed to this definition (meeting note, email, or survey confirmation) is included and verifiable.
  • Meets Expectations (12)Partner agreement is claimed but the evidence is indirect or informal.
  • Does Not Meet Expectations (3)No evidence of partner agreement.
Writing: length, listed commitments10 pointsOutcomes: SO3
  • Exceeds Expectations (10)1 to 2 pages; every metric, prerequisite, and commitment to the partner is its own list item or table row.
  • Meets Expectations (8)One of the two missing: outside 1 to 2 pages, or a metric, prerequisite, or commitment written into a paragraph.
  • Does Not Meet Expectations (2)Both missing.

Identify Success Metrics for the metrics and instrumentation criterion, and Dependency Mapping or Critical Path Analysis for prerequisites and lead times. User Story Mapping from fall feeds the target level.

Examples. A project may match several rows or none. If none fits, ask your partner or mentor which activities do.

If Activities
you contribute to an open-source project, so its maintainers decide what merges Analyze an Existing Codebase to find out what those maintainers actually require before a merge
your top level needs people outside the team to use it on their own Hypothesis Testing and Find Users, since those people take weeks to recruit and the channel must exist by winter
your top level is something the partner does (integrate it, run it) Map Your External Approvals and Stakeholder Mapping: those levels describe actions the partner takes, so the prerequisites are mostly theirs
your project uses another institution’s data Map Your External Approvals for prerequisites and lead times

Browse Planning and Risk and Requirements when these run out.