Fit a line and explain its errors.

This is the same reference used in Technical mode. Expand it whenever you need the exact numbers, assumptions or further explanation.

Start with a prediction in centimetres

We observe sepal and petal lengths in the licensed Iris dataset. Suppose you know only a flower’s sepal length and want to estimate its petal length. A regression model predicts a number. It differs from predicting a species category, even though the same source can support both learning exercises.

The training-mean baseline always predicts the average training petal length. A line lets the prediction change with the input. Move the line in the lab, select a validation flower and follow the vertical segment from prediction to observation.

Two coefficients describe the line

For a small worked example, suppose the intercept is 1 cm and the slope is 0.5 cm of petal length per cm of sepal length. At sepal length 6 cm, the prediction is 1 + 0.5 × 6 = 4 cm.

x is sepal length in cm; ŷ (“y hat”) is predicted petal length in cm. a is the intercept, in cm. b is the slope, in cm of predicted petal length per cm of sepal length. Read the formula as “prediction equals the starting value plus slope times input.” Changing a shifts the line vertically. Changing b changes how quickly its prediction rises or falls as x changes.

An intercept at x = 0 is a mathematical parameter. Zero sepal length lies outside these flower observations, so that intercept does not have a supported biological interpretation. A slope in observational data describes an association, not the causal effect of changing an input. In this dataset the mixture of species can contribute to the relationship.

Show an error before averaging it

If the actual petal length is 5 cm and the prediction is 4 cm, the residual is 1 cm, using actual minus predicted. If actual is 3 cm and predicted is 5 cm, the residual is −2 cm. Squaring gives 1 cm² and 4 cm². Their mean squared error is (1 + 4) / 2 = 2.5 cm².

i identifies a row; yᵢ is its observed value; ŷᵢ is its prediction; rᵢ is its residual; and n is the number of evaluated rows. The sum symbol means add one squared residual for each row. MSE is undefined for an empty sample, not zero. Squaring prevents opposite signs from cancelling and makes larger errors contribute disproportionately.

Mean absolute error, MAE, averages absolute residuals instead. The same two residuals give (1 + 2) / 2 = 1.5 cm. MAE retains the original output unit; MSE has squared units. A numerical value of 1 in these two metrics does not mean the same thing. An acceptable error should be connected to the task and measurement precision.

Fit using training data only

Least squares chooses the slope and intercept that minimize training MSE. You can search manually, but a one-input line with an intercept also has a direct solution. First find the training mean x and mean y. Subtract those means from each training pair to describe deviations from the center.

The lab uses one representative per identical four-measurement group and fits on training groups only. Its deterministic stratified group assignment and small historical sample limit what can be claimed. These groups are a deduplication convention, not known specimen identities. The source measurements are unaltered in this regression view; the artificial missingness and mixed units belong to a different teaching lab.

Compare against a deliberately broken relationship

The label-shuffled control preserves the training inputs and the collection of training target values while rearranging which target belongs to which input. It fits a new line to that broken pairing. Validation labels remain original, so every candidate is judged against the same task. The displayed training metrics also use original targets for a common comparison; they are not the shuffled optimizer’s fitting objective.

Five reproducible permutations let you see that controls themselves vary. A single control outcome is not a statistical significance test. Do not select whichever shuffle makes your preferred conclusion look strongest. Report the setup and seek appropriate independent evidence.

Interpret the result within its scope

Compare the fitted line with the mean baseline, inspect one residual, and explain the units of both error measures. Then ask what the current evidence leaves out: other collections, different measurement practices, species proportions, outliers and possible nonlinear relationships.

The plot keeps fixed axes. A manual line can predict outside the visible range; its full prediction still appears in the arithmetic. A negative prediction is mathematically possible for a line but is not a physically meaningful petal length. Choosing a model or transformation to respect such constraints is part of model design.

This is repeated development evidence on a small licensed dataset, not final deployment validation. The downloadable comparison is practice. Independent implementation and decision quality require runnable evidence and human review; learner pilots remain pending.