Two systems with identical parameter counts can behave dramatically differently depending on how they are built.