Startup AI teams live on ship-it because the underlying models change weekly. The failure mode is shipping an agent with write access and no evals. Used well it means shipping behind a flag with a rollback; used badly it means users are the test set.