When testing against an external service, it’s common to mock that external service. But what if the contract for the external service changes? Your tests will still pass, but your application will fail.

Martin Fowler advocates an integration contract test which tests your application against the service. These tests are not run as frequently and should not always cause a build failure, but rather should “trigger a task to get things consistent again.”