Sometimes AWS spins up bad instances. Usually sheriffs notifies ciduty about these but if you see one escalate to ciduty in #ci.
Bad Instances
When AWS spins up a bad instances (usually identified by the fact that it fails every job), find it in the worker explorer of AWS Provisioner and quarantine it. Its inactivity will cause the worker to be terminated and AWS will spin up a new one.