Cucumber tests with Data Tables will pass with failing examples as long as the first example passes. This happens because all the examples have the same fully qualified name that comes from the scenario outline description. I have submitted a PR to fix this #83 .