applying-test-conventions

Applying test conventions

Inform the user

• Always tell the user "SKILL: I am applying test conventions" to inform the user that you are running this skill.

Conventions to be followed when testing

Those conventions use examples using Ruby, but are applicable to any programming language and test framework.

Rule: Always write concise scenarios with a 3-steps structure: setup, run and expect

Always respect this structure for a test scenario:

1. Setup test data and mocks. Use defaults to only express test data relevant to the test scenario at hand.
2. Always call only the public interface of the class to be tested. Never call private methods of the interface.
3. Write simple expectations and assertions on results of the public interface of the class to be tested. Never assert results from private methods or internal states of the interface. Use test helpers to make sure each step takes very few lines in each scenario.

Example: Incorrect

it 'counts comments' do
  collection = MyCollection.new([
    { author: 'test_author1', comment: 'test_comment1' },
    { author: 'test_author1', comment: 'test_comment2' },
    { author: 'test_author2', comment: 'test_comment3' }
  ])
  comments = collection.instance_variable_get(:@items)
  expect(comments.size).to eq 3
end

Example: Correct

# Helper providing test comments
def comment_factory(author: 'test_author', comment: 'test_comment')
  { author:, comment: }
end

it 'counts comments' do
  collection = MyCollection.new(3.times.map { comment_factory })
  expect(collection.nbr_elements).to eq 3
end

Rationale

Concise unit tests that have a clear structure are much easier to read and maintain. Only relying on public methods to run and assert guarantees freedom to refactor the internals of the classes being tested, without impacting unit tests.

Rule: Make sure each test scenario runs in an isolated way

Running scenarios in whatever order or group should never change the result of the test suite run. If this is not the case, understand what could break the isolation of those unit tests and fix it.