
- •Practical Unit Testing with JUnit and Mockito
- •Table of Contents
- •About the Author
- •Acknowledgments
- •Preface
- •Preface - JUnit
- •Part I. Developers' Tests
- •Chapter 1. On Tests and Tools
- •1.1. An Object-Oriented System
- •1.2. Types of Developers' Tests
- •1.2.1. Unit Tests
- •1.2.2. Integration Tests
- •1.2.3. End-to-End Tests
- •1.2.4. Examples
- •1.2.5. Conclusions
- •1.3. Verification and Design
- •1.5. Tools Introduction
- •Chapter 2. Unit Tests
- •2.1. What is a Unit Test?
- •2.2. Interactions in Unit Tests
- •2.2.1. State vs. Interaction Testing
- •2.2.2. Why Worry about Indirect Interactions?
- •Part II. Writing Unit Tests
- •3.2. Class To Test
- •3.3. Your First JUnit Test
- •3.3.1. Test Results
- •3.4. JUnit Assertions
- •3.5. Failing Test
- •3.6. Parameterized Tests
- •3.6.1. The Problem
- •3.6.2. The Solution
- •3.6.3. Conclusions
- •3.7. Checking Expected Exceptions
- •3.8. Test Fixture Setting
- •3.8.1. Test Fixture Examples
- •3.8.2. Test Fixture in Every Test Method
- •3.8.3. JUnit Execution Model
- •3.8.4. Annotations for Test Fixture Creation
- •3.9. Phases of a Unit Test
- •3.10. Conclusions
- •3.11. Exercises
- •3.11.1. JUnit Run
- •3.11.2. String Reverse
- •3.11.3. HashMap
- •3.11.4. Fahrenheits to Celcius with Parameterized Tests
- •3.11.5. Master Your IDE
- •Templates
- •Quick Navigation
- •Chapter 4. Test Driven Development
- •4.1. When to Write Tests?
- •4.1.1. Test Last (AKA Code First) Development
- •4.1.2. Test First Development
- •4.1.3. Always after a Bug is Found
- •4.2. TDD Rhythm
- •4.2.1. RED - Write a Test that Fails
- •How To Choose the Next Test To Write
- •Readable Assertion Message
- •4.2.2. GREEN - Write the Simplest Thing that Works
- •4.2.3. REFACTOR - Improve the Code
- •Refactoring the Tests
- •Adding Javadocs
- •4.2.4. Here We Go Again
- •4.3. Benefits
- •4.4. TDD is Not Only about Unit Tests
- •4.5. Test First Example
- •4.5.1. The Problem
- •4.5.2. RED - Write a Failing Test
- •4.5.3. GREEN - Fix the Code
- •4.5.4. REFACTOR - Even If Only a Little Bit
- •4.5.5. First Cycle Finished
- •‘The Simplest Thing that Works’ Revisited
- •4.5.6. More Test Cases
- •But is It Comparable?
- •Comparison Tests
- •4.6. Conclusions and Comments
- •4.7. How to Start Coding TDD
- •4.8. When not To Use Test-First?
- •4.9. Should I Follow It Blindly?
- •4.9.1. Write Good Assertion Messages from the Beginning
- •4.9.2. If the Test Passes "By Default"
- •4.10. Exercises
- •4.10.1. Password Validator
- •4.10.2. Regex
- •4.10.3. Booking System
- •Chapter 5. Mocks, Stubs, Test Spies
- •5.1. Introducing Mockito
- •5.1.1. Creating Test Doubles
- •5.1.2. Expectations
- •5.1.3. Verification
- •5.1.4. Conclusions
- •5.2. Types of Test Double
- •5.2.1. Code To Be Tested with Test Doubles
- •5.2.2. The Dummy Object
- •5.2.3. Test Stub
- •5.2.4. Test Spy
- •5.2.5. Mock
- •5.3. Putting it All Together
- •5.4. Example: TDD with Test Doubles
- •5.4.2. The Second Test: Send a Message to Multiple Subscribers
- •Refactoring
- •5.4.3. The Third Test: Send Messages to Subscribers Only
- •5.4.4. The Fourth Test: Subscribe More Than Once
- •Mockito: How Many Times?
- •5.4.5. The Fifth Test: Remove a Subscriber
- •5.4.6. TDD and Test Doubles - Conclusions
- •More Test Code than Production Code
- •The Interface is What Really Matters
- •Interactions Can Be Tested
- •Some Test Doubles are More Useful than Others
- •5.5. Always Use Test Doubles… or Maybe Not?
- •5.5.1. No Test Doubles
- •5.5.2. Using Test Doubles
- •No Winner So Far
- •5.5.3. A More Complicated Example
- •5.5.4. Use Test Doubles or Not? - Conclusion
- •5.6. Conclusions (with a Warning)
- •5.7. Exercises
- •5.7.1. User Service Tested
- •5.7.2. Race Results Enhanced
- •5.7.3. Booking System Revisited
- •5.7.4. Read, Read, Read!
- •Part III. Hints and Discussions
- •Chapter 6. Things You Should Know
- •6.1. What Values To Check?
- •6.1.1. Expected Values
- •6.1.2. Boundary Values
- •6.1.3. Strange Values
- •6.1.4. Should You Always Care?
- •6.1.5. Not Only Input Parameters
- •6.2. How to Fail a Test?
- •6.3. How to Ignore a Test?
- •6.4. More about Expected Exceptions
- •6.4.1. The Expected Exception Message
- •6.4.2. Catch-Exception Library
- •6.4.3. Testing Exceptions And Interactions
- •6.4.4. Conclusions
- •6.5. Stubbing Void Methods
- •6.6. Matchers
- •6.6.1. JUnit Support for Matcher Libraries
- •6.6.2. Comparing Matcher with "Standard" Assertions
- •6.6.3. Custom Matchers
- •6.6.4. Advantages of Matchers
- •6.7. Mockito Matchers
- •6.7.1. Hamcrest Matchers Integration
- •6.7.2. Matchers Warning
- •6.8. Rules
- •6.8.1. Using Rules
- •6.8.2. Writing Custom Rules
- •6.9. Unit Testing Asynchronous Code
- •6.9.1. Waiting for the Asynchronous Task to Finish
- •6.9.2. Making Asynchronous Synchronous
- •6.9.3. Conclusions
- •6.10. Testing Thread Safe
- •6.10.1. ID Generator: Requirements
- •6.10.2. ID Generator: First Implementation
- •6.10.3. ID Generator: Second Implementation
- •6.10.4. Conclusions
- •6.11. Time is not on Your Side
- •6.11.1. Test Every Date (Within Reason)
- •6.11.2. Conclusions
- •6.12. Testing Collections
- •6.12.1. The TDD Approach - Step by Step
- •6.12.2. Using External Assertions
- •Unitils
- •Testing Collections Using Matchers
- •6.12.3. Custom Solution
- •6.12.4. Conclusions
- •6.13. Reading Test Data From Files
- •6.13.1. CSV Files
- •6.13.2. Excel Files
- •6.14. Conclusions
- •6.15. Exercises
- •6.15.1. Design Test Cases: State Testing
- •6.15.2. Design Test Cases: Interactions Testing
- •6.15.3. Test Collections
- •6.15.4. Time Testing
- •6.15.5. Redesign of the TimeProvider class
- •6.15.6. Write a Custom Matcher
- •6.15.7. Preserve System Properties During Tests
- •6.15.8. Enhance the RetryTestRule
- •6.15.9. Make an ID Generator Bulletproof
- •Chapter 7. Points of Controversy
- •7.1. Access Modifiers
- •7.2. Random Values in Tests
- •7.2.1. Random Object Properties
- •7.2.2. Generating Multiple Test Cases
- •7.2.3. Conclusions
- •7.3. Is Set-up the Right Thing for You?
- •7.4. How Many Assertions per Test Method?
- •7.4.1. Code Example
- •7.4.2. Pros and Cons
- •7.4.3. Conclusions
- •7.5. Private Methods Testing
- •7.5.1. Verification vs. Design - Revisited
- •7.5.2. Options We Have
- •7.5.3. Private Methods Testing - Techniques
- •Reflection
- •Access Modifiers
- •7.5.4. Conclusions
- •7.6. New Operator
- •7.6.1. PowerMock to the Rescue
- •7.6.2. Redesign and Inject
- •7.6.3. Refactor and Subclass
- •7.6.4. Partial Mocking
- •7.6.5. Conclusions
- •7.7. Capturing Arguments to Collaborators
- •7.8. Conclusions
- •7.9. Exercises
- •7.9.1. Testing Legacy Code
- •Part IV. Listen and Organize
- •Chapter 8. Getting Feedback
- •8.1. IDE Feedback
- •8.1.1. Eclipse Test Reports
- •8.1.2. IntelliJ IDEA Test Reports
- •8.1.3. Conclusion
- •8.2. JUnit Default Reports
- •8.3. Writing Custom Listeners
- •8.4. Readable Assertion Messages
- •8.4.1. Add a Custom Assertion Message
- •8.4.2. Implement the toString() Method
- •8.4.3. Use the Right Assertion Method
- •8.5. Logging in Tests
- •8.6. Debugging Tests
- •8.7. Notifying The Team
- •8.8. Conclusions
- •8.9. Exercises
- •8.9.1. Study Test Output
- •8.9.2. Enhance the Custom Rule
- •8.9.3. Custom Test Listener
- •8.9.4. Debugging Session
- •Chapter 9. Organization Of Tests
- •9.1. Package for Test Classes
- •9.2. Name Your Tests Consistently
- •9.2.1. Test Class Names
- •Splitting Up Long Test Classes
- •Test Class Per Feature
- •9.2.2. Test Method Names
- •9.2.3. Naming of Test-Double Variables
- •9.3. Comments in Tests
- •9.4. BDD: ‘Given’, ‘When’, ‘Then’
- •9.4.1. Testing BDD-Style
- •9.4.2. Mockito BDD-Style
- •9.5. Reducing Boilerplate Code
- •9.5.1. One-Liner Stubs
- •9.5.2. Mockito Annotations
- •9.6. Creating Complex Objects
- •9.6.1. Mummy Knows Best
- •9.6.2. Test Data Builder
- •9.6.3. Conclusions
- •9.7. Conclusions
- •9.8. Exercises
- •9.8.1. Test Fixture Setting
- •9.8.2. Test Data Builder
- •Part V. Make Them Better
- •Chapter 10. Maintainable Tests
- •10.1. Test Behaviour, not Methods
- •10.2. Complexity Leads to Bugs
- •10.3. Follow the Rules or Suffer
- •10.3.1. Real Life is Object-Oriented
- •10.3.2. The Non-Object-Oriented Approach
- •Do We Need Mocks?
- •10.3.3. The Object-Oriented Approach
- •10.3.4. How To Deal with Procedural Code?
- •10.3.5. Conclusions
- •10.4. Rewriting Tests when the Code Changes
- •10.4.1. Avoid Overspecified Tests
- •10.4.2. Are You Really Coding Test-First?
- •10.4.3. Conclusions
- •10.5. Things Too Simple To Break
- •10.6. Conclusions
- •10.7. Exercises
- •10.7.1. A Car is a Sports Car if …
- •10.7.2. Stack Test
- •Chapter 11. Test Quality
- •11.1. An Overview
- •11.2. Static Analysis Tools
- •11.3. Code Coverage
- •11.3.1. Line and Branch Coverage
- •11.3.2. Code Coverage Reports
- •11.3.3. The Devil is in the Details
- •11.3.4. How Much Code Coverage is Good Enough?
- •11.3.5. Conclusion
- •11.4. Mutation Testing
- •11.4.1. How does it Work?
- •11.4.2. Working with PIT
- •11.4.3. Conclusions
- •11.5. Code Reviews
- •11.5.1. A Three-Minute Test Code Review
- •Size Heuristics
- •But do They Run?
- •Check Code Coverage
- •Conclusions
- •11.5.2. Things to Look For
- •Easy to Understand
- •Documented
- •Are All the Important Scenarios Verified?
- •Run Them
- •Date Testing
- •11.5.3. Conclusions
- •11.6. Refactor Your Tests
- •11.6.1. Use Meaningful Names - Everywhere
- •11.6.2. Make It Understandable at a Glance
- •11.6.3. Make Irrelevant Data Clearly Visible
- •11.6.4. Do not Test Many Things at Once
- •11.6.5. Change Order of Methods
- •11.7. Conclusions
- •11.8. Exercises
- •11.8.1. Clean this Mess
- •Appendix A. Automated Tests
- •A.1. Wasting Your Time by not Writing Tests
- •A.1.1. And what about Human Testers?
- •A.1.2. One More Benefit: A Documentation that is Always Up-To-Date
- •A.2. When and Where Should Tests Run?
- •Appendix B. Running Unit Tests
- •B.1. Running Tests with Eclipse
- •B.1.1. Debugging Tests with Eclipse
- •B.2. Running Tests with IntelliJ IDEA
- •B.2.1. Debugging Tests with IntelliJ IDEA
- •B.3. Running Tests with Gradle
- •B.3.1. Using JUnit Listeners with Gradle
- •B.3.2. Adding JARs to Gradle’s Tests Classpath
- •B.4. Running Tests with Maven
- •B.4.1. Using JUnit Listeners and Reporters with Maven
- •B.4.2. Adding JARs to Maven’s Tests Classpath
- •Appendix C. Test Spy vs. Mock
- •C.1. Different Flow - and Who Asserts?
- •C.2. Stop with the First Error
- •C.3. Stubbing
- •C.4. Forgiveness
- •C.5. Different Threads or Containers
- •C.6. Conclusions
- •Appendix D. Where Should I Go Now?
- •Bibliography
- •Glossary
- •Index
- •Thank You!

Chapter 6. Things You Should Know
6.5. Stubbing Void Methods
Sometimes it is required to stub void methods. Mockito allows to do it, but there is a small catch: the syntax differs substantially from what we have learned so far. For example, to stub the behaviour of someMethod() method you would usually write the following:
Listing 6.11. Stubbing a non-void method
when(someObject.someMethod()).thenReturn("some value");
However, if a method returns void, then the syntax differs (obviously it does not make sens to return anything from void method, so in the example below we instruct the voidMethod() to throw an exception):
Listing 6.12. Stubbing a void method
doThrow(new IllegalArgumentException("bad argument!"))
.when(someObject).voidMethod();
As the original Mockito’s documentation states, this different syntax is required, because: "Stubbing voids requires different approach from when(Object) because the compiler does not like void methods inside brackets…".
Apart from the doThrow() method, there are two other methods which may help when working with void methods: doNothing() and doAnswer(). Mockito documentation discusses them in detail, giving very good examples for both.
6.6. Matchers
Up to now we have been almost exclusively using standard JUnit assertions. We have used assertTrue() to verify some basic boolean expressions, assertEquals() to compare two objects with respect to equality, and assertNull() or assertNotNull() to make sure that a given object is or is not null, etc. These basic assertions are enough to verify any condition you might think of. That is true, but there is still room for further improvement here! In particular, thanks to using matchers we can have more readable test code, which is always a good thing.
6.6.1. JUnit Support for Matcher Libraries
Let us dive into history for a minute. A long time ago, Hamcrest was the only matchers library available in the world of Java. At this time a decision was made to facilitate its use for JUnit users and an additional assertion method - assertThat() - was added to the Assert class right next to our old friends assertEquals, assertTrue and others. This addition to the JUnit API seemed right at the time, but after a few years, when new matchers libraries had emerged, it had become a legacy mistake. This is not to say that there is anything wrong with Hamcrest! Not at all: it is still a very good, successful and very popular tool. However, the presence of the Hamcrest-related assertThat() method in the JUnit API makes developers think that it is the matchers library to be used with JUnit.
Currently, there are two matchers libraries for Java developers that are the most popular ones: Hamcrest and FEST Fluent Assertions. They are very similar in terms of the functionalities offered, but differ
110

Chapter 6. Things You Should Know
when it comes to the API. The main difference is that FEST offers a fluent interface API. This works very well with the auto-completion feature of current IDEs, and this is one of the reasons why I value it above Hamcrest.
The reality is that you can use any matcher library with JUnit tests with ease. Usually, all you need to do is import an adequate class (an equivalent to the Assert class of JUnit); that really is all! For example, to use the FEST Fluent Assertions matchers library all you need to do is import the
org.fest.assertions.Assertions class.
The information included in this section is valid across all currently existing implementations of matchers; you can use what you learn here with both FEST and Hamcrest (the two most popular frameworks of this kind). All the examples will be written with FEST, but only because this is my tool of choice.
6.6.2. Comparing Matcher with "Standard" Assertions
In some sections of this book we have already mentioned that there are two aspects to the readability of assertions: how they look within the test code, and what information is given to the developer once an assertion has failed. Matchers are particularly useful for helping with both of these issues.
Matchers makes your tests more readable. They provide extra readability at a linguistic level, because the order of words in assertThat(worker).isA(manager) resembles natural language much more closely than does assertEquals(worker, manager), the standard assertEqual() assertion. This is true both for FEST or Hamcrest matchers available out-of-the box, and for custom matchers that you yourself write. The following example demonstrates this:
Table 6.1. Comparison of default JUnit assertions and FEST matchers
standard JUnit assertions |
|
|
|
|
Book book = new Book(TITLE); |
|
|
|
|
assertNotNull(book.getTitle()); |
|
|
|
assertFalse(book.getTitle().isEmpty()); |
|
|
|
assertEquals(TITLE, book.getTitle()); |
|
|
|
|
|
FEST matchers |
|
|
|
|
Book book = new Book(TITLE); |
|
|
|
|
assertThat(book.getTitle()).isNotNull(); |
|
|
|
assertThat(book.getTitle()).isNotEmpty(); |
|
|
|
assertThat(book.getTitle()).isEqualTo(TITLE); |
|
|
|
|
|
You may also notice that the use of matchers introduces a specific "rhythm" to your assertions: they all read similarly.
6.6.3. Custom Matchers
But so far this is nothing to get especially excited about. We can do more than this by writing custom matchers, which are designed to verify properties of our domain object. For example, would it not be nice to replace the assertion on a book’s title property with a simple assertThat(book).hasTitle(TITLE)? Absolutely! This is possible, even though creating such a matcher comes at a certain cost. Listing 6.13 shows the code of a custom matcher that will furnish us with the aforementioned hasTitle() method:
111

Chapter 6. Things You Should Know
Listing 6.13. Implementation of a FEST custom matcher
import org.fest.assertions.*;
public class BookAssert extends GenericAssert<BookAssert, Book> {
public BookAssert(Book actual) { super(BookAssert.class, actual);
}
public static BookAssert assertThat(Book actual) { return new BookAssert(actual);
}
public BookAssert hasTitle(String title) { isNotNull();
String errorMessage = String.format(
"Expected book's title to be <%s> but was <%s>", title, actual.getTitle());
Assertions.assertThat(actual.getTitle())
.overridingErrorMessage(errorMessage)
.isEqualTo(title); return this;
}
}
Import of required FEST classes.
Our implementation of assertThat() is required, so that we can start assertion lines in the same way as we would start any matchers’ assertions. Then we can chain together both the default matchers
(e.g. isEqualTo(), isNotNull()) and our custom hasTitle() matcher.
Here we have a custom matcher responsible for verifying equality as regards book title, with respect to any given book. It also contains a null check (isNotNull()), so that the test code will be safe
from any NullPointerException error.
The error message is overridden here, so that if the assertion fails the developer will know exactly what happened (e.g. "Expected book’s title to be <Hobbit> but was <Odyssey>"). This is yet another advantage of matchers, which can provide very readable failure messages in cases of failed assertions.
Now that we have this custom matcher implemented, we can use it in our test code as shown below:
Listing 6.14. The use of a custom matcher
import org.junit.Test;
import static com.practicalunittesting
.chp06.matchers.BookAssert.assertThat;
public class BookFestTest {
private static final String TITLE = "My book";
@Test
public void constructorShouldSetTitle() { Book book = new Book(TITLE);
assertThat(book).hasTitle(TITLE);
}
}
In this case we use the assertThat() method provided by the BookAssert class.
112

Chapter 6. Things You Should Know
As shown in the listing above, custom matchers also help to achieve better readability by helping us to write the tests at a reasonable level of abstraction. This is possible because custom matchers can contain some assertions within themselves and so act as superordinate assertions under intentionrevealing names. The association with private methods, which are often used in test code to achieve exactly the same goal, is justified. However the syntax of matchers makes them even more readable.
Another interesting point about matchers is that they are highly reusable. They can be used in connection with a great many test methods and test classes. Moreover, they can be combined together to create complex assertions, as shown in Listing 6.15. This example also demonstrates that it is possible to combine default matchers (isNotIn()) with custom ones (hasTitle() and isWrittenIn()).
Listing 6.15. Combining matchers
public void combinedMatchersExample() { Book book = new Book(TITLE);
assertThat(book).hasTitle(TITLE)
.isNotIn(scienceFictionBooks)
.isWrittenIn(ENGLISH);
}
Such simple examples hardly reveal the true power and usefulness of matchers. Custom matchers excel particularly when working with rich domain objects or complex data structures.
6.6.4. Advantages of Matchers
It is time to list the advantages of matchers, which are numerous:
•they enhance code readability,
•they help us to write assertions on the right abstraction level,
•they help to remove logic from tests (and encapsulate it within the matchers’ classes),
•they are highly reusable, which is very important if your domain objects are complex and are tested with multiple test scenarios,
•many matchers are available directly from matcher libraries - including specific matchers for work with collections (as shown in Section 6.12) or exceptions (see Section 6.4),
•writing custom matchers is a relatively simple task.
In spite of their usefulness, I do not see matchers being used much. I guess the main reasons for this are lack of knowledge about them, a general reluctance to add yet another library to one’s project, and the cost involved in implementing custom assertions. Personally, I find them invaluable, especially when working with rich domain objects. As soon as I no longer feel comfortable using the default assertions (assertEquals(), assertTrue()), I write a custom matcher instead. Usually this solves my problem.
In my experience, it quite often happens that the custom matchers one has written for unit tests get reused later for integration and/or end-to-end tests. This increases the "return on the investment" one had to make to implement them.
As a last tip, I would suggest that if you use matchers, you should use them everywhere, so that all your assertions begin with assertThat(). This will make your tests very readable indeed.
113