Glossary

Index

A

access modifiers, 146, 159 use in tests, 164, 166

accessor method testing, 229

all-pairs testing (see pairwise testing) anti-pattern, 235

copy&paste, 27, 82, 225 feature envy, 225 getters, 225

god object, 206, 221 loudmouth, 185 mime, 228

Apache Commons Lang, 146 arrange/act/assert

broken, 105

broken with mock, 278 definition, 33

expected exceptions, 106 with test spy, 278

assertions, 21, 22-23 for collections, 133

number of, 34, 133, 152-155 parameters order, 23

using matchers, 111

using the right one, 23, 185 assertions message (see failure message) Awaitility, 123-124

B

background threads testing, 120-126

BDD, 196-199

and set-up methods, 152 introduction, 196 Mockito support, 199 with JUnit, 197

Behaviour Driven Development (see BDD) boilerplate code, 199-203

Boy Scout Rule, 221, 255 bugs

fixing, 40 fixing cost, 9

build tools, 253, 270

C

Catch-Exception, 12, 106

classes

naming (see naming) Cobertura, 11

reports, 239

code coverage, 238-245, 251, 253 100% goal, 243

branch coverage, 238 how to use, 244

line coverage, 238 reports, 239, 247

weakness, 217, 241-242, 247 code reviews, 249-254

code smell (see anti-pattern) code-first, 39-40, 217

when updating code, 228 collaborator (see DOC) comments (see documentation) concurrency

testing, 126-128, 253 continuous deployment, 9 continuous integration, 268, 270

notifications, 187 copy&paste

issues, 252 CSV

reading test parameters, 138 cyclomatic complexity, 238

D

debugging tests, 186 with Eclipse, 272

with IntelliJ IDEA, 273 delegator method

testing, 231

Dependency Injection (see DI) design patterns

DTO, 93 factory

testing, 161 use in tests, 206

immutable object, 204, 206 object mother, 206-206 publisher/subscriber, 78 test data builder, 207-210

benefits, 209 Value Object, 93

developers tests

as documentation, 267 automation, 265, 268

comparison, 7, 235 pros & cons, 8 results, 22

types, 2

when to run, 54, 268 when to write, 39-41

DI

use in testing, 163 direct inputs, 14, 15 direct outputs, 14, 15 DOC

creation, 65, 200, 204 definition, 3 examples, 6

in unit tests, 14 interactions with SUT, 14 not implemented, 88

real collaborators, 89-94, 223 documentation (see test documentation) Don’t Repeat Yourself (see DRY principle) DRY principle, 45

and set-up methods, 152 cases against it, 261 parameterized tests, 27 violation, 93, 204

DSL

test data builder, 207 with matchers, 138

dummy definition, 74 example, 74, 80

dummy object (see dummy)

E

EasyMock, 11, 64, 67 code example, 278

EasyTest, 11, 140 Eclipse, 12

debugging tests, 272 running tests, 270 test reports, 177

end-to-end tests, 5 examples, 6 TDD, 47

test fixture examples, 30 Excel

reading test parameters, 138 exceptions (see expected exceptions) expected exceptions, 27-29, 186, 192

advanced, 104-109 message verification, 105 with FEST, 109

F

fail fast, 279

failure message, 55, 183-185, 216, 252, 258 custom message, 184

Hamcrest, 137 improving it, 50 matchers, 112 toString(), 184 Unitils, 135

when to write, 44, 59 fairy

dies, 225

fault injection (see mutation testing) FEST, 11, 110

assertions, 111 collections testing, 135 custom matchers, 111-113 expected exceptions, 109

Findbugs, 235, 237 flickering tests, 127, 129, 149 fluent interface (see FEST)

with FEST, 135

with test data builder, 207

fragile tests (see overspecified tests)

G

getter (see accessor metod) given-when-then (see BDD) Gradle, 12, 270

running tests, 273 test reports, 180 tests classapth, 274 using listeners, 274

H

Hamcrest, 11, 110

collections testing, 136-137 Mockito integration, 115

human testers, 267

I

IDE, 12, 177

autogenerated code, 43, 50, 59, 219 Eclipse (see Eclipse)

IntelliJ IDEA (see IntelliJ IDEAi) indirect inputs, 14, 16

controlling, 67, 75 indirect outputs, 14, 16, 278

verification, 68, 76, 76 information hiding, 221 inheritance, 252 integration tests, 4

examples, 6 TDD, 47

test fixture examples, 30 IntelliJ IDEA, 12

debugging tests, 273 running tests, 272 test reports, 178

interactions testing, 15-17, 94 example, 74

no interaction, 227

no interactions, 84, 86, 108 order verification, 227

vs. state testing, 16-17, 229 isolation, 13, 74

of test methods, 151 pros & cons, 89-94 with test doubles, 71

JUnit API @After, 33 @AfterClass, 33 @Before, 32

@BeforeClass, 33 @Ignore, 103 @RunWith, 25 @Test, 21

expected, 27

Assert, 21, 110, 184 (see assertions) Assume, 103

Description, 119, 182 fail(), 102, 106 MethodRule, 117 rules, 116-120 Statement, 119 TestRule, 117 TestWatcher, 182

JUnitParams, 11, 25-27 $, 26 @FileParameters, 139 @Parameters, 25 JUnitParamsRunner, 25

J

Java API arrays, 133 Calendar, 129

Collection, 133 Comparable, 53, 54 equals(), 171 ExecutorService, 120 instanceof, 54

List, 133

Map, 133 reflection, 157 Set, 133 toString(), 184

Javadocs, 13, 46, 177, 267 JMock, 67

JUnit, 10

assertions (see assertions) basics, 21-22

custom reports, 181-183 custom rules, 118 default reports, 180

test methods, 21

test methods names, 193 tests execution order, 33

K

KISS principle, 45, 236, 252

L

Law of Demeter (see LOD principle) legacy code, 7, 59, 156, 224 listeners (see test listeners)

LOD principle, 219 broken, 225

logic

in tests, 27, 219, 252 logs, 185

M

maintainability of tests, 205, 215-231 design principles, 219, 236 refactoring, 45, 236

vs. complex tests, 219

vs. interactions testing, 68 vs. overspecified tests, 215 vs. PowerMock, 162

with TDD, 42 Make It Easy, 210 manual testing, 265

matchers, 109, 110-113 advantages, 113, 113

FEST (see FEST) Hamcrest (see Hamcrest) JUnit support, 110

one line assertion, 154 reusability, 113

with Mockito, 114 writing custom, 111-113

Maven, 12, 253, 270 running tests, 274 test reports, 180 tests classpath, 276 using listeners, 276

methods

naming (see naming) mock

definition, 76 example, 76, 278 forgiving, 280 nice, 66, 280

returning mock, 225 strict, 67, 280

vs. test spy, 278 mock object (see mock) Mockito, 10

annotations, 201-203 arguments to DOCs, 169 BDD support, 199

creating test doubles, 65-67, 199-203 Hamcrest matchers, 115 introduction, 64 MockitoJUnitRunner, 201

number of invocations, 86 predefined matchers, 114 setting expectations, 67-68 stubbing

default values, 66 one-liners, 201 void methods, 110

verification, 68-70 Mockito API

@InjectMocks, 202 @Mock, 201 any…(), 114 argThat(), 115 ArgumentCaptor, 172 contains(), 115 doReturn(), 167 endsWith(), 115

eq(), 114

getMock(), 201 initMocks(), 201 inOrder(), 227 is…(), 114 matches(), 115 mock(), 65

MockitoAnnotations, 201 never(), 84, 86

refEq(), 114 same(), 114 spy(), 166 startsWith(), 115 stub(), 75 thenReturn(), 67 thenThrow(), 67 times(), 86 verify(), 68

verifyNoMoreInteractions(), 227 verifyZeroInteractions(), 108, 227 when(), 67, 199

…That(), 115 mutant, 245

mutation testing, 245-249

N

naming, 191

classes, 20, 191-193 parameters, 257

test methods, 193-195, 218, 227, 251 variables, 29, 54, 195, 251, 256, 258

new operator testing, 160-169 Non-object-oriented code (see procedural code) notifications, 186

O

Object-Oriented system, 2, 15, 219 overspecified tests, 225-229

issues, 222

nice mocks, 280

object-oriented approach, 221-223 test fixture, 204

testing implementation, 215-219

P

pairwise testing, 102 parameterized tests, 24-27, 53

idea, 25

parameters, 99-102, 196, 253 boundary values, 100 capturing, 169-174

expected, 99

from CSV file, 138 from Excel file, 138 indirect, 102

null, 74

random, 146-149

relaxed verification, 114, 227 strange values, 100 verification, 70-70

partial mocking, 166-168

PIT Mutation Testing, 12, 246-248 PMD, 235, 237

PowerMock, 11, 132 drawbacks, 162 java.util.Calendar, 132 new operator, 161-163 private methods, 158

private methods

in tests, 205, 252, 261 vs. matchers, 113

testing, 8, 156-159 access modifiers, 159 PowerMock, 158 reflection, 157

procedural code, 220-223 avoid, 224

project structure, 19 packages, 190

Q

Quickcheck, 147

R

readable code assertions, 23

collections testing, 135 common structure, 260 expected exceptions, 107 fluent interface, 193 focused tests, 259 irrelevant data, 258

meaningful names, 29, 193, 251, 256 Mockito syntax, 67

parameters, 257 refactoring, 254-262

self-contained test methods, 197, 261 using matchers, 110, 113, 115

vs. inheritance, 252

vs. set-up methods, 151

with Mockito annotations, 203 red-green-refactor (see TDD) redesign, 130, 163

refactoring

done wrong, 46 example, 83 TDD rhythm, 45

test code, 46, 51, 236, 254-262 use in tests, 164, 166

vs. test doubles, 94 reports (see test reports)

S

saboteur, 67, 75 (see test spy) set-up methods, 29, 46

pros & cons, 150-152 readability, 151

setter (see accessor method)

simplest thing that works, 45, 52, 55, 81

Single Responsibility Principle (see SRP principle) spy (see test spy)

SRP principle, 45, 236 one reason to fail, 227 violation, 93, 170, 226

state testing, 15-17, 19-35, 95

vs. interactions testing, 16-17, 229 static analysis tools, 237

static methods testing, 160-169 stub (see test stub)

SUT

creation, 200, 204 (see test fixture) creation without new(), 166 definition, 3

examples, 6

in unit tests, 14, 33 interactions with DOCs, 14 interactions with test class, 14

T

TDD, 39-61

benefits, 47, 224, 229 case against, 58 choosing next test, 43, 82 collections testing, 133 end-to-end tests, 47 example, 48-57, 78-88 how to start, 57 integration tests, 47 introduction, 39, 40

rhythm, 41-47, 59

test passes instantly, 56, 59 vs. legacy code, 59

when updating code, 228 with test doubles, 78-88

tear-down method, 34

Tell Don’t Ask principle, 219, 225, 228 Tempus-Fugit, 12, 128

test code quality, 235-262 size heuristics, 250

test dependencies, 252

test documentation, 46, 196-196, 253 test doubles

benefits, 93 creation, 65

dummy (see dummy) example, 76 expectations, 67 interactions, 71 introduction, 64 mock (see mock) not using, 89-94, 223 test spy (see test spy)

test stub (see test stub) types, 71

variables naming, 195 verification, 68

unnecessary, 226

Test Driven Design (see TDD)

Test Driven Development (see TDD) test fixture, 29-33, 150-152

complex objects, 204-210 examples, 30

in every test method, 30 JUnit annotations, 32 JUnit execution model, 31 set-up methods, 32, 150

test listeners

with Gradle, 274 with Maven, 276

test reports, 186

code coverage, 239 JUnit default reports, 180 mutation testing, 247

test result error, 22 failed, 22 passed, 22 skipped, 22

test smell (see anti-pattern) test spy

definition, 76 example, 76, 278 vs. mock, 278

test stub definition, 75 example, 75

test-first (see TDD) test-last (see code-first) testing

collections, 133

thread safe (see concurrency) time-dependent code, 129-132, 254

testing goal

better design, 7, 156, 161 verification, 7, 156, 161

tests maintainability (see maintainability of tests)

U

unit tests benefits, 13 definition, 13 examples, 6 interactions, 14 introduction, 4 phases, 33 term misuse, 13

test fixture examples, 30 Unitils, 12

collections testing, 134-135

V

variables

naming (see naming)

Y

YAGNI principle, 81

You Ain’t Gonna Need It (see YAGNI principle)