
- •Introduction
- •Who This Book Is For
- •What This Book Covers
- •How This Book Is Structured
- •What You Need to Use This Book
- •Conventions
- •Source Code
- •Errata
- •p2p.wrox.com
- •What Are Regular Expressions?
- •What Can Regular Expressions Be Used For?
- •Finding Doubled Words
- •Checking Input from Web Forms
- •Changing Date Formats
- •Finding Incorrect Case
- •Adding Links to URLs
- •Regular Expressions You Already Use
- •Search and Replace in Word Processors
- •Directory Listings
- •Online Searching
- •Why Regular Expressions Seem Intimidating
- •Compact, Cryptic Syntax
- •Whitespace Can Significantly Alter the Meaning
- •No Standards Body
- •Differences between Implementations
- •Characters Change Meaning in Different Contexts
- •Regular Expressions Can Be Case Sensitive
- •Case-Sensitive and Case-Insensitive Matching
- •Case and Metacharacters
- •Continual Evolution in Techniques Supported
- •Multiple Solutions for a Single Problem
- •What You Want to Do with a Regular Expression
- •Replacing Text in Quantity
- •Regular Expression Tools
- •findstr
- •Microsoft Word
- •StarOffice Writer/OpenOffice.org Writer
- •Komodo Rx Package
- •PowerGrep
- •Microsoft Excel
- •JavaScript and JScript
- •VBScript
- •Visual Basic.NET
- •Java
- •Perl
- •MySQL
- •SQL Server 2000
- •W3C XML Schema
- •An Analytical Approach to Using Regular Expressions
- •Express and Document What You Want to Do in English
- •Consider the Regular Expression Options Available
- •Consider Sensitivity and Specificity
- •Create Appropriate Regular Expressions
- •Document All but Simple Regular Expressions
- •Document What You Expect the Regular Expression to Do
- •Document What You Want to Match
- •Test the Results of a Regular Expression
- •Matching Single Characters
- •Matching Sequences of Characters That Each Occur Once
- •Introducing Metacharacters
- •Matching Sequences of Different Characters
- •Matching Optional Characters
- •Matching Multiple Optional Characters
- •Other Cardinality Operators
- •The * Quantifier
- •The + Quantifier
- •The Curly-Brace Syntax
- •The {n} Syntax
- •The {n,m} Syntax
- •Exercises
- •Regular Expression Metacharacters
- •Thinking about Characters and Positions
- •The Period (.) Metacharacter
- •Matching Variably Structured Part Numbers
- •Matching a Literal Period
- •The \w Metacharacter
- •The \W Metacharacter
- •Digits and Nondigits
- •The \d Metacharacter
- •Canadian Postal Code Example
- •The \D Metacharacter
- •Alternatives to \d and \D
- •The \s Metacharacter
- •Handling Optional Whitespace
- •The \S Metacharacter
- •The \t Metacharacter
- •The \n Metacharacter
- •Escaped Characters
- •Finding the Backslash
- •Modifiers
- •Global Search
- •Case-Insensitive Search
- •Exercises
- •Introduction to Character Classes
- •Choice between Two Characters
- •Using Quantifiers with Character Classes
- •Using the \b Metacharacter in Character Classes
- •Selecting Literal Square Brackets
- •Using Ranges in Character Classes
- •Alphabetic Ranges
- •Use [A-z] With Care
- •Digit Ranges in Character Classes
- •Hexadecimal Numbers
- •IP Addresses
- •Reverse Ranges in Character Classes
- •A Potential Range Trap
- •Finding HTML Heading Elements
- •Metacharacter Meaning within Character Classes
- •The ^ metacharacter
- •How to Use the - Metacharacter
- •Negated Character Classes
- •Combining Positive and Negative Character Classes
- •POSIX Character Classes
- •The [:alnum:] Character Class
- •Exercises
- •String, Line, and Word Boundaries
- •The ^ Metacharacter
- •The ^ Metacharacter and Multiline Mode
- •The $ Metacharacter
- •The $ Metacharacter in Multiline Mode
- •Using the ^ and $ Metacharacters Together
- •Matching Blank Lines
- •Working with Dollar Amounts
- •Revisiting the IP Address Example
- •What Is a Word?
- •Identifying Word Boundaries
- •The \< Syntax
- •The \>Syntax
- •The \b Syntax
- •The \B Metacharacter
- •Less-Common Word-Boundary Metacharacters
- •Exercises
- •Grouping Using Parentheses
- •Parentheses and Quantifiers
- •Matching Literal Parentheses
- •U.S. Telephone Number Example
- •Alternation
- •Choosing among Multiple Options
- •Unexpected Alternation Behavior
- •Capturing Parentheses
- •Numbering of Captured Groups
- •Numbering When Using Nested Parentheses
- •Named Groups
- •Non-Capturing Parentheses
- •Back References
- •Exercises
- •Why You Need Lookahead and Lookbehind
- •The (? metacharacters
- •Lookahead
- •Positive Lookahead
- •Negative Lookahead
- •Positive Lookahead Examples
- •Positive Lookahead in the Same Document
- •Inserting an Apostrophe
- •Lookbehind
- •Positive Lookbehind
- •Negative Lookbehind
- •How to Match Positions
- •Adding Commas to Large Numbers
- •Exercises
- •What Are Sensitivity and Specificity?
- •Extreme Sensitivity, Awful Specificity
- •Email Addresses Example
- •Replacing Hyphens Example
- •The Sensitivity/Specificity Trade-Off
- •Sensitivity, Specificity, and Positional Characters
- •Sensitivity, Specificity, and Modes
- •Sensitivity, Specificity, and Lookahead and Lookbehind
- •How Much Should the Regular Expressions Do?
- •Abbreviations
- •Characters from Other Languages
- •Names
- •Sensitivity and How to Achieve It
- •Specificity and How to Maximize It
- •Exercises
- •Documenting Regular Expressions
- •Document the Problem Definition
- •Add Comments to Your Code
- •Making Use of Extended Mode
- •Know Your Data
- •Abbreviations
- •Proper Names
- •Incorrect Spelling
- •Creating Test Cases
- •Debugging Regular Expressions
- •Treacherous Whitespace
- •Backslashes Causing Problems
- •Considering Other Causes
- •The User Interface
- •Metacharacters Available
- •Quantifiers
- •The @ Quantifier
- •The {n,m} Syntax
- •Modes
- •Character Classes
- •Back References
- •Lookahead and Lookbehind
- •Lazy Matching versus Greedy Matching
- •Examples
- •Character Class Examples, Including Ranges
- •Whole Word Searches
- •Search-and-Replace Examples
- •Changing Name Structure Using Back References
- •Manipulating Dates
- •The Star Training Company Example
- •Regular Expressions in Visual Basic for Applications
- •Exercises
- •The User Interface
- •Metacharacters Available
- •Quantifiers
- •Modes
- •Character Classes
- •Alternation
- •Back References
- •Lookahead and Lookbehind
- •Search Example
- •Search-and-Replace Example
- •Online Chats
- •POSIX Character Classes
- •Matching Numeric Digits
- •Exercises
- •Introducing findstr
- •Finding Literal Text
- •Quantifiers
- •Character Classes
- •Command-Line Switch Examples
- •The /v Switch
- •The /a Switch
- •Single File Examples
- •Simple Character Class Example
- •Find Protocols Example
- •Multiple File Example
- •A Filelist Example
- •Exercises
- •The PowerGREP Interface
- •A Simple Find Example
- •The Replace Tab
- •The File Finder Tab
- •Syntax Coloring
- •Other Tabs
- •Numeric Digits and Alphabetic Characters
- •Quantifiers
- •Back References
- •Alternation
- •Line Position Metacharacters
- •Word-Boundary Metacharacters
- •Lookahead and Lookbehind
- •Longer Examples
- •Finding HTML Horizontal Rule Elements
- •Matching Time Example
- •Exercises
- •The Excel Find Interface
- •Escaping Wildcard Characters
- •Using Wildcards in Data Forms
- •Using Wildcards in Filters
- •Exercises
- •Using LIKE with Regular Expressions
- •The % Metacharacter
- •The _ Metacharacter
- •Character Classes
- •Negated Character Classes
- •Using Full-Text Search
- •Using The CONTAINS Predicate
- •Document Filters on Image Columns
- •Exercises
- •Using the _ and % Metacharacters
- •Testing Matching of Literals: _ and % Metacharacters
- •Using Positional Metacharacters
- •Using Character Classes
- •Quantifiers
- •Social Security Number Example
- •Exercises
- •The Interface to Metacharacters in Microsoft Access
- •Creating a Hard-Wired Query
- •Creating a Parameter Query
- •Using the ? Metacharacter
- •Using the * Metacharacter
- •Using the # Metacharacter
- •Using the # Character with Date/Time Data
- •Using Character Classes in Access
- •Exercises
- •The RegExp Object
- •Attributes of the RegExp Object
- •The Other Properties of the RegExp Object
- •The test() Method of the RegExp Object
- •The exec() Method of the RegExp Object
- •The String Object
- •Metacharacters in JavaScript and JScript
- •SSN Validation Example
- •Exercises
- •The RegExp Object and How to Use It
- •Quantifiers
- •Positional Metacharacters
- •Character Classes
- •Word Boundaries
- •Lookahead
- •Grouping and Nongrouping Parentheses
- •Exercises
- •The System.Text.RegularExpressions namespace
- •A Simple Visual Basic .NET Example
- •The Classes of System.Text.RegularExpressions
- •The Regex Object
- •Using the Match Object and Matches Collection
- •Using the Match.Success Property and Match.NextMatch Method
- •The GroupCollection and Group Classes
- •The CaptureCollection and Capture Class
- •The RegexOptions Enumeration
- •Case-Insensitive Matching: The IgnoreCase Option
- •Multiline Matching: The Effect on the ^ and $ Metacharacters
- •Right to Left Matching: The RightToLeft Option
- •Lookahead and Lookbehind
- •Exercises
- •An Introductory Example
- •The Classes of System.Text.RegularExpressions
- •The Regex Class
- •The Options Property of the Regex Class
- •Regex Class Methods
- •The CompileToAssembly() Method
- •The GetGroupNames() Method
- •The GetGroupNumbers() Method
- •GroupNumberFromName() and GroupNameFromNumber() Methods
- •The IsMatch() Method
- •The Match() Method
- •The Matches() Method
- •The Replace() Method
- •The Split() Method
- •Using the Static Methods of the Regex Class
- •The IsMatch() Method as a Static
- •The Match() Method as a Static
- •The Matches() Method as a Static
- •The Replace() Method as a Static
- •The Split() Method as a Static
- •The Match and Matches Classes
- •The Match Class
- •The GroupCollection and Group Classes
- •The RegexOptions Class
- •The IgnorePatternWhitespace Option
- •Metacharacters Supported in Visual C# .NET
- •Using Named Groups
- •Using Back References
- •Exercise
- •The ereg() Set of Functions
- •The ereg() Function
- •The ereg() Function with Three Arguments
- •The eregi() Function
- •The ereg_replace() Function
- •The eregi_replace() Function
- •The split() Function
- •The spliti() Function
- •The sql_regcase() Function
- •Perl Compatible Regular Expressions
- •Pattern Delimiters in PCRE
- •Escaping Pattern Delimiters
- •Matching Modifiers in PCRE
- •Using the preg_match() Function
- •Using the preg_match_all() Function
- •Using the preg_grep() Function
- •Using the preg_quote() Function
- •Using the preg_replace() Function
- •Using the preg_replace_callback() Function
- •Using the preg_split() Function
- •Supported Metacharacters with ereg()
- •Using POSIX Character Classes with PHP
- •Supported Metacharacters with PCRE
- •Positional Metacharacters
- •Character Classes in PHP
- •Documenting PHP Regular Expressions
- •Exercises
- •W3C XML Schema Basics
- •Tools for Using W3C XML Schema
- •Comparing XML Schema and DTDs
- •How Constraints Are Expressed in W3C XML Schema
- •W3C XML Schema Datatypes
- •Derivation by Restriction
- •Unicode and W3C XML Schema
- •Unicode Overview
- •Using Unicode Character Classes
- •Matching Decimal Numbers
- •Mixing Unicode Character Classes with Other Metacharacters
- •Unicode Character Blocks
- •Using Unicode Character Blocks
- •Metacharacters Supported in W3C XML Schema
- •Positional Metacharacters
- •Matching Numeric Digits
- •Alternation
- •Using the \w and \s Metacharacters
- •Escaping Metacharacters
- •Exercises
- •Introduction to the java.util.regex Package
- •Obtaining and Installing Java
- •The Pattern Class
- •Using the matches() Method Statically
- •Two Simple Java Examples
- •The Properties (Fields) of the Pattern Class
- •The CASE_INSENSITIVE Flag
- •Using the COMMENTS Flag
- •The DOTALL Flag
- •The MULTILINE Flag
- •The UNICODE_CASE Flag
- •The UNIX_LINES Flag
- •The Methods of the Pattern Class
- •The compile() Method
- •The flags() Method
- •The matcher() Method
- •The matches() Method
- •The pattern() Method
- •The split() Method
- •The Matcher Class
- •The appendReplacement() Method
- •The appendTail() Method
- •The end() Method
- •The find() Method
- •The group() Method
- •The groupCount() Method
- •The lookingAt() Method
- •The matches() Method
- •The pattern() Method
- •The replaceAll() Method
- •The replaceFirst() Method
- •The reset() Method
- •The start() Method
- •The PatternSyntaxException Class
- •Using the \d Metacharacter
- •Character Classes
- •The POSIX Character Classes in the java.util.regex Package
- •Unicode Character Classes and Character Blocks
- •Using Escaped Characters
- •Using Methods of the String Class
- •Using the matches() Method
- •Using the replaceFirst() Method
- •Using the replaceAll() Method
- •Using the split() Method
- •Exercises
- •Obtaining and Installing Perl
- •Creating a Simple Perl Program
- •Basics of Perl Regular Expression Usage
- •Using the m// Operator
- •Using Other Regular Expression Delimiters
- •Matching Using Variable Substitution
- •Using the s/// Operator
- •Using s/// with the Global Modifier
- •Using s/// with the Default Variable
- •Using the split Operator
- •Using Quantifiers in Perl
- •Using Positional Metacharacters
- •Captured Groups in Perl
- •Using Back References in Perl
- •Using Alternation
- •Using Character Classes in Perl
- •Using Lookahead
- •Using Lookbehind
- •Escaping Metacharacters
- •A Simple Perl Regex Tester
- •Exercises
- •Index

Regular Expressions in Java
The Methods of the Pattern Class
The following table summarizes the methods that are specific to the Pattern class. Methods inherited from the Object class are not described here.
Method |
Description |
|
|
compile() |
This static method compiles a regular expression pattern into a Pattern |
|
object. |
flags() |
Returns the flags set on a Pattern object. |
matcher() |
Creates a Matcher object that will match a regular expression against the |
|
test string. |
matches() |
This static method attempts to match a regular expression against a test |
|
string. |
pattern() |
Returns the regular expression pattern from which the Pattern object was |
|
compiled. |
split() |
Splits the test string at each occurrence of a match for a regular expression. |
|
|
The compile() Method
There are two forms of the compile() method, each of which is static. One form takes a single argument, a String value containing a regular expression pattern. Any metacharacters, such as \d, must be written as \\d. The method throws a PatternSyntaxException.
The second form takes two arguments. The first argument is a String value containing a regular expression pattern. Any metacharacters, such as \d, must be written as \\d. The second argument is an int value indicating which flags are set. The method throws a PatternSyntaxException. if the regular expression is invalid and an IllegalArgumentException if the int value does not correspond to a permitted combination of flags.
The flags() Method
The flags() method takes no argument. It returns an int value corresponding to the flags (if any) that were set when the Pattern object was compiled.
The matcher() Method
The matcher() method takes one argument, a CharSequence value, which is the test string. A new Matcher object is returned that will match the CharSequence argument against the regular expression pattern specified for the Pattern object.
The matches() Method
This static method takes two arguments. The first argument is a String value containing the regular expression pattern. The second argument is a CharSequence value containing the test string. The matches() method returns a boolean value indicating whether or not matching was successful. The matches() method throws a PatternSyntaxException.
633

Chapter 25
The pattern() Method
The pattern() method takes no argument and returns a String value containing the regular expression pattern that was used to compile the Pattern object.
The split() Method
The split() method can take two forms. The first form has a single CharSequence value as its argument, which contains the test string. A String[] is returned. The CharSequence is split at each occurrence of the regular expression pattern. If the regular expression pattern matches the final character(s) in the CharSequence, the empty string following the match is not returned as part of the string array.
The second form behaves like the first except that it has an int value as its second argument. The int value specifies the maximum number of times that the CharSequence value may be split.
The Matcher Class
The Matcher class is where most of the work is done. The Matcher object interprets the regular expression and performs the matching operations.
The Matcher class provides no public constructor. To create a Matcher object, you must call the public matcher() method on a Pattern object (as shown earlier):
Matcher myMatcher = myPattern.matcher(“someString”);
The matcher() method takes a single argument, a string.
The methods of the Matcher class are summarized in the following table.
Method |
Description |
|
|
appendReplacement() |
Appends a replacement string to a string buffer when a match is |
|
found. |
appendTail() |
Appends the remaining character sequence to a string buffer after |
|
the final match is found (or the whole character sequence, if no |
|
match is found). |
end() |
Returns the index (plus one) of the last character matched. |
find() |
Attempts to find a substring of the test string that matches the |
|
regular expression pattern. |
group() |
Used with no argument, it returns the matching substring. Used |
|
with one argument, it returns the matching substring for a speci- |
|
fied capturing group. |
groupCount() |
Returns the number of capturing groups in a regular expression |
|
pattern. |
lookingAt() |
Attempts to find a match for the regular expression pattern in the |
|
test string. |
634

|
|
Regular Expressions in Java |
|
|
|
|
|
|
|
Method |
Description |
|
|
|
|
matches() |
Attempts to match the whole test string against the regular |
|
|
expression pattern. |
|
pattern() |
Returns the Pattern object used in matching. |
|
replaceAll() |
Returns a string in which all occurrences of a regular expression |
|
|
pattern have been replaced by a replacement string. |
|
replaceFirst() |
Returns a string in which the first occurrence of a regular expres- |
|
|
sion pattern has been replaced by a replacement string. |
|
reset() |
Resets a Matcher object. |
|
start() |
Returns the index of the first character in a match. |
The appendReplacement() Method
The appendReplacement() method is intended for use with the find() and appendTail() methods. The following example uses the appendReplacement(), find(), and appendTail() methods together with a StringBuffer object to replace occurrences of the character sequence Star with the character sequence Moon.
Try It Out |
The appendReplacement() Method |
1.Type the following code in a text editor:
import java.io.*;
import java.util.regex.*;
public final class MatcherMethods { private static String myRegex; private static String testString;
private static BufferedReader myBufferedReader; private static Pattern myPattern;
private static Matcher myMatcher;
public static void main(String[] argv) { initResources();
processTest(); closeResources(); }
private static void initResources() { try {
myBufferedReader = new BufferedReader(new FileReader(“MatcherMethods.txt”));
}
catch (FileNotFoundException fnfe) {
System.out.println(“Cannot locate input file! “+fnfe.getMessage()); System.exit(0); }
try { myRegex = myBufferedReader.readLine(); testString = myBufferedReader.readLine();
}
catch (IOException ioe) {}
635

Chapter 25
myPattern = Pattern.compile(myRegex); myMatcher = myPattern.matcher(testString);
System.out.println(“Current myRegex is: “+myRegex); System.out.println(“Current testString is: “+testString);
}
private static void processTest()
{
StringBuffer myStringBuffer = new StringBuffer(); while (myMatcher.find())
{
myMatcher.appendReplacement(myStringBuffer, “Moon”);
} // end while loop myMatcher.appendTail(myStringBuffer); System.out.println(); System.out.println(myStringBuffer.toString());
}
private static void closeResources()
{
try{ myBufferedReader.close(); }catch(IOException ioe){}
}
}
2.Save the code as MatcherMethods.java; compile it; and at the command line, type javac MatcherMethods.java.
3.Type the following text in a text editor:
Star
Star Training Company is well known for high quality training. Star Training is currently offering special value training packages.
The preceding information other than the first word is all on one line in the file MatcherMethods.txt. It is shown wrapped on two lines for the convenience of printing.
4.Save the text as MatcherMethods.txt.
5.Run the Java code. At the command line, type java MatcherMethods, and inspect the results, as shown in Figure 25-5. Notice that each occurrence of the character sequence Star in the test string has been replaced by the character sequence Moon.
Figure 25-5
636

Regular Expressions in Java
How It Works
The key part of this example, as far as the Matcher object’s methods are concerned, is the use of the appendReplacement(), find(), and appendTail() methods.
A BufferedReader is used to accept the contents of MatcherMethods.txt:
myBufferedReader = new BufferedReader(new FileReader(“MatcherMethods.txt”));
The code in the processTest() method uses the appendReplacment(), find(), and appendTail() methods.
A myStringBuffer object is declared and instantiated as a new StringBuffer object:
StringBuffer myStringBuffer = new StringBuffer();
A while loop is used to progress through the test string. If a match is found, the myMatcher.find() method returns the boolean value of true, so the code in the while loop is executed:
while (myMatcher.find())
{
The appendReplacement() method progresses through the test character sequence, adding characters to the StringBuffer. If a match is found, the characters constituting the match are not added to the StringBuffer. Instead, the replacement text is appended to the string buffer. Matching continues in the test character sequence from a position immediately after the character sequence that was a match:
myMatcher.appendReplacement(myStringBuffer, “Moon”);
When no further matches are found, the while loop is exited:
} // end while loop
At this point, the string buffer contains the characters from the test character sequence up to the last match. The appendTail() method is used to append the remaining, nonmatching characters from the test character sequence to the StringBuffer:
myMatcher.appendTail(myStringBuffer);
A blank line is displayed to separate the test character sequence from the character sequence containing the replaced character sequence (assuming that a match was found). If there was no match, the original test character sequence and the “replaced” character sequence contain the same sequences of characters:
System.out.println();
The myStringBuffer object’s toString() method is used to allow the replaced string to be displayed using the println() method:
System.out.println(myStringBuffer.toString());
637