{"id":507,"date":"2009-02-13T07:21:14","date_gmt":"2009-02-13T12:21:14","guid":{"rendered":"http:\/\/itp.indiamos.com\/blog\/?p=507"},"modified":"2009-04-14T01:23:25","modified_gmt":"2009-04-14T06:23:25","slug":"jane-says","status":"publish","type":"post","link":"https:\/\/itp.indiamos.com\/blog\/2009\/02\/13\/jane-says\/","title":{"rendered":"\u201cHave you seen my wig around?\u201d"},"content":{"rendered":"

\"Jane<\/a><\/p>\n

This week’s A2Z assignment was as follows:<\/p>\n

Make a program that creatively transforms or performs analysis on a text using regular expressions. The program should take its input from the keyboard and send its to the screen (or redirect to\/from a file). Your program might (a) filter lines from the input, based on whether they match a pattern; (b) match and display certain portions of each line; (c) replace certain portions of each line with new text; or (d) any combination of the above.<\/p>\n

Sample ideas: Replace all words in a text of a certain length with a random word; find telephone numbers or e-mail addresses in a text; locate words within a word list that will have a certain score in Scrabble; etc.<\/p>\n

Bonus challenge 1: Use one or more features of regular expression syntax that we didn\u2019t discuss in class. Reference here.<\/p>\n

Bonus challenge 2: Use one or more features of the Pattern or Matcher class that we didn\u2019t discuss in class. Of particular interest: regex flags (CASE_INSENSITIVE, MULTILINE), \u201cback references\u201d in replaceAll. Matcher class reference here.\n<\/p><\/blockquote>\n

So, what I made is a program that tries to find the proper names in the input text (my preferred input being the first scene of Pride and Prejudice<\/cite>) and replace them with names of people in our class. For my purposes, a proper name is any capitalized word that (a) follows an honorific, such as Mr., Mrs., Sir, Lady, or Miss, or<\/em> (b) does not immediately follow a carriage return or chunk of terminal punctuation (i.e., a period, exclamation point, or question mark, with or without a closing quotation mark thereafter), and (c) is neither a day of the week, a month of the year, nor the name of a holiday (though the only holiday it’s really looking for is Michaelmas, as that’s what appears in my P&P extract).<\/p>\n

I tried for hours to do this in a compact way, by looking for the absence<\/em> of certain words or characters (terminal punctuation, honorifics, days of the week, holidays) combined with the presence<\/em> of other patterns, but it just would not fly. So the result requires a lot of intermediate steps, to avoid changing words that have been identified as not likely to be names. In a vain attempt to make testing my regular expressions quicker, I worked them out in BBEdit first, using the grep option in the search and replace panel. Saved me from having to recompile the thing fifty thousand times. And the expressions worked<\/em> in BBEdit, for the most part. They do not<\/em> work so well translated into Java, unfortunately—the success rate at finding names is much lower, and after ten straight hours, I just didn’t have the patience to troubleshoot it any more. But these glitches just make the results more funny, which is, of course, the point.<\/p>\n

So, here is the code:<\/p>\n

[java]import java.util.regex.*;
\nimport com.decontextualize.a2z.TextFilter;<\/p>\n

public class RegexNames extends TextFilter
\n{
\n public static void main(String[] args)
\n {
\n new RegexNames().run();
\n } \/\/ end main(String[] args)<\/p>\n

private String search1 = “(Mr\\\\.|Mrs\\\\.|Lord|Lady|Sir) ([A-Z]\\\\w+)”;
\n private String replace1 = “##NAME##”;<\/p>\n

private String search2 = “(\\\\.\u201d |\\\\?\u201d |!\u201d |\\\\. |\\\\? |! |\\\\r|\\\\r\u201c)([A-Z]\\\\w+)”;<\/p>\n

private String search3 = “( |\u201c|\\\\r)(Mr\\\\.|Mrs\\\\.|Lord|Lady|Sir|Miss|Monday|Tuesday|Wednesday|Friday|Saturday|Sunday|January|February|March|April|May|June|July|August|September|October|November|December|Michaelmas)”;<\/p>\n

private String search4 = “( |\u201c)([A-Z][a-z]+)”;<\/p>\n

private String [] class_names = new String [] {
\n “Adam”, “Alejandro”, “Andrew”, “Bryan”, “Caroline”, “Dimitris”, “Jonathan”, “Joseph”, “Martin”, “Michael”, “Ozge”, “Sanjay”, “Steven” };
\n public void begin()
\n {
\n println(“* * *”);
\n }<\/p>\n

public void eachLine(String line)
\n {
\n String line_new;<\/p>\n

Pattern p1 = Pattern.compile(search1);
\n Matcher m1 = p1.matcher(line);
\n if (m1.find())
\n {
\n line = line.replaceAll(m1.group(2), replace1);
\n }<\/p>\n

line_new = line;<\/p>\n

Pattern p2 = Pattern.compile(search2);
\n Matcher m2 = p2.matcher(line_new);
\n if (m2.find())
\n {
\n line_new = line_new.replaceAll(m2.group(2), “##” + m2.group(2) + “##”);
\n }<\/p>\n

Pattern p3 = Pattern.compile(search3);
\n Matcher m3 = p3.matcher(line_new);
\n if (m3.find())
\n {
\n line_new = line_new.replaceAll(m3.group(2), “##” + m3.group(2) + “##”);
\n }<\/p>\n

Pattern p4 = Pattern.compile(search4);
\n Matcher m4 = p4.matcher(line_new);
\n if (m4.find())
\n {
\n line_new = line_new.replaceAll(m4.group(2), “##NAME##”);
\n }<\/p>\n

line_new = line_new.replace( “##NAME##”, class_names[(int)(Math.random() * 13)] );<\/p>\n

line_new = line_new.replace( “##”, “” );<\/p>\n

println(“\\t” + line_new);
\n } \/\/ end eachLine(String line)<\/p>\n

public void end()
\n {
\n println(“* * *”);
\n }<\/p>\n

} \/\/ end RegexNames extends TextFilter[\/java]<\/p>\n

And here is the output (you can find the original text at Project Gutenberg<\/a>):<\/p>\n

* * *
\n     It is a truth universally acknowledged, that a single man in possession of a large fortune must be in want of a wife.
\n     However little known the feelings or views of such a man may be on his first entering a neighbourhood, this truth is so well fixed in the minds of the surrounding families, that he is considered the rightful property of someone or other of their daughters.
\n     \u201cAdam dear Mr. Adam,\u201d said his lady to him one day, \u201chave you heard that Netherfield Park is let at last?\u201d
\n     Mr. Bryan replied that he had not.
\n     \u201cSteven it is, returned she; \u201dfor Mrs. Steven has just been here, and she told me all about it.
\n     Mr. Michael made no answer.
\n     \u201cDimitris you not want to know who has taken it?\u201d cried his wife impatiently.
\n     \u201cYOU want to tell me, and I have no objection to hearing it.\u201d
\n     This was invitation enough.
\n     \u201cSteven, my dear, you must know, Mrs. Steven says that Netherfield is taken by a young man of large fortune from the north of England; that he came down on Monday in a chaise and four to see the place, and was so much delighted with it, that he agreed with Mr. Morris immediately; that he is to take possession before Michaelmas, and some of his servants are to be in the house by the end of next week.\u201d
\n     \u201cJoseph is his name?\u201d
\n     \u201cAdam.\u201d
\n     \u201cDimitris he married or single?\u201d
\n     \u201cBryan! Single, my dear, to be sure! A single man of large fortune; four or five thousand a year. What a fine thing for our girls!\u201d
\n     \u201cHow so? How can it affect them?\u201d
\n     \u201cBryan dear Mr. Bryan,\u201d replied his wife, \u201chow can you be so tiresome! You must know that I am thinking of his marrying one of them.\u201d
\n     \u201cOzge that his design in settling here?\u201d
\n     \u201cCaroline! Nonsense, how can you talk so! But it is very likely that he MAY fall in love with one of them, and therefore you must visit him as soon as he comes.\u201d
\n     \u201cI see no occasion for that. You and the girls may go, or you may send them by themselves, which perhaps will be still better, for as you are as handsome as any of them, Mr. Michael may like you the best of the party.\u201d
\n     \u201cMichael dear, you flatter me. I certainly HAVE had my share of beauty, but I do not pretend to be anything extraordinary now. When a woman has five grown-up daughters, she ought to give over thinking of her own beauty.\u201d
\n     \u201cJonathan such cases, a woman has not often much beauty to think of.\u201d
\n     \u201cMichael, my dear, you must indeed go and see Mr. Michael when he comes into the neighbourhood.\u201d
\n     \u201cSteven is more than I engage for, I assure you.\u201d
\n     \u201cJonathan consider your daughters. Only think what an establishment it would be for one of them. Sir Jonathan and Lady Lucas are determined to go, merely on that account, for in general, you know, they visit no newcomers. Indeed you must go, for it will be impossible for US to visit him if you do not.\u201d
\n     \u201cSanjay are over-scrupulous, surely. I dare say Mr. Sanjay will be very glad to see you; and I will send a few lines by you to assure him of my hearty consent to his marrying whichever he chooses of the girls; though I must throw in a good word for my little Lizzy.\u201d
\n     \u201cI desire you will do no such thing. Lizzy is not a bit better than the others; and I am sure she is not half so handsome as Michael, nor half so good-humoured as Lydia. But you are always giving HER the preference.\u201d
\n     \u201cAndrew have none of them much to recommend them,\u201d replied he; \u201cthey are all silly and ignorant like other girls; but Lizzy has something more of quickness than her sisters.\u201d
\n     \u201cMr. Bryan, how CAN you abuse your own children in such a way? You take delight in vexing me. You have no compassion for my poor nerves.\u201d
\n     \u201cCaroline mistake me, my dear. I have a high respect for your nerves. They are my old friends. I have heard you mention them with consideration these last twenty years at least.\u201d
\n     Mr. Dimitris was so odd a mixture of quick parts, sarcastic humour, reserve, and caprice, that the experience of three-and- twenty years had been insufficient to make his wife understand his character. HER mind was less difficult to develop. Dimitris was a woman of mean understanding, little information, and uncertain temper. When she was discontented, she fancied herself nervous. The business of her life was to get her daughters married; its solace was visiting and news.
\n* * *<\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"

This week’s A2Z assignment was as follows: Make a program that creatively transforms or performs analysis on a text using regular expressions. The program should take its input from the keyboard and send its to the screen (or redirect to\/from a file). Your program might (a) filter lines from the input, based on whether they … Continue reading \u201cHave you seen my wig around?\u201d<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[26,4,35],"tags":[],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3qY10-8b","_links":{"self":[{"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/posts\/507"}],"collection":[{"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/comments?post=507"}],"version-history":[{"count":13,"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/posts\/507\/revisions"}],"predecessor-version":[{"id":619,"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/posts\/507\/revisions\/619"}],"wp:attachment":[{"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/media?parent=507"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/categories?post=507"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/itp.indiamos.com\/blog\/wp-json\/wp\/v2\/tags?post=507"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}