Not sure if that interesting girl on IM is a girl? Use the Gender Guesser.

While on yelp.com I was in a thread where a few people thought a user had created a fake profile to promote his business, and someone mentioned there had been a study done that found gender differences in writing, and then created a program to analyze writing and determine the gender. I put the “girl”‘s comments in and it came out as “weak male,” but so did almost everyone’s posts. Either way, it’s an interesting concept and fun to play around with.

In 2003, a team of researchers from the Illinois Institute of Technology and Bar-Ilan University in Israel (Shlomo Argamon, Moshe Koppel, Jonathan Fine, and Anat Rachel Shimoni) developed a method to estimate gender from word usage. Their paper described a Bayesian network where weighted word frequencies and parts of speech could be used to estimate the gender of an author. Their approach made a distinction between fiction and non-fiction writing styles.

A simplified version of this work was implemented as the Gender Genie. They showed that fewer words were needed and that writing styles varied based on the forum. For example, fiction and non-fiction differs from blogs (informal writing). Even though the genres differ, there are still gender-specific word frequencies.

This Gender Guesser system is heavily based on the Gender Genie. In particular, the word lists and weights are reproduced from the Gender Genie. The Gender Guesser extends the interpretation of informal writing to work on blogs and chat-room messages, and combines formal writing styles (fiction, non-fiction, essays, news reports, etc.). It also looks for weak emphasis — used to distinguish European English from American English. In general, if the difference between male and female weight values is not significant (a “weak” score), then the author could be European. This is because the weight matrix is biased for distinguishing genders in American English.

Gender Guesser