Based on a discussion on PaulDotCom
about creating custom word lists by spidering a targets website and
collecting unique words I decided to write CeWL, the Custom Word List
generator. CeWL is a ruby app which spiders a given url to a specified
depth, optionally following external links, and returns a list of words
which can then be used for password crackers such as John the Ripper.
By default, CeWL sticks to just the site you have specified and will go
to a depth of 2 links, this behaviour can be changed by passing
arguments. Be careful if setting a large depth and allowing it to go
offsite, you could end up drifting on to a lot of other domains. All
words of three characters and over are output to stdout. This length
can be increased and the words can be written to a file rather than
screen so the app can be automated.
Version 2 of CeWL can also create two new lists, a list
of email addresses found in mailto links and a list of author/creator
names collected from meta data found in documents on the site. It can
currently process documents in Office pre 2007, Office 2007 and PDF
formats. This user data can then be used to create the list of
usernames to be used in association with the password list.
CeWL also has an associated command line app, FAB
(Files Already Bagged) which uses the same meta data extraction
techniques to create author/creator lists from already downloaded.
Pronunciation
Seeing as I was asked, CeWL is pronounced "cool".
Download
download cewl version 2.1
For more information about installation & usage check
Technorati Tags: 
Post new comment