Wordlist Manipulator v3.0

[TAPE]

On a blogpost I put up a while back for the use of crunch
http://adaywithtape.blogspot.com/201...runch-v30.html

I was getting so many queries on how to create certain wordlists that fell just out of the scope
of what crunch is intended for that I decided to write a bit of code to make it easier than learning
all the sed / awk etc etc commands.

Pureh@te put out a wordlist tool a while ago, and it wasgood stuff and I basically took his
idea and ran with it a bit.

So, combining a well created wordlist together with known options to enable the creation of
a wordlist that is more how you want it to look.


To clarify;
crunch is IMO the best tool to create wordlists from scratch, but I simply wanted to enable an
easy way to modify wordlists to what may be the desired result for a specific target.

I have spent a bit of time on getting the list of options to what I
felt was relevant, and all things considered, I feel it came out OK.

In any case, all feedback, negative, constructive and otherwise
greatly appreciated.


WLM
====
Wordlist Manipulator v3.0 (messed up there... its 0.3 !!)

Blogpost;
http://adaywithtape.blogspot.com/201...revisited.html

Download Link;
http://www.mediafire.com/file/p1tn76qw95hobi4/wlm

ALL OPTIONS
-----------
1. Case Options;
1.1 Change case of first letter of each word in the wordlist.
1.2 Change case of last letter of each word in the wordlist.
1.3 Change all lower case to upper case.
1.4 Change all upper case to lower case.


2. Combination options;
2.1 Combine words from 1 list list to all words in another list.
2.2 Combine all wordlists in a directory to 1 big wordlist.


3. Prefix characters to wordlist;
3.1 Prefix numeric values in sequence (ie. 0-999)
3.2 Prefix fixed number of numeric values in sequence (ie. 000-999)
3.3 Prefix a word or characters to wordlist.
Some characters will require you to escape them using backslash (\)
also space does not work, so this function has some limitations.


4. Append / Suffix characters to wordlist;
4.1 Suffix numeric values in sequence (ie. 0-999)
3.2 Suffix fixed number of numeric values in sequence (ie. 000-999)
3.3 Suffix a word or characters to wordlist.
Some characters will require you to escape them using backslash (\)
also space does not work, so this function has some limitations.


5. Include characters
5.1 Include characters from a certain postion from start of word.
5.2 Include characters from a certain postion from end of word.
Some characters will require you to escape them using backslash (\)
also space does not work, so this function has some limitations.


6. Substitute/Replace characters
5.1 Include characters from start of word.
5.2 Include characters from end of word.
5.3 Substitute/Replace characters at specified positions in list.
Some characters will require you to escape them using backslash (\)
also space does not work, so this function has some limitations.


7. Optimize / tidy up wordlist.
7.1 Full optimization of wordlist. (Thanks to Pureh@te's wordlist_tools.sh)
7.2 Optimize for WPA (min 8 chars max 63 chars)
7.3 To be done.


8. Split options
8.1 Split wordlists based on a user defined max linecount in each slit file.
8.2 Split wordlists based on a user defined max size of each split file.


9. Removal / Deletion options
9.1 Remove characters at a certain position from start of word.
9.2 Remove characters at a certain position before end of word.
9.3 Remove specific characters globally from words.
9.4 Removing words containing specific characters from wordlist.
9.5 Remove words with more than X number of identical adjacent characters from wordlist
9.6 Remove words existing in 1 list from another list (test version only for small lists)


10. Miscellaneous fun
10.1 Check possible wordlist sizes (with same min-max length only).
10.2 Included a new version of datelist able to handle all dates.
10.3 Strip SSIDs from a kismet generated .nettxt file.


f.File information
Gives information on aspects of selected file ;
- Filetype
- Wordcount of file
- Longest line
- File Size
- first 3 and last 3 lines of file

The only improvements not included are the 'datelist v0.6' improvements
that were recently included in my datelist script.
http://adaywithtape.blogspot.com/201...-wordlist.html



In any case, if it proves useful, or not at all, or too buggy ( :-| ) then please let me know.


Thanks - TAPE

[TAPE]

Hey guys,

Just wanted to say that have released v0.4 of WLM
Can be downloaded here (I'm too stupid to get my google code page looking right...) ;
http://www.mediafire.com/file/p1tn76qw95hobi4/wlm

Basic updates from v0.3 as follows ;

#0.4
# > Included possibility to invert the case in words (lower->upper & upper->lower).
# > Included basic error checks to the datelist script to avoid erroneous input.
# > Included possibility to remove words that do not have X number of numeric values.
# > Included possibility to remove words with N number of repeated characters.
# > Included basic leetifying options, not terribly happy with how that is done, but suppose better than nothing.
# > Temporary (? ) inclusion of Gitsnik's great permute.pl script also able to run on direct input
# pending my pitiful bash endeavours to reproduce the same thing..

Just run the file to start it up (may require a 'chmod 755 wlm_v0-4' to make it executable)
or it you run it followed by a word then it will run Gitsnik's permute.pl script over the word.

./wlm_v-04 awesome

http://adaywithtape.blogspot.nl/2011...revisited.html

[thad0ctor]

nice man! can't wait to add this to my next release

[line08]

went thru the options but couldn't find 1 that allow me to insert a new word at any particular line (eg: i would like to insert a word at line 1).
is this possible?

[TAPE]

Such options are not included, but you could easily do that using sed or the like ;
Include the word BOOYAH after line number 5 in a wordlist file ;

 
sed '5a BOOYAH' -i wordlist.txt

Include the word BOOYAH before line number 5 in a wordlist file ;

sed '5i BOOYAH' -i wordlist.txt

[TAPE]

Hey guys,

Have updated WLM to v0.5

Script download link ;
http://www.mediafire.com/file/p1tn76qw95hobi4/wlm


Update on the Blogpost (with link to video)
http://adaywithtape.blogspot.nl/2011...revisited.html

Video actually done using different distro, but written to work on BackTrack.

0.5 Released 20-08-2012
> Fixed bug in datelist script that ignored July month -- Thanks to Stepking2
> Fixed bug in datelist leapyear script that caused whole century years to ignore Feburary -- Thanks to Stepking2
> Fixed bug in removal of last characters in word in menu option 9
> Replaced repetetive code with functions

[thad0ctor]

very nice TAPE, I can't wait to check this out and add v0.5 to my script, keep up the good work!

[line08]

Such options are not included, but you could easily do that using sed or the like ;
Include the word BOOYAH after line number 5 in a wordlist file ;

 
sed '5a BOOYAH' -i wordlist.txt

Include the word BOOYAH before line number 5 in a wordlist file ;

sed '5i BOOYAH' -i wordlist.txt

exactly what i was looking for, thx

[TAPE]

Hey guys,

Have released version 0.7 of Wordlist Manipulator and have now included a rudimentary
update possibility, which should make it easier for users to check for updates in the future.
Therefor no longer a version indicator in the download link.




Download link ;
http://www.mediafire.com/file/p1tn76qw95hobi4/wlm


Changes since v0.5 (for some reason I didnt really officially release v0.6..)

#0.6 Released 26-09-2012
# > Made all menus and queries, which weren't already, uniformly presented where possible.
# > Included 7.3 Wordlist optimization option (sort on word/string length)
# > Deleted the unused 8.3 menu option.
# > Inlcuded option to delete words of a certain length from file.
#
#0.7 Released 21-10-2012
# > Updated split options by including the -a switch variable to allow for sufficient suffix numbers depending on
# number of files which will be created when splitting files on linecount based on user input.
# > Included rudimentary update function. To be improved..

Pleased to hear of any bug reports that may crop up !
(wanting to test the update function.. )

[TAPE]

Google Code page for more clarity & explanation on the tool usage;

http://code.google.com/p/wordlist-manipulator/