Page 1 of 2 12 LastLast
Results 1 to 10 of 19

Thread: Removing patterns from Numeric wordlist

Hybrid View

  1. #1
    Just burned his ISO
    Join Date
    May 2012
    Posts
    2

    Default Removing patterns from Numeric wordlist

    Numeric, and otherwise, wordlists have patterns that are unlikely to be utilized by software which creates the key based on 'random' digits. Repetition is an obvious one, but all patterns must go.

    0000000001
    0101010101
    89abcdef
    febf2cff (utilizing the 'f' 4/8 makes this key highly improbable to be generated randomly)

    Obviously, this can drastically reduce a wordlist's size; a necessity if you want to challenge larger keys.

    It seems this has been covered elsewhere but I cannot find a reference: Does anyone know of an existing program that does such a thing, or am I delusional? I realize there are numerous rudimentary ways to do this, but its seems as if there is already a program specifically for this. If not, its off to the coding board!

  2. #2
    Member
    Join Date
    Dec 2011
    Posts
    86

    Default Re: Removing patterns from Numeric wordlist

    everything can be done with sed, to remove a pattern:

    cat filename.txt > sed '/pattern/d' | cat outfile.txt should work

    also you can remove words with X amount of consecutive characters using sed, I don't know the function off the top of my head but you can find it in Tape's Word List Manipulator

  3. #3
    Moderated Member
    Join Date
    Oct 2011
    Posts
    44

    Default Re: Removing patterns from Numeric wordlist

    Thad0ctor what is a good way to contact you for a project idea?

  4. #4
    Very good friend of the forum TAPE's Avatar
    Join Date
    Jan 2010
    Location
    Europe
    Posts
    599

    Default Re: Removing patterns from Numeric wordlist

    Yeah, further to thad0ctor's message hereabove
    (by the way, your email as mentioned in your contact info in your script is not working thad0ctor)
    you can narrow down the outcome of wordlists created with
    for instance crunch by using a specific pattern which makes
    it more relevant to yourtarget.

    For details on crunch have a look at ;
    http://adaywithtape.blogspot.com/201...runch-v30.html
    and for simple wordlist manipulation have a look at ;
    http://adaywithtape.blogspot.com/201...revisited.html

  5. #5
    Member
    Join Date
    Dec 2011
    Posts
    86

    Default Re: Removing patterns from Numeric wordlist

    hey tape, I forgot there is a hyphen between tha and d0ctor but I lost the login info anyways

    edited
    Last edited by thad0ctor; 05-02-2012 at 10:07 PM.

  6. #6
    Very good friend of the forum TAPE's Avatar
    Join Date
    Jan 2010
    Location
    Europe
    Posts
    599

    Default Re: Removing patterns from Numeric wordlist

    Got it thanks

  7. #7
    Just burned his ISO
    Join Date
    May 2012
    Posts
    2

    Default Re: Removing patterns from Numeric wordlist

    Please, do not leave your garbage in my thread. Why bother posting if you do not fully read the OP or are posting regarding airoscript redux or any other bash front-ends(shortcuts) you have 'created'. BTW, that example is nasty, I am not sure how one can make shell scripts without having any clue about in/out redirection. No, that example should never work.I do not intend to be so rude, but damn, these replies are depressing. The OP said: "I realize there are numerous rudimentary ways to do this, but its seems as if there is already a program specifically for this.." not 'zomg how I make w0rdlistz'. I can only hope the eager few did not scare away the knowledgeable. So please, if you are one of the few who have already posted here, kindly stay away from my thread.

    The appropriate solution will do much more than some inline with regex. Not to mention, parsing multiple TB in such a way would be reckless, at best. The solution I am looking for will do more than just remove g 'a pattern' , it will remove 'ALL patterns'. The target is software that creates keys based on random digits.

    Like I said, it seems as if this has been covered before and a solid program exists for just this purpose. Of course if there is not, I do not mind creating something.

  8. #8
    Very good friend of the forum Gitsnik's Avatar
    Join Date
    Jan 2010
    Location
    The Crystal Wind
    Posts
    851

    Default Re: Removing patterns from Numeric wordlist

    Alright then here is a script that will remove duplicated letters. It's not going to remove all patterns, I'm not giving you anything in the area's of artificial networks, but you can figure out the extras for yourself.

    http://gitsnik.blogspot.com.au/2011/...nch-redux.html

    That will remove any duplicate characters in a line (read the page). I am not going to support it, don't ask me any questions, it works, if you can't use it that is your problem.

    Have a good read around the forums, your attitude will not go over well here.
    Still not underestimating the power...

    There is no such thing as bad information - There is truth in the data, so you sift it all, even the crap stuff.

  9. #9
    My life is this forum thorin's Avatar
    Join Date
    Jan 2010
    Posts
    2,629

    Default Re: Removing patterns from Numeric wordlist

    Quote Originally Posted by SomeNewbThatFeelsEntitled
    So please, if you are one of the few who have already posted here, kindly stay away from my thread.
    This thread is NOT yours.

    It belongs to an open community of volunteers that owe you absolutely nothing. If you wish this thread to be yours please feel free to spin up your own domain and server, start your own forums with no users, and post your question.

    Numeric, and otherwise, wordlists have patterns that are unlikely to be utilized by software which creates the key based on 'random' digits. Repetition is an obvious one, but all patterns must go.

    0000000001
    0101010101
    89abcdef
    febf2cff (utilizing the 'f' 4/8 makes this key highly improbable to be generated randomly)
    You seem to be operating under a false premiss. Repetition does not denote any failure of randomness. In fact removing seeming patterns and repetition simply removes valid outcomes. If a value is truly random then it's just as likely to contain repetition (00000) vs all unique values (12345). The fact that your 4th example contains 4fs out of 8 does not make it any more or less likely to be generated at random.

    The same applies for sequences and other patterns. If you randomly generate values you'll eventually see words (in any and all languages even) that doesn't render the value non-random. It simply means that someone interprets them as having meaning or a pattern.

    Consider the case for dual factor authentication and use of key fobs (i.e.: RSA tokens) if the developer(s) used some kind of pattern recognition on the generated values and dropped all duplicates or sequential values they'd simply be reducing the number of values an attacker has to attempt in order to hit a correct "randomly generated" one-time-password.
    Last edited by thorin; 05-07-2012 at 08:21 AM.
    I'm a compulsive post editor, you might wanna wait until my post has been online for 5-10 mins before quoting it as it will likely change.

    I know I seem harsh in some of my replies. SORRY! But if you're doing something illegal or posting something that seems to be obvious BS I'm going to call you on it.

  10. #10
    Member
    Join Date
    Dec 2011
    Posts
    86

    Default Re: Removing patterns from Numeric wordlist

    based on what you want you'll probably have to write a new bash script along the lines of:


    - crunch with your settings
    - pipe the output to sed to remove X consecutive characters
    - run a for loop for each line of output counting how many instances of each character there are in a line
    - pipe out the characters that did not fit the requirements
    - cat the output list into a word list

    I'll look into making a function like this, it sounds like a fun challenge and a cool feature for my tool kit but in the meantime you should reassess you attitude towards those who are trying to help you

Page 1 of 2 12 LastLast

Similar Threads

  1. Removing words from wordlist
    By CKing in forum Experts Forum
    Replies: 6
    Last Post: 04-18-2011, 05:00 AM
  2. Removing numbers from a wordlist.
    By oracx in forum Beginners Forum
    Replies: 2
    Last Post: 02-22-2010, 11:39 PM
  3. alpha-numeric wordlist
    By cain#1 in forum OLD Newbie Area
    Replies: 1
    Last Post: 06-28-2009, 03:03 AM
  4. Replies: 28
    Last Post: 10-23-2008, 10:28 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •