Well now I am in the middle of compiling a massive airolib database and I still can't figure out the reason behind the ignoring lines.
I spent a day downloading every wordlist I could find, including the few great ones on here, and in the end I had over 1000 wordlists, I then used a simple copy command in windows to copy everything into one file, which turned out to be ~7.15Gb.
Then I let airolib run for a couple days just importing the psswds and the top 1000 essid list, and the last time I checked before it finished it was at 590 million lines, with 198 million ignored.
And now I am batching it at 5,800,000 PMK going ~173 PMK/s.
I would like to pinpoint why 1.9 mil are ignored.