AlbanianWizard

Hi,

So here the problem , I have a really big 8GB wordlist file with very good pwd’s generated from the best password list files on the net. At first, after catting all and putting in the same place I thought that would be better to split the big file in mini files so (thought wrong, but anyway) :

[cc lang="BASH"]
split –bytes=35MB -d -a 3 aw-bruto.txt
[/cc]

–bytes to specify the size of this “mini” files, -d to say I want them “numbered” and -a to specify the suffix lenght.

So I got a list with many files named x001 => x225 and now I want to sort them in order to get a single file but sorted -u

so:
[cc lang="BASH"]
cat * | sort -u –compress-program=bzip2 –debug >> aw-sorted.txt
[/cc]

-u to remove all dupplicated passwords.
What’s next?

I had also to remove the mess of unwanted characters binary etc, so:
[cc lang="BASH"]cat aw-sorted.txt | tr -cd ‘\11\12\40-\176′ >> aw-clear.txt
cat aw-clear.txt | tr -cd [:cntrl:] >> aw-clear1.txt
[/cc]

man tr for more info.
Than you can modify with john, or crunch and than split the file with pw-inspector (you need hydra installed) and modify the pwd’s as you whish.