AZdecrypt 1.19

[Jarlve]

AZdecrypt 1.14 release added to the main page:

What has changed?

First of all a big thank you to beijinghouse for his code contributions:

- beijinghouse recoded the loading routine and it is now loads n-grams up to 20 times as fast! It also supports loading n-gram files directly from .gz files.
- beijinghouse also made some speed optimizations to the variable types, random number generator and IOC calculations of the solver and this sped up the solvers by up to 10%.
- beijinghouse excellent all-around 6-grams are included with the download. I like to see these as a 6-gram version of the Practical cryptography 5-grams.
- Download link to beijinghouse's 7-grams: https://drive.google.com/open?id=1eEWCO ... 29c2ijw3_f

is there how to rearrange varies columns at the same time ??! I say, for example, use an argument as 3,2,4,7,8,10,17,1,5,6,9,11,12,13,14,15,16.

- @ Marclean: added, go to Functions, Transposition and look for Rearrange columns or rows. In the A1 "key#" field enter a key such as you described separated by commas or spaces.

The text in the input window is now transposed correctly. If you now click on "Solve", the cipher will still be solved. Apparently the previously loaded cipher is still stored somewhere. If you copy the transposed cipher and insert it again, "Solve" does not lead to any result anymore (as desired). Something is obviously not updated correctly.

- @ Largo: issued, this was actually part of some hidden functionality which is now disabled.
- Renamed the "Substitution + transposition" to "Substitution + simple transposition" and added an interface. All transposition operations that have a smaller set of possible arguments will be housed here. Added Spiral and L-route transpositions as well as Largo's Split transposition idea:

I've added this transposition to my solver for the next AZdecrypt release. It has solved your cipher and no results on the 340 so far. It can pick any set of dimensions and then make a horizontal or vertical split at any offset of which each part could have its own transposition (none, mirrored, flipped, columnars, diagonals).

- Improved "Substitution + row bound" solver.
- Improved the solve rate of mostly all solvers a bit.
- Added solver "Substitution + crib list" by request of beijinghouse. Go to the Misc folder and look to the readme.txt for an explanation. It basically allows you to batch cribs at the positions of your choosing.
- Included a new build of my Reddit n-grams. These are great when first-person language is expected such as the Zodiac communications.
- Fixed issue with status display. MIPS is now more accurate. Also added the average IOC.
- Compiled with the new 2019 FreeBASIC 1.06.0 release.
- Many bug fixes. New source can be found in: https://drive.google.com/open?id=0B5r0r ... mljRWJvYkU

Updated the readme.txt with added names of the people that have helped me over the years plus some links to other people's work. Let me know if I have forgotten you!

Code: Select all

- Many thanks to the people of the FreeBASIC forum for helping me out with code issues: counting_pine, dodicat, fxm, Lothar Schirm, MichaelW, MrSwiss, PaulSquires and many more.
- Many thanks to the people of the Zodiackillersite cipher forums for their help and support: daikon, doranchak, glurk, Largo, Marclean, Mr lowe, smokie treats and many more.
- Thanks to Geoff L. (smokie treats) for helping me design and test the "nulls and skips" solver and for the creation of countless test ciphers and cipher statistics.
- Thanks to beijinghouse @ www.zodiackillersite.com for:
--> Providing excellent all-around n-grams that were compiled from a 3TB corpus.
--> Recoding the n-gram loading routine so that it is up to 20 times faster and the added support for loading n-grams directly from .gz files.
--> Several code speed optimizations to the solvers which increase the MIPS by up to 10%.

David Oranchak's Zodiacs Ciphers wiki: http://zodiackillerciphers.com/wiki/index.php?title=Main_Page
glurk's zkdecrypto: https://code.google.com/archive/p/zkdecrypto/
Largo's Peek-a-boo: http://www.zodiackillersite.com/viewtopic.php?f=81&t=3255


[beijinghouse]

Great work Jarlve!

Thanks for incorporating the speedups I found into the main code so quickly.

Excited to see what everyone here can do with the new 6-grams and 7-grams too.

For those who haven't tested my n-grams yet, here's a few quick examples of how they tend to get slightly better solves on a handful of semi-tricky ciphers:

cipher_information=fortyfeet
v\0^/v::^T:C\U^U\=3CC3\X-\+X2o.0:T+03:2

Code: Select all

beijinghouse                                 reddit
FORTYFEETBELOWTWOMILLIONSOUNDSAREBURIED      NTRDONEEDBESTODOTHISSITACTUALLYREBURIEL


cipher_information=mobyelectra_numerals
cywfsbcrrjkcetbil
fpxmdfrifryqgjfyh
ftpnfoitwmgcabynt
pivjktwmdcvgsivxk
zgqmdcvgrxafkrhme
snfoikxagcabymein
tdmuqybqximeidmuq
ybqjieckxrga

Code: Select all

beijinghouse           reddit
ITWASHIDDENINTHEM      ITTATHISSPAINYHEW
AHAOFADEADTREEATM      ASNOFASEASTELPATW
ATHSAVETWOEIGHTST      AYSMAKEYTOLIGHTMY
HELENTWOFILESELAN      SERPAYTOFIRLTERNA
DEROFILEDAGANDMON      BLEOFIRLSNGAASWON
SSAVENAGEIGHTONES      TMAKEANGLIGHTONEM
TFOURTHRAEONEFOUR      YFORETHENEONEFORE
THREENINADEG           THEPENIANSLG


cipher_information=largo2_names
CDmDCRn7UgeVKdUZ3
SFUJQ+IY4SIqPdas2
I-AEozZEZBtXMJKG1
qbp-GQSKNAT7AjVjg
BFLSkl0Rl0CCnoWeM
XhUgjKOG2XbH7J3Ip
ABi64tpkx0xl0Cung
EKKB1ULhP+Ge+z+II
TbXdtjVfdQB1NiPWH
MZQ6VU5IABFLSv0m0
CwnIj21EyHtp2236z
6IZ4oWsr1ZsFOQLA1
LE2Uoi-cV36FJgBFL
y-rc0xv0CwngMBqSW
qMK6rY1j+doHo814N
JWrcNVdbz1YOhUgBi
S3tpklDkkDCwnc5LY
GKXyrcVr-3IXUW84F
WKGABFL+WpajGKW87
PZTXS4yFZT18-1qbr

Code: Select all

beijinghouse           reddit
TODOTHEROBERTDOMI      TIFITWEROMARTDOMI
NGOSANDLINDAEDWAR      NGOSANDLINDOEDWAR
DSBECAMEMYFIRSTSL      DSBECAMEMYFIRSTSL
AVESSANTABARBARAB      OVESSANTABARBARAM
YGUNSTOHTOTTECHER      YGUNSHOWHOTTECHAR
IDOBATESRIVERSIDE      ITOMATESRIVERSIDE
BYKNIFESTOTTOTHEB      BYKNIFESTOTHOTHEM
ETTYLOUDENSENANDD      ETTYLOUTENSANANDD
AVIDFARADAYLAKEHE      AVIDFARADAYLAKEHE
RMANROADBYGUNTODO      RMANROADBYGUNTOFO
THEDARLENEFERRINA      THEDARLENEFERRINA
NDMICHAELMAGEAUBL      NDMICHAELMAGEAUBL
UEROCKSPRINGSBYGU      UEROCKSPRINGSMYGU
NSEPOTTOTHEBRYANH      NSEPOTTOTHEMRYONH
ARTNELLANDCECELIA      ORTNELLANDCECELIA
SHEPARDVALLEDOBYK      SHEPARDVALLETOMYK
NIFESTOSSOTHEPAUL      NIFESHISSITHEPAUL
STINEPRESIDIOHEIG      STINEPRESIDIOHEIG
HTSBYGUNHEWASTHER      HTSBYGUNHEWASTHER
EMAININGMALESLAVE      EMAININGMALESLOVE


[DMW]

This is the coolest thing ever! Thank you, thank you, thank you!

[Jarlve]

Forgot to mention that the Create transposition matrix function is also spruced up a little bit with the addition of transpose and untranspose buttons which act directly upon the cipher in the input window. As a reminder: it is possible to draw straight lines and diagonals by right-mouse clicking from your last entry.

[Largo]

Hey Jarlve and beijinghouse,

many thanks to both of you for this really cool update! It's really great when people work together and develop awesome things. Sooner or later the time comes when z340 will be broken!

Translated with www.DeepL.com/Translator

[smokie treats]

Thank you very much for the update. I have plans to use it on a project next weekend, which I will post. Thanks again.

[doranchak]

Amazing work! Thanks again for the excellent updates!

[smokie treats]

Jalrve: What ngram files should I use with the rows bound option? Can you make those available? Also, what is the name of the ngram file for the first person language? Thanks.

[Jarlve]

Thanks beijinghouse, DMW, Largo, smokie treats and doranchak.

Jalrve: What ngram files should I use with the rows bound option? Can you make those available? Also, what is the name of the ngram file for the first person language? Thanks.

The row bound solver uses the Reddit n-grams automatically and these come with the download. By default it will include 3, 4 and 5-grams but you can make it include 6-grams also by first loading the "6-grams_english_jarlve_reddit.txt" file. Any of the Reddit n-grams are great for first person language.

[smokie treats]

Jarlve: How long should I run something like this for...?
?
1 101 37 44 11 56 8 60 31
4
55 3 3 102 53 4 32 11 5
11 25
21 37 8 2 50 51 8 50 16
3 33 26 10
22 16 61 7 25 53 36 48 103
11 14 56 43 40
46 3 57 22 16 5 61 52 3
6 59 40 63 9 27 62
42 37 51 58 104 20 29 37 51
40 51 30 31 29 42 20 31
18 35 7 49 30 59 40 63 55
38 36 34 50 56 7 26 21 36
40 54 41 18 61 8 37 33
51 1
29 38 48 30 50 36 39 15
105 17 5
50 41 106 41 27 37 21 107
36 108 40 48 39
44 31 49 3 23 5 109 44
20 45 12 36 46 44
5 110 6 16 46 36 51 31
63 18 35 21 111 1 30 58
34 43 48 55 36 27 62 34
29 42 32 47 5 6 54 56
2 20 112 30 50 10 28 13
4 22 39 45 9 4 13
5 23 15 5 113 16 11
7 25 21 114 53 21
8 26 33 115 10
10 28 22 31
11 29 40 16
13 31 41
14 32
16
17
11 55 33 13
116 36 28 12 7 22 11 11 117 51 18 15 51 52 3 1 33
20 5 3
118
37 10 26 13 20 53 16 11 14 20 43 34 119 40 25 54
5 47 5 36 21 6
18 29 26 56 23 2 28 20 28 14 20 53 47
17 15 120 7 40 6 38 24 9
42 20 23 51 28 38 53 58 20 23
16 121 6 122 32 24 23 17 8 26 27 12
23 23 14 20 57 55 123
34 15 47 6 50 124 39 23 38 17 51 23 13 30 15