Page 9 of 29

Re: AZdecrypt WinGUI

PostPosted: Tue Dec 12, 2017 9:01 am
by Largo
Hi, Jarlve,
I just noticed a small problem: The button "Stop Tasks" also leads to a shutdown when the corresponding option is switched on and the batch solver is running. But there's no hurry, don't worry. I just wanted to let you know

Re: AZdecrypt WinGUI

PostPosted: Wed Dec 13, 2017 9:38 am
by Jarlve
Largo wrote:Hi, Jarlve,
I just noticed a small problem: The button "Stop Tasks" also leads to a shutdown when the corresponding option is switched on and the batch solver is running. But there's no hurry, don't worry. I just wanted to let you know

Nice catch Largo, thank you for your continuing effort to report back these issues to me! It is much appreciated.

Re: AZdecrypt WinGUI

PostPosted: Sat Dec 30, 2017 2:35 pm
by Largo
Hey Jarlve,

this is a "Fake P19" cipher I've generated with my statistics tool (plaintext from project gutenberg "Dracula"). P19 contains significantly more Bigrams than P1. AZDecrypt solves it very fast in the normal solving mode. But when I untranspose it by P19 and feed it to the transposition solver, no solution is found. I'm not sure...does the transposition solver supports "Transpose Period n" or just "Untranspose Period n"? Or is the "fake period" the reason it's not solved?


Code: Select all
mn9QSoWXpjxqTrK0A
UsBLkCuutVmMhnYyo
bljSpZWqkJrDNsKvG
AXzcLl1xt7OBimY2T
4hFJndZPMo3ye0Czb
jxpcUkl5VDNwJ!W6u
uqSAKvXdTr!O4fs12
tULP8YBVZeCjWymDS
nQHAokBM3zpXbJqIc
Nw5dvr8C0xeustgGm
7ODinAfoHBp7qCbJg
61DuA2frcIG3T4sBu
CKltmjDkAlLP0jUnd
JBeJYOVS!1yb2CcJZ
3DHIdGA7o0PupqH1z
BWJCXrT!eMkxOUVPS
uOT2yb3Jc01sUVtQI
Dml2znPGj8OJdNAu!
P5JoeKbgO630xpwqL
1HrJcM!P4J5SksTtl

Re: AZdecrypt WinGUI

PostPosted: Sun Dec 31, 2017 3:25 am
by Jarlve
Largo wrote:this is a "Fake P19" cipher I've generated with my statistics tool (plaintext from project gutenberg "Dracula"). P19 contains significantly more Bigrams than P1. AZDecrypt solves it very fast in the normal solving mode. But when I untranspose it by P19 and feed it to the transposition solver, no solution is found. I'm not sure...does the transposition solver supports "Transpose Period n" or just "Untranspose Period n"? Or is the "fake period" the reason it's not solved?

The AZdecrypt transposition solver supports both transposition and untransposition for all its operations.

The fake period is getting in the way. That is by design as it uses a bigram beam search to find good operations. This is why it works so well most of the time, but not all of the time. It is possible to replace the bigram beam search with the substitution solver itself but it would slow down the search to a crawl - something for later perhaps. Workaround, go to options, solver, and change the bigram beam states variable from 729 to 1. This will remove the bigram beam search from the equation and then fake bigrams will no longer affect the solver. Take in mind though that the solver will need a much longer time to find the operation. Perhaps change the operation stack size to 1 also.

Re: AZdecrypt WinGUI

PostPosted: Sun Dec 31, 2017 7:23 am
by Largo
Thank you for the explanation! I'll experiment with it, maybe I'll get new ideas.

But I have another question, if you don't mind:
Some time ago I worked on a proof-of-concept tool that can solve monoalphabetic substitutions distributed over the network. My solver uses a hillclimber in combination with simulated annealing, based on n-grams. This works quite well, but I have not managed to extend the solver in such a way that homophonic substitutions can be solved too. I think I remember that we talked about it once, but I can't find any details in the forum. How did you handle this in AZDecrypt? Where do you have the necessary knowledge? Have you thought up the procedures yourself or can you tell me about websites or papers that can help me? Unfortunately, I cannot estimate how much work it takes to write a very basic solver for "simple" homophone substitutions. My monoalphabetic solver should be a solid basis, shouldn't it?

Re: AZdecrypt WinGUI

PostPosted: Mon Jan 01, 2018 3:20 am
by Jarlve
Largo wrote:Some time ago I worked on a proof-of-concept tool that can solve monoalphabetic substitutions distributed over the network. My solver uses a hillclimber in combination with simulated annealing, based on n-grams. This works quite well, but I have not managed to extend the solver in such a way that homophonic substitutions can be solved too.

Just extend it and it should work.

Largo wrote:How did you handle this in AZDecrypt?

Randomly initialize a symbol to letter key. Then have a loop that determines the iterations. Inside this loop go through the following procedure. Make one random change to the symbol to letter key, for instance, symbol 63 becomes letter L. Score the change with ngrams + ioc normalization, if improvement then keep the change, if not then discard it + your simulated annealing stuff and repeat.

Largo wrote:Where do you have the necessary knowledge? Have you thought up the procedures yourself or can you tell me about websites or papers that can help me?

I did not have any knowledge. I cannot think of a single paper that will actually help you. Just extend your current solver.

Re: AZdecrypt WinGUI

PostPosted: Tue Jan 02, 2018 3:51 am
by Largo
Thanks for the informations, I'll try it!

However, I have another question, if you don't mind:

The solutions issued by the transposition solver contain information about the transposition used. Like so:

Code: Select all
Offset column order (51*7, X: 15)
Flip (305*2)


How can I reproduce this via the transposition menu in AZDecrypt? The details do not seem to match the fields A1-A8 and their corresponding instructions. How do I have to do that? I have tried quite a few things, but unfortunately I have not been successful. Thanks in advance.

Re: AZdecrypt WinGUI

PostPosted: Tue Jan 02, 2018 9:44 am
by Jarlve
51*7, these are the dimensions, x=51, y=7. You will need to set it manually through the dimensions menu and the same for 305*2.

Re: AZdecrypt WinGUI

PostPosted: Sun Jan 07, 2018 7:31 am
by Jarlve
Hey all.

Sorry to say that my cryptology work and forum activity/visits will be minimal for 2018, reason is that I want to move into other things. In the meantime I still want to offer support for AZdecrypt and if there is anything else you think I need to see contact me at: jaahrolov.ec@oym (untranspose it with period 2).

Re: AZdecrypt WinGUI

PostPosted: Sun Jan 07, 2018 5:00 pm
by smokie treats
Jarlve wrote:Hey all. Sorry to say that my cryptology work and forum activity/visits will be minimal for 2018, reason is that I want to move into other things.


I started feeling the same way several weeks ago. I too need to move on to other endeavors. I won't be gone completely, but am at a point where I feel that I have few new ideas to share and am just ready for a new chapter. Thanks for everything that you have done. Your contribution was substantial, amazing, and will not be repeated. We had a connection, and I really had a lot of fun working with you, especially when we had the same thoughts at the same time even from geographically so far away. Good luck with whatever it is that you do.

Geoff