[strongSwan] ubuntu 14.04 testing environment

[Michael C. Cambria]

Hi Tobias,

First, thanks for the help. Replies, Follow-up comments inline.

On 05/26/2015 05:04 AM, Tobias Brunner wrote:
> Hi Michael,
>
>>>> What fails isn't obvious.  Looking at one test I was interested in,
>>>> net2net-cert-sha2, it looked like the test actually did pass (or I just
>>>> can't find the failure.)
>>> You may compare your results to the ones at [1].
>> I did, other than the plugin failed to load message, results look
>> similar to what I see at [1]
> Well, similar is not the same.  And as suspected, you are not using
> 5.3.0 but 5.2.0.  As per your console.log:
>
>> moon# ipsec start
>> Starting strongSwan 5.2.0 IPsec [starter]...
>> No leaks detected, 1 suppressed by whitelist
> So the authentication does not use SHA2 and some of the tests in
> evaltest.dat therefore fail.
>
> Check your testing.conf (or testing.conf.local) file and see if you
> actually have version 5.3.0 set in SWANVERSION.

At present I'm more interested in making sure I understand the testing 
setup than any one individual test.   Your suspicion was correct, 
testing.conf was using 5.2.  I grabbed a 5.3 tarball, didn't expect it 
to test 5.2.  Setting the version to 5.3, that specific test now passes, 
but some (14) still fail... which leads me to believe there is more I'm 
missing.

What fails now, on up to date Ubuntu 14.04 host using the 5.3 tarball, 
with --no-parent patch and testing.conf set with SWANVERSION=5.3.0:

[FAIL]  37 ikev1/multi-level-ca: pre..test..post
[FAIL]  38 ikev1/multi-level-ca-cr-init: pre..test..post
[FAIL]  39 ikev1/multi-level-ca-cr-resp: pre..test..post
[FAIL]  130 ikev2/multi-level-ca: pre..test..post
[FAIL]  131 ikev2/multi-level-ca-cr-init: pre..test..post
[FAIL]  132 ikev2/multi-level-ca-cr-resp: pre..test..post
[FAIL]  133 ikev2/multi-level-ca-ldap: pre..test..post
[FAIL]  134 ikev2/multi-level-ca-loop: pre..test..post
[FAIL]  136 ikev2/multi-level-ca-revoked: pre..test..post
[FAIL]  137 ikev2/multi-level-ca-strict: pre..test..post
[FAIL]  164 ikev2/ocsp-multi-level: pre..test..post
[FAIL]  267 p2pnat/behind-same-nat: pre..test..post
[FAIL]  268 p2pnat/medsrv-psk: pre..test..post
[FAIL]  286 sql/multi-level-ca: pre..test..post


Thanks,
MikeC