[strongSwan-dev] Charon crash at logging

[Bharat Bhushan]

Hi All:

Charon at my setup generally stuck at  __lll_lock_wait.

Setup
1. ipsec stroke loglevel any 8
Following step 2,3,4 are in loop
while  [ 1 ]; do
  2. ping traffic.
  3. Stop the ping.
  4. Inactivity fires after 15 seconds.
done
5. ipsec statusall every 2 seconds.

It looks from core that 12 out of 16 threads are waiting on low level
__lll_lock_wait.

#0  __lll_lock_wait (futex=0x41651c, private=<value optimized out>) at
../nptl/sysdeps/unix/sysv/linux/lowlevellock.c:51
#1  0x2acb99cc in __pthread_mutex_lock (mutex=0x41651c) at
pthread_mutex_lock.c:86
#2  0x2aaf9c1c in lock (this=<value optimized out>) at threading/mutex.c:108
#3  0x2aaf9dc0 in lock_r (this=0x416510) at threading/mutex.c:147
#4  0x2ab66a6c in vlog (this=0x416450, group=DBG_JOB,
level=LEVEL_DIAG, format=0x2ab2f5d8 "JOB %p, job.execute %p,
job.destroy %p", args=0x2b17ee34)
    at bus/bus.c:257
#5  0x2ab6da30 in dbg_bus (group=19456, level=LEVEL_AUDIT, fmt=0x1
<Address 0x1 out of bounds>) at daemon.c:93
#6  0x2aaf6710 in process_jobs (this=0x415b10) at processing/processor.c:135
#7  0x2aaf9560 in thread_main (this=0x41f658) at threading/thread.c:287
#8  0x2acb65dc in start_thread (arg=<value optimized out>) at
pthread_create.c:299
#9  0x2add7b4c in __thread_start () from /lib/libc.so.6

from /var/log/messages:
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 10[DMN] thread 10 received 4
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 10[DMN] thread 10 received 4
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[JOB] JOB 0x423500,
job.execute 0x2ab7b4b8, job.destroy 0x2ab7b46c
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[JOB] JOB 0x423500,
job.execute 0x2ab7b4b8, job.destroy 0x2ab7b46c
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[MGR] checkout IKE_SA
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[MGR] checkout
IKE_SA
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[JOB] JOB 0x424968,
job.execute 0x2ab7b4b8, job.destroy 0x2ab7b46c
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[JOB] JOB 0x424968,
job.execute 0x2ab7b4b8, job.destroy 0x2ab7b46c
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[MGR] checkout IKE_SA
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[MGR] checkout
IKE_SA
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[JOB] JOB 0x2b3039f0,
job.execute 0x2ab7bdd8, job.destroy 0x2ab7bd8c
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[JOB] JOB
0x2b3039f0, job.execute 0x2ab7bdd8, job.destroy 0x2ab7bd8c
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[MGR] checkout IKE_SA
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[MGR] checkout IKE_SA
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[JOB] IKE_SA to rekey not found
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[JOB] IKE_SA to
rekey not found
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[JOB] JOB 0x2b304d48,
job.execute 0x2ab7b4b8, job.destroy 0x2ab7b46c
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[JOB] JOB
0x2b304d48, job.execute 0x2ab7b4b8, job.destroy 0x2ab7b46c
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[MGR] checkout IKE_SA
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[MGR] checkout
IKE_SA
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[JOB] JOB 0x2b303138,
job.execute 0x2ab7bdd8, job.destroy 0x2ab7bd8c
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[JOB] JOB
0x2b303138, job.execute 0x2ab7bdd8, job.destroy 0x2ab7bd8c
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 02[MGR] checkout IKE_SA
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 02[MGR] checkout
IKE_SA
Feb 16 16:32:24 2011: %DAEMON-6-INFO: charon: 10[DMN] killing ourself,
received critical signal
Feb 16 16:32:24 2011: %AUTHPRIV-6-INFO: charon: 10[DMN] killing
ourself, received critical signal

Please let me know if more info is needed.


Regards,
Bharat