OpenDaylight JIRA https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 [AAA-71] Beryllium: Netconf fails to authenticate its SSH connection, rendering it unusable https://jira.opendaylight.org/browse/AAA-71 aaa <p>Any netconf tests fails due to the netconf clients failing to open a SSH connection to netconf servers. Here is a fragment of DEBUG logs from one such failure:</p> <p>2015-11-11 10:30:27,727 | DEBUG | o-group-thread-4 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Creating IoSession on /127.0.0.1:1830 from /127.0.0.1:50892<br/> 2015-11-11 10:30:27,728 | INFO | o-group-thread-4 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Server session created from /127.0.0.1:50892<br/> 2015-11-11 10:30:27,728 | DEBUG | o-group-thread-4 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 26 bytes<br/> 2015-11-11 10:30:27,728 | DEBUG | o-group-thread-4 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:27,729 | INFO | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Client session created<br/> 2015-11-11 10:30:27,729 | DEBUG | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_KEXINIT<br/> 2015-11-11 10:30:27,730 | DEBUG | NioProcessor-1 | ClientUserAuthServiceNew | 231 - org.apache.sshd.core - 0.14.0 | Start authentication<br/> 2015-11-11 10:30:27,730 | DEBUG | NioProcessor-1 | ClientUserAuthServiceNew | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_USERAUTH_REQUEST for none<br/> 2015-11-11 10:30:27,730 | INFO | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Start flagging packets as pending until key exchange is done<br/> 2015-11-11 10:30:27,730 | DEBUG | o-group-thread-5 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 26 bytes<br/> 2015-11-11 10:30:27,731 | INFO | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Server version string: SSH-2.0-SSHD-CORE-0.14.0<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-5 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Client version string: SSH-2.0-SSHD-CORE-0.14.0<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-5 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_KEXINIT<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-5 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 592 bytes<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-5 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:27,731 | DEBUG | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_KEXINIT<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-5 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 704 bytes<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-5 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_KEXINIT<br/> 2015-11-11 10:30:27,731 | DEBUG | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Kex: server-&gt;client aes128-ctr hmac-sha2-256 none<br/> 2015-11-11 10:30:27,731 | DEBUG | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Kex: client-&gt;server aes128-ctr hmac-sha2-256 none<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-5 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Kex: server-&gt;client aes128-ctr hmac-sha2-256 none<br/> 2015-11-11 10:30:27,731 | DEBUG | NioProcessor-1 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_KEX_DH_GEX_REQUEST<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-5 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Kex: client-&gt;server aes128-ctr hmac-sha2-256 none<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-6 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 32 bytes<br/> 2015-11-11 10:30:27,731 | DEBUG | o-group-thread-6 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_KEX_DH_GEX_REQUEST<br/> 2015-11-11 10:30:27,970 | DEBUG | o-group-thread-6 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_KEX_DH_GEX_GROUP<br/> 2015-11-11 10:30:27,970 | DEBUG | o-group-thread-6 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 536 bytes<br/> 2015-11-11 10:30:27,970 | DEBUG | o-group-thread-6 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:27,971 | DEBUG | NioProcessor-1 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_KEX_DH_GEX_GROUP<br/> 2015-11-11 10:30:28,182 | DEBUG | NioProcessor-1 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_KEX_DH_GEX_INIT<br/> 2015-11-11 10:30:28,183 | DEBUG | o-group-thread-7 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 536 bytes<br/> 2015-11-11 10:30:28,183 | DEBUG | o-group-thread-7 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_KEX_DH_GEX_INIT<br/> 2015-11-11 10:30:28,455 | DEBUG | o-group-thread-7 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | K_S: 00 00 00 07 73 73 68 2d 72 73 61 00 00 00 03 01 00 01 00 00 02 01 00 92 7e 72 60 ff 47 ce 93 76 7e 7f 6c eb 5a fb 5a 09 39 f8 df 6a fd e4 7e bf 66 7a 84 10 71 91 ae e0 69 0b bb e6 54 fe 1a 8f b4 e8 9a 0f b0 48 ec e4 6a bd e3 f9 c5 16 3e 09 ee 7a 03 4d 23 8e 45 9c 58 1a b2 00 9d 51 6f 22 39 fb 1d 04 0e bb cc 2b e9 d7 bc e3 2d f8 c3 06 ab db fb 4e 64 3e 8d d0 97 27 fa 36 71 db 34 79 50 56 48 c0 22 5c 2c c2 bd 41 a6 a8 d7 4c c3 ab 03 5a 31 25 e1 fa aa eb 53 fe 83 5b e3 11 19 7e ae f5 f8 30 c1 57 32 b9 fa 8e 51 f4 f1 8d 3d 44 74 18 bc 80 3d bd 52 97 ad bb d3 2e ea 30 91 47 d6 a7 41 3e 1c f8 59 7b eb ae 11 2e 86 25 16 4d 40 0f 71 f0 08 6b cb 7a 9b e2 73 b0 96 09 6c eb 72 b5 fd 78 59 9d 7a 00 1a 8a cc c7 dc 75 14 3e 54 15 6c b6 09 66 db 5e ee b6 41 24 fd b2 75 56 13 fc 7f 00 79 ba 40 94 ae 8e f1 49 ea 52 e1 8d f1 41 7a 6c 0b ee 62 8a 83 78 84 5d 1d c7 99 4b 03 4d b9 23 55 08 94 e0 e1 3e cb 7d f5 ec d0 9a 4f 26 8c 95 ca 40 0b 36 48 f2 77 0f e5 48 00 f7 41 0e 3a 7d 03 21 66 4e f3 23 41 3a f6 60 9a af b3 bf f0 59 3f fb b5 e9 a4 3a 14 51 81 b7 49 01 37 87 3e 59 ab 0a 48 66 ed 5b 40 ae 59 95 90 28 91 dc f1 ed 48 37 d7 a6 fa 1f 42 c6 47 dc ee ea 3f d5 af 79 84 50 cf 7f 0d ed dd 57 11 4f 7c 00 cf be c2 56 26 a4 43 30 f2 85 7f 8f f2 8c e8 8e 03 63 63 9b 7e 06 04 60 20 d8 14 a3 82 68 01 cb 5c 86 00 14 ae e4 18 ac 83 4d e5 63 bf 7c cf 65 24 35 e4 67 53 7a 14 75 e9 cd ff 93 77 83 32 78 cf a2 94 23 f2 a6 b5 a7 df fa b7 fb f5 df 4a e6 f9 05 58 9c 39 96 df fc a2 f8 9b 9c 22 7d b3 f3 98 3c 06 f4 4a 76 37 a3 02 6e d2 64 b5 53 a0 c1 86 9d 59 98 33 24 78 fd 9a 7b 3e 32 36 70 fb 49 d0 bd 51 6e 8d b6 7d<br/> 2015-11-11 10:30:28,455 | DEBUG | o-group-thread-7 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | f: 0a 16 b2 91 66 1a e7 ba f6 10 43 0d 4f f2 03 65 92 f0 58 7a 28 7b 4b 60 0e 5c 3a 22 61 d0 a7 b1 e8 e4 fe c9 30 50 46 dd a0 23 a1 1b c6 dd 24 60 e2 37 ae b1 98 08 d6 71 12 c2 ad 26 7b 72 98 9d 3e 8e 51 7b 3a 78 ab be c5 cf 36 25 fa 05 95 ca 40 3a ae e0 5f d3 f5 94 4e b3 34 6e 18 cd 7b b0 a8 dc f6 5d 72 99 d5 af 0c 6b 8b d4 c1 fd 67 7b b7 c9 21 a2 a3 ac cd 4a 9a 06 6f e3 ff 12 ce d6 ce 70 03 6d f2 f4 5b 9e 09 71 8b 98 8b d3 7b ce 5b 91 f8 72 e3 c8 ab aa 81 9e 5a 2f 98 fc 63 95 21 22 4a b4 7e fb 08 cc 92 f3 a7 dc da 23 53 44 79 f8 d3 36 dd ea d2 81 7a 37 5f 1d aa 84 0d c2 31 6c 38 5a 56 f2 ce b2 29 62 d3 d7 76 f3 60 4d c7 ac 01 09 d1 72 29 7c 4c a3 69 e8 6f f5 7a 17 9e c7 fc ac 81 c7 a2 a8 90 ce 05 2e b2 b5 01 87 c6 1d d7 50 e2 12 7a e3 fa 0f 00 06 65 95 d1 5b 44 6e ef c1 b4 79 e3 16 84 54 6e 9f d7 8f fa 41 b5 d3 fd bd 18 c4 45 cc 86 8c d7 4e b8 89 f2 7d 23 af d5 8e 5f d6 4d f7 fe d6 eb 34 6f 0a 0d ed 3d a6 be 35 58 f5 ba b3 db ce 99 08 fb 7c a2 13 5e 17 77 e9 c9 72 94 07 9a d2 7c 22 92 bb e1 00 df b6 cd 19 fc 80 b9 4f c6 e3 76 8f 95 11 00 79 cd 19 7b 95 0d 47 97 16 22 c8 09 05 6c ef a6 17 ad 6c 88 df 47 c5 12 3d d3 bf 90 af fe 59 b2 73 d2 0c 3f 08 0b db e2 9c 4c d5 cc c9 6e 0f bf 5d 6e 4a 9d 30 41 c8 59 a9 3b ed 06 15 12 f5 9b fb c5 08 c1 65 14 c0 72 b0 e7 03 71 c8 bc d7 28 a8 46 cb 45 ca dd c9 87 83 da 6e 22 22 b3 f5 97 23 41 43 aa 01 a8 a7 45 42 f1 56 1d af fb 9d 69 66 53 63 ab 51 73 ae 0b 4d ad 89 43 e8 8b 85 d7 d8 2f f1 65 19 c6 98 43 84 14 d7 48 aa 31 33 bc fa a0 5b ee 24 f2 ba b1 8a db 35 08 f3 bd 12 cc d1<br/> 2015-11-11 10:30:28,455 | DEBUG | o-group-thread-7 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | sigH: 00 00 00 07 73 73 68 2d 72 73 61 00 00 02 00 8e 59 87 84 80 11 63 4d b0 06 65 0d c6 4a 84 d6 8b 94 ad 6c e2 12 59 4c e6 15 35 2c 83 9c a3 41 d1 ac e6 8d 85 01 92 f2 9f 5a 88 82 8f f5 38 25 07 29 04 5b 3a 07 b0 5e ec 8e be b0 77 ee 9b 9b b6 d9 20 a0 66 c2 c2 40 8b 08 60 28 42 a3 de b1 97 6e 07 4f ce 74 c4 53 54 42 72 cb dd 6c 48 e6 d2 fc bd a1 4c 37 2c 7d 9f 97 86 92 5d 98 0c 10 06 fd dc 2a 05 ba c1 2d 94 e1 f5 4d 94 f1 74 9b 81 0b 64 43 f0 6f c9 27 27 ce a8 98 b0 f5 95 85 b8 58 d6 68 fd 7e fe 86 24 01 44 53 86 96 55 f9 38 bc 62 b0 be 7e 22 6e 41 d4 88 d5 a1 39 86 ff c8 de 6b 40 57 ee 86 77 04 83 b7 85 77 10 9d 6f dc d0 8e 40 76 43 1f 88 ac 0f 77 94 63 b4 6c 91 63 69 e4 75 62 b4 6f a0 9d 7e 02 28 5f b0 cf 27 56 84 c7 29 c6 ac c7 4d 15 80 d2 9e 02 bc 90 ef 70 dc 7e 98 f2 e0 9d 16 a7 17 66 ae a6 2f 35 c0 73 8a aa 65 85 19 d9 22 ae 7e 48 b1 c3 e5 4b 26 14 ff 3b 1d f2 8a 61 d2 23 73 14 74 66 3c 2e f1 29 f4 e0 b5 cd e0 18 e3 ed 0a 00 71 7d 1d e8 fe 15 a4 92 d4 c1 9f 4a 5b c4 7b 28 91 42 41 85 86 5a 4e 82 ca e1 3e 20 b9 29 50 e9 72 8e 96 68 c9 86 b6 f5 df 12 a7 80 89 fa 0f 79 a0 72 7c af dd 74 b4 4b df 9c 2f 5d 04 38 de b1 b3 6b d9 01 b9 62 f9 1e 55 2c 74 83 22 09 e4 83 bf b8 9c f3 88 e7 08 0f aa 67 11 6c 5e 9e fd ea 90 ae 79 b1 63 4f 66 28 03 de 4e 8a 45 91 a8 51 47 17 67 68 02 e3 de c4 c5 ae 6e 29 76 b9 c9 89 e1 61 02 22 ea 93 6e c3 a7 dc ae a9 2b 4a ea 6c 31 20 cf 9a 50 35 4a a4 b5 f4 ec 24 cd 4c c3 9d 68 f3 cf cd 17 49 dd a7 09 46 66 7c c2 57 c8 7c 93 12 5a 4b 1d ce 8b 1d a7 69 47 e1 01 b0 74 6f e3 18 ca 4b 52 8a 45 f2 74 a5 66 8e 62 a6 76 0d 5f 8f 0c d2 92<br/> 2015-11-11 10:30:28,455 | DEBUG | o-group-thread-7 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_KEX_DH_GEX_REPLY<br/> 2015-11-11 10:30:28,455 | DEBUG | o-group-thread-7 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 1600 bytes<br/> 2015-11-11 10:30:28,456 | DEBUG | NioProcessor-1 | DHGEX256 | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_KEX_DH_GEX_REPLY<br/> 2015-11-11 10:30:28,457 | DEBUG | o-group-thread-7 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,457 | DEBUG | o-group-thread-7 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_NEWKEYS<br/> 2015-11-11 10:30:28,458 | DEBUG | o-group-thread-7 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 16 bytes<br/> 2015-11-11 10:30:28,458 | DEBUG | o-group-thread-7 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,670 | WARN | NioProcessor-1 | AcceptAllServerKeyVerifier | 231 - org.apache.sshd.core - 0.14.0 | Server at /127.0.0.1:1830 presented unverified RSA key: d6:88:31:05:e8:a4:bc:fa:bd:12:dd:cc:ef:21:63:ca<br/> 2015-11-11 10:30:28,670 | DEBUG | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_NEWKEYS<br/> 2015-11-11 10:30:28,670 | DEBUG | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_NEWKEYS<br/> 2015-11-11 10:30:28,671 | DEBUG | o-group-thread-8 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 16 bytes<br/> 2015-11-11 10:30:28,671 | DEBUG | o-group-thread-8 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_NEWKEYS<br/> 2015-11-11 10:30:28,671 | DEBUG | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_SERVICE_REQUEST for ssh-userauth<br/> 2015-11-11 10:30:28,671 | INFO | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Dequeing pending packets<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 80 bytes<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_SERVICE_REQUEST 'ssh-userauth'<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authorized authentication methods: password,keyboard-interactive<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | ServerSession | 231 - org.apache.sshd.core - 0.14.0 | Accepted service ssh-userauth<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 80 bytes<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 96 bytes<br/> 2015-11-11 10:30:28,672 | DEBUG | NioProcessor-1 | ClientSessionImpl | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_SERVICE_ACCEPT<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_REQUEST<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authenticating user 'admin' with service 'ssh-connection' and method 'none'<br/> 2015-11-11 10:30:28,672 | DEBUG | o-group-thread-1 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication failed<br/> 2015-11-11 10:30:28,673 | DEBUG | o-group-thread-1 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 96 bytes<br/> 2015-11-11 10:30:28,673 | DEBUG | o-group-thread-1 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,673 | INFO | NioProcessor-1 | ClientUserAuthServiceNew | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_FAILURE<br/> 2015-11-11 10:30:28,673 | DEBUG | NioProcessor-1 | ClientUserAuthServiceNew | 231 - org.apache.sshd.core - 0.14.0 | Authentications that can continue: password, keyboard-interactive<br/> 2015-11-11 10:30:28,673 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_USERAUTH_REQUEST for keyboard-interactive<br/> 2015-11-11 10:30:28,673 | DEBUG | o-group-thread-2 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 128 bytes<br/> 2015-11-11 10:30:28,674 | DEBUG | o-group-thread-2 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_REQUEST<br/> 2015-11-11 10:30:28,674 | DEBUG | o-group-thread-2 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authenticating user 'admin' with service 'ssh-connection' and method 'keyboard-interactive'<br/> 2015-11-11 10:30:28,674 | DEBUG | o-group-thread-2 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 128 bytes<br/> 2015-11-11 10:30:28,674 | DEBUG | o-group-thread-2 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,674 | DEBUG | o-group-thread-2 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication not finished<br/> 2015-11-11 10:30:28,674 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_INFO_REQUEST<br/> 2015-11-11 10:30:28,674 | INFO | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Received Password authentication en-US<br/> 2015-11-11 10:30:28,674 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Promt: Password: <br/> 2015-11-11 10:30:28,674 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Echo: <span class="error">&#91;false&#93;</span><br/> 2015-11-11 10:30:28,674 | DEBUG | o-group-thread-3 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 80 bytes<br/> 2015-11-11 10:30:28,675 | DEBUG | o-group-thread-3 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Received authentication message 61<br/> 2015-11-11 10:30:28,675 | DEBUG | o-group-thread-3 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication failed: null<br/> 2015-11-11 10:30:28,675 | DEBUG | o-group-thread-3 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication failed<br/> 2015-11-11 10:30:28,675 | DEBUG | o-group-thread-3 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 96 bytes<br/> 2015-11-11 10:30:28,675 | DEBUG | o-group-thread-3 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,675 | INFO | NioProcessor-1 | ClientUserAuthServiceNew | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_FAILURE<br/> 2015-11-11 10:30:28,675 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_USERAUTH_REQUEST for keyboard-interactive<br/> 2015-11-11 10:30:28,675 | DEBUG | o-group-thread-4 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 128 bytes<br/> 2015-11-11 10:30:28,676 | DEBUG | o-group-thread-4 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_REQUEST<br/> 2015-11-11 10:30:28,676 | DEBUG | o-group-thread-4 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authenticating user 'admin' with service 'ssh-connection' and method 'keyboard-interactive'<br/> 2015-11-11 10:30:28,676 | DEBUG | o-group-thread-4 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 128 bytes<br/> 2015-11-11 10:30:28,676 | DEBUG | o-group-thread-4 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,676 | DEBUG | o-group-thread-4 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication not finished<br/> 2015-11-11 10:30:28,676 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_INFO_REQUEST<br/> 2015-11-11 10:30:28,676 | INFO | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Received Password authentication en-US<br/> 2015-11-11 10:30:28,676 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Promt: Password: <br/> 2015-11-11 10:30:28,676 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Echo: <span class="error">&#91;false&#93;</span><br/> 2015-11-11 10:30:28,676 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_USERAUTH_REQUEST for keyboard-interactive<br/> 2015-11-11 10:30:28,677 | DEBUG | o-group-thread-5 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 128 bytes<br/> 2015-11-11 10:30:28,677 | DEBUG | o-group-thread-5 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_REQUEST<br/> 2015-11-11 10:30:28,677 | DEBUG | o-group-thread-5 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authenticating user 'admin' with service 'ssh-connection' and method 'keyboard-interactive'<br/> 2015-11-11 10:30:28,677 | DEBUG | o-group-thread-5 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 128 bytes<br/> 2015-11-11 10:30:28,677 | DEBUG | o-group-thread-5 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,677 | DEBUG | o-group-thread-5 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication not finished<br/> 2015-11-11 10:30:28,677 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_INFO_REQUEST<br/> 2015-11-11 10:30:28,677 | INFO | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Received Password authentication en-US<br/> 2015-11-11 10:30:28,677 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Promt: Password: <br/> 2015-11-11 10:30:28,677 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Echo: <span class="error">&#91;false&#93;</span><br/> 2015-11-11 10:30:28,677 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_USERAUTH_REQUEST for keyboard-interactive<br/> 2015-11-11 10:30:28,678 | DEBUG | o-group-thread-6 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 128 bytes<br/> 2015-11-11 10:30:28,678 | DEBUG | o-group-thread-6 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_REQUEST<br/> 2015-11-11 10:30:28,678 | DEBUG | o-group-thread-6 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authenticating user 'admin' with service 'ssh-connection' and method 'keyboard-interactive'<br/> 2015-11-11 10:30:28,678 | DEBUG | o-group-thread-6 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 128 bytes<br/> 2015-11-11 10:30:28,678 | DEBUG | o-group-thread-6 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,678 | DEBUG | o-group-thread-6 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication not finished<br/> 2015-11-11 10:30:28,678 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_INFO_REQUEST<br/> 2015-11-11 10:30:28,678 | INFO | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Received Password authentication en-US<br/> 2015-11-11 10:30:28,678 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Promt: Password: <br/> 2015-11-11 10:30:28,678 | DEBUG | NioProcessor-1 | UserAuthKeyboardInteractive | 231 - org.apache.sshd.core - 0.14.0 | Echo: <span class="error">&#91;false&#93;</span><br/> 2015-11-11 10:30:28,678 | DEBUG | NioProcessor-1 | UserAuthPassword | 231 - org.apache.sshd.core - 0.14.0 | Send SSH_MSG_USERAUTH_REQUEST for password<br/> 2015-11-11 10:30:28,679 | DEBUG | o-group-thread-7 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Read 112 bytes<br/> 2015-11-11 10:30:28,679 | DEBUG | o-group-thread-7 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_REQUEST<br/> 2015-11-11 10:30:28,679 | DEBUG | o-group-thread-7 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authenticating user 'admin' with service 'ssh-connection' and method 'password'<br/> 2015-11-11 10:30:28,679 | DEBUG | o-group-thread-7 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication failed: null<br/> 2015-11-11 10:30:28,679 | DEBUG | o-group-thread-7 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication failed<br/> 2015-11-11 10:30:28,679 | DEBUG | o-group-thread-7 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Writing 96 bytes<br/> 2015-11-11 10:30:28,679 | DEBUG | o-group-thread-7 | Nio2Session | 231 - org.apache.sshd.core - 0.14.0 | Finished writing<br/> 2015-11-11 10:30:28,679 | INFO | NioProcessor-1 | ClientUserAuthServiceNew | 231 - org.apache.sshd.core - 0.14.0 | Received SSH_MSG_USERAUTH_FAILURE<br/> 2015-11-11 10:30:28,680 | WARN | NioProcessor-1 | AsyncSshHandler | 228 - org.opendaylight.netconf.netty-util - 1.0.0.SNAPSHOT | Unable to setup SSH connection on channel: <span class="error">&#91;id: 0x8bcc19b1&#93;</span></p> <p>The most suspicious lines here are those:</p> <p>2015-11-11 10:30:28,675 | DEBUG | o-group-thread-3 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication failed: null</p> <p>2015-11-11 10:30:28,679 | DEBUG | o-group-thread-7 | ServerUserAuthService | 231 - org.apache.sshd.core - 0.14.0 | Authentication failed: null</p> <p>Comparison with a working Beryllium version turned out that the authentication used to succeed at the point of the first "Authentication failed: null" log message.</p> <p>Operating System: All<br/> Platform: All</p> AAA-71 Beryllium: Netconf fails to authenticate its SSH connection, rendering it unusable Bug Verified Done Tomas Cere Jozef Behran Wed, 11 Nov 2015 14:17:49 +0000 Thu, 21 Mar 2019 11:56:43 +0000 Thu, 12 Nov 2015 18:20:27 +0000 General 0 3 <p>Started to occur between these test runs:</p> <p><a href="https://jenkins.opendaylight.org/releng/view/netconf/job/netconf-csit-1node-userfeatures-only-beryllium/3/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/releng/view/netconf/job/netconf-csit-1node-userfeatures-only-beryllium/3/</a> (Nov 5, 2015 3:14:06 PM)</p> <p><a href="https://jenkins.opendaylight.org/releng/view/netconf/job/netconf-csit-1node-userfeatures-only-beryllium/4/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/releng/view/netconf/job/netconf-csit-1node-userfeatures-only-beryllium/4/</a> (Nov 5, 2015 5:19:16 PM)</p> <p>Current suspiction is that there is some change in AAA which broke Netconf (and possibly other things as well).</p> <p><a href="https://git.opendaylight.org/gerrit/#/c/29588/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/29588/</a></p> <p>This was caused by aaa not using the precomputed domain that accounted for credentials not providing a domain and using a default one.<br/> This was causing a null pointer and no users could be retrieved from datastore.</p> <p>Passrate is back to very good: <a href="https://jenkins.opendaylight.org/releng/view/netconf/job/netconf-csit-1node-userfeatures-only-beryllium/17/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/releng/view/netconf/job/netconf-csit-1node-userfeatures-only-beryllium/17/</a><br/> Marking as verified.</p> Development External issue ID 4624 External issue URL ODL SR Target Milestone Rank 0|i023x3: