OF disconnect during handshake when switch-idle-timeout is set to 1sec

We are trying to configure switch-idle-timeout to 1000ms in openflowplugin configuration for quick switch failure detection if the switch is being shut down forcefully.
After changing the configuration, we sometimes experience TCP disconnect from the controller side during handshake phase.

Quick switch failure detection is a crucial feature for production deployments.

See more info in https://lists.opendaylight.org/pipermail/openflowjava-dev/2015-April/000464.html
Is there a way to let the handshake process timeout and ignore switch-idle-timeout during handshake?