Server crash: Unable to open Audit file in append mode

[kpturner]

I have transferred the log using wetransfer.com to support@lightstreamer.com

[giuseppe.corti]

Hi Kevin,

The log file shows that the number of connections is exploded when the server was already in severe crisis because of the stalling of SERVER pool.
Please note messages like these (with delay constantly growing):

05-May-15 14:05:24,728|WARN |LightstreamerLogger.scheduler    |Timer-0                    |If the delay issue persists, taking a JVM full thread dump may be the best way to investigate the issue.
05-May-15 14:05:26,758|WARN |LightstreamerLogger.scheduler    |Timer-0                    |Current delay for tasks scheduled on thread pool SERVER is 156 seconds.

The SERVER pool has the task of dealing with client requests and this explains why no new session could start.
Clients continued to open new connections but requests sent remained without replies and probably triggered a retry loop.

The most common cause for these messages is due to delays or blocks in the replies from Metadata/Data Adapters to the server requests. Mainly, the requests involved are notifyUser, getItems, getSchema, subscribe and unsubscribe.
But, in order to know what exactly happened it was necessary take a thread dump of the JVM.

Furthermore, we can definitely rule out problems of the client library at least in this case.

Regards,
Giuseppe