topic Re: How to configure Neo4j logging settings in ThingWorx? in ThingWorx Developers

How to configure Neo4j logging settings in ThingWorx?

chrish — Sun, 14 Feb 2016 02:53:20 GMT

My ThingWorx server is growing Neo4j log files almost exponentially. In normal

installs

I can change configuration and control log retention, etc in neo4j.properties and cneo4j-wrapper.conf but neither appears to be available in ThingWorx installation. Where is this configured?

Re: How to configure Neo4j logging settings in ThingWorx?

Aanjan — Mon, 15 Feb 2016 15:20:52 GMT

Christopher, unfortunately the Neo4j log settings are not exposed in the platform. The only logging settings you can control per se, is the ThingWorx logging itself - Subsystems -> LoggingSubsystem has settings for max log size and retention time.

Re: How to configure Neo4j logging settings in ThingWorx?

chrish — Wed, 17 Feb 2016 16:30:56 GMT

Ok. I went into Subsystems -> LoggingSubsystem and my install is configured max log size of 100000KB (100MB) according to Composer. This is the default. Why then is my Neo logs growing to over 100GB in the ThingworxStorage/database/data directory?? How can I prevent Neo logs from generating 100's of GB of log files and overwhelming the storage on the server?

Re: How to configure Neo4j logging settings in ThingWorx?

Aanjan — Thu, 18 Feb 2016 17:10:03 GMT

Christopher, that's the ThingWorx logs - if you go into ThingworxStorage\logs, 100mb would be the maximum size of a log file before it gets pushed into archive. Regarding the neo logs, those are the nioneo_logical logs, right? Do you have anything writing values into streams very frequently?

Re: How to configure Neo4j logging settings in ThingWorx?

chrish — Sat, 20 Feb 2016 03:10:00 GMT

Yes. Data Tables and Streams. Both are stored in Neo. This is the basis of my original question.

Re: How to configure Neo4j logging settings in ThingWorx?

vranganathan — Tue, 19 Jul 2016 15:26:50 GMT

I have same issue. I tried the purging of my streams on nightly basis. Still in ThingworxBackupStorage I have lot of files nioneo_logical.log.* Is it safe to delete them?

Re: How to configure Neo4j logging settings in ThingWorx?

Aanjan — Tue, 19 Jul 2016 15:36:07 GMT

Varathan, although you can delete them, that is not the recommended way. These nioneo logical logs are the backup logs made by neo4j to restore its database if it crashed. What you can do is change the duration the logs are retained. Here's an article on managing retention of neo4j logs.

Re: How to configure Neo4j logging settings in ThingWorx?

vranganathan — Tue, 19 Jul 2016 16:01:24 GMT

Thanks. I added the platform-settings.json. Set the DatabaseLogRetentionPolicy to 4 days. I noticed that it freed up some space (about 1.5%). However in /ThingworxStorage/database/data I see nioneo_logical.log.* as old as 7 days. I did restart the tomcat. Is there anything I am missing?

Re: How to configure Neo4j logging settings in ThingWorx?

Aanjan — Wed, 20 Jul 2016 16:05:25 GMT

That should be it. It should've ran another clean up by now, so has there been a change in disk space? You can set it to as low as 1 day.

Re: How to configure Neo4j logging settings in ThingWorx?

vranganathan — Thu, 21 Jul 2016 13:08:09 GMT

It did not clean the old files. I am manually deleting them. Thanks.

Re: How to configure Neo4j logging settings in ThingWorx?

chrish — Fri, 05 Aug 2016 21:00:15 GMT

Once I implemented platform-settings.json with PTC support's help; my logs started cleaning themselves up better.