[APP][Pro] Archive Insights - export all your Insights data to a NAS, FTP or web folder

I have some issues with uploading to my NAS over FTP.
In my flow I activate an export of the last 24 hours every night at 03:00 and not all the day are going well and the following results is in the log of the app.

2020-02-28 03:00:13 [log] [App] Finshed all exports
2020-02-28 03:00:03 [err] [App] { Error: This socket has been ended by the other party (control socket) at Socket.writeAfterFIN [as write] (net.js:376:12) at FTPContext.send (/node_modules/basic-ftp/dist/FtpContext.js:170:22) at Promise (/node_modules/basic-ftp/dist/FtpContext.js:232:22) at new Promise () at FTPContext.handle (/node_modules/basic-ftp/dist/FtpContext.js:202:16) at Client.send (/node_modules/basic-ftp/dist/Client.js:100:25) at Client.cd (/node_modules/basic-ftp/dist/Client.js:226:21) at at process._tickCallback (internal/process/next_tick.js:189:7) code: ‘EPIPE’ }
2020-02-28 03:00:03 [err] [App] error: { Error: This socket has been ended by the other party (control socket) at Socket.writeAfterFIN [as write] (net.js:376:12) at FTPContext.send (/node_modules/basic-ftp/dist/FtpContext.js:170:22) at Promise (/node_modules/basic-ftp/dist/FtpContext.js:232:22) at new Promise () at FTPContext.handle (/node_modules/basic-ftp/dist/FtpContext.js:202:16) at Client.send (/node_modules/basic-ftp/dist/Client.js:100:25) at Client.cd (/node_modules/basic-ftp/dist/Client.js:226:21) at at process._tickCallback (internal/process/next_tick.js:189:7) code: ‘EPIPE’ }
2020-02-28 03:00:03 [log] [App] 18 files zipped, 68930 total bytes
2020-02-28 03:00:01 [log] [App] getting logs related to com.homewizard

The results so far:
28 failed
27 okay
26 failed
25 okay
24 failed
23 okay

Does someone knows what goed wrong here?

New app version will soon be released in the appstore.
v2.5.1: Packages update. athom-api@2.1.220. webdav@2.10.2. basic-ftp@4.5.3 FTP fixes. Added Export and Cancel Export via app setting

Some bugfixes for (Secure) FTP were implemented. Also it is now possible to start a Insights backup straight from the app settings tab.

Already available now for install as test version:

1 Like

Can you please try the new version, and let me know if that helps (and do a ptp of Homey before doing a new export)

Hi !
I have installed the app and ptp for 15min.
Nothing has changed

If SMB doesnt work for you, try ftp or webdav (or another SMB server)

The new version 2.5.2 is now released in the Homey appstore. Enjoy :+1:

FTP is working again after update and PTP. Now for 4 days a good export.
Thx.

1 Like

Oops…
Again FTP isn’t working anymore.
After 3 successful nights with a backup each night, now already 2 nights missed.
It’s time for me to go find another solution to export the data frequently. This app isn’t working good enough.

Perhaps it’s not caused by the app but by Homey’s not-so-stellar networking?

Or your FTP service reached its limits?

What does the app log say?

FTP server is working good as also the network is.

Logging from the app:

2020-03-13 03:00:13 [log] [App] Finshed all exports
2020-03-13 03:00:03 [err] [App] { Error: This socket has been ended by the other party (control socket) at Socket.writeAfterFIN [as write] (net.js:376:12) at FTPContext.send (/node_modules/basic-ftp/dist/FtpContext.js:170:22) at Promise (/node_modules/basic-ftp/dist/FtpContext.js:230:22) at new Promise () at FTPContext.handle (/node_modules/basic-ftp/dist/FtpContext.js:200:16) at FTPContext.request (/node_modules/basic-ftp/dist/FtpContext.js:177:21) at Client.send (/node_modules/basic-ftp/dist/Client.js:103:25) at Client.cd (/node_modules/basic-ftp/dist/Client.js:234:21) at at process._tickCallback (internal/process/next_tick.js:189:7) code: ‘EPIPE’ }
2020-03-13 03:00:03 [err] [App] error: { Error: This socket has been ended by the other party (control socket) at Socket.writeAfterFIN [as write] (net.js:376:12) at FTPContext.send (/node_modules/basic-ftp/dist/FtpContext.js:170:22) at Promise (/node_modules/basic-ftp/dist/FtpContext.js:230:22) at new Promise () at FTPContext.handle (/node_modules/basic-ftp/dist/FtpContext.js:200:16) at FTPContext.request (/node_modules/basic-ftp/dist/FtpContext.js:177:21) at Client.send (/node_modules/basic-ftp/dist/Client.js:103:25) at Client.cd (/node_modules/basic-ftp/dist/Client.js:234:21) at at process._tickCallback (internal/process/next_tick.js:189:7) code: ‘EPIPE’ }
2020-03-13 03:00:03 [log] [App] 18 files zipped, 70982 total bytes
2020-03-13 03:00:01 [log] [App] getting logs related to com.homewizard

means your FTP service stopped the upload. Could also be related to bad network connection. Why don’t you try another FTP service, or a SMB (network drive) or WebDAV?

The FTP server is my local NAS and because of the of Mac at home I don’t need SMB or WebDAV.
Normally I don’t have issues with local FTP and my logs on the NAS are not logging these issues. So maybe it’s Homey related.
I wil have a look into SMB later.
Thank you.

1 Like

Unzipped files are easier to handle. I have something similar running on my NAS, I use a PHP script to read the text files, push the data into a SQL database and delete the file immediately. On that same NAS I run a webserver to show all the data in trends.

I see. Well this app is intended for archiving purposes.
If you want to do trending you might want to take a look at prometheus exporter or mqtt hub.

Can you share your solution?
It’s the same purpose I want to use the data for.

I’m trying to configure my Archive Insights, but can’t… I tried NAS, WebDAV and FTP which work good with a browser.

Here what results from NAS:
2020-04-13 21:05:59 [log] [App] connect ETIMEDOUT 192.168.1.10:445
2020-04-13 21:04:32 [log] [App] testing SMB settings from frontend

And here from FTP:
2020-04-13 18:53:39 [log] [App] Error: Timeout (control socket) at Socket.socket.once (/node_modules/basic-ftp/dist/FtpContext.js:310:58) at Object.onceWrapper (events.js:313:30) at emitNone (events.js:106:13) at Socket.emit (events.js:208:7) at Socket._onTimeout (net.js:422:8) at ontimeout (timers.js:498:11) at tryOnTimeout (timers.js:323:5) at Timer.listOnTimeout (timers.js:290:5)
2020-04-13 18:53:09 [log] [App] testing FTP settings from frontend

Please, can you help me with any clues?
Thank you…

New app version 2.6.0 will soon be released. It has major stability improvements and a workaround for handling corrupt insights data.

You can already get it as test version:

  • Packages update.
  • athom-api@3.2.3.
  • webdav@3.3.0.
  • basic-ftp@4.5.4.
  • marsaud/smb2@0.16.0
  • archiver@4.0.1.
  • Fix crash on corrupt Insights data.

I am trying to export to a network drive on my NAS (DS218+). Connection set-up seems to work as i do see the ĂŹnsights2.csv`file appear but when I explicitly export from the app menu, the logging seems to say that the files were zipped and exported but I dont see them appear on the drive.

did you switch on the ‘use smb on export’ ?