Backup Flow?

csteele · June 10, 2020, 5:40pm

Let me say it a different way, perhaps.. and as I said, it's more a peeve with Node-Red than this wonderful backup offering..

I've always had a disparate Home Automation System. I used to have 4 different manufacturers of Hubs all interconnected. Then I threw them all out to use Hubitat (plus a Lutron bridge) -- then my system GREW. Homebridge, Node-Red, HubConnect NodeJS Server, etc. I'm back to a pretty large array of tools.

I think it's great! I think at a certain point, 2nd Hubitat Hubs and NodeJS servers become "normal" growth. I'm just really sad that the power of Node-Red isn't very easy to leap into. It's a lot to learn, just to get ONE light to turn on. A First Flow is usually a giant step. Heck, just learning that double-click is the secret, is hard to discover LOL

I think it's likely I'm "Complaining" about something completely off topic. Please return to your regular programming

morningz · June 13, 2020, 9:54pm

I had pieced together this flow which saves the important files on every restart of Node-RED

I started, but hadn't finished, a script to clean out flows older than a certain point so it doesn't clog up disk space.

Anyways, this has been working great and has saved me a few times

gist.github.com

https://gist.github.com/MorningZ/c3cef64a38b27e289dab0c8c0603dcc9

node-red-backup-on-reboot.json

[{"id":"e0be58b2.7ddf98","type":"file in","z":"e9d24fcf.7516d","name":"Flows","filename":"/config/node-red/flows.json","format":"utf8","x":355,"y":100,"wires":[["a2f5e367.c78e3"]],"l":false},{"id":"959b7810.2ab598","type":"file","z":"e9d24fcf.7516d","name":"Flows","filename":"","appendNewline":false,"createDir":true,"overwriteFile":"true","x":510,"y":100,"wires":[["5b4ffafb.686684"]]},{"id":"84dbd1e4.78bc","type":"inject","z":"e9d24fcf.7516d","name":"Create Backups","topic":"","payload":"restarted","payloadType":"str","repeat":"","crontab":"","once":true,"onceDelay":"300","x":420,"y":58,"wires":[["e0be58b2.7ddf98"]]},{"id":"a2f5e367.c78e3","type":"function","z":"e9d24fcf.7516d","name":"Set filename","func":"\n// Add file name from ISO date: 2020-04-25T23:13:54.138Z\nlet hit = (new Date()).toISOString().match(/^(\\d{4})[-](\\d{1,2})[-](\\d{2})[T](\\d{2})[:](\\d{2})/);\n\nmsg.filename = \"/config/node-red/backups/\" + hit[1] + \"-\" + hit[2] + \"/\" + hit[3] + hit[4] + hit[5] + \"_flows.json\";\n\nreturn msg;","outputs":1,"noerr":0,"x":415,"y":100,"wires":[["959b7810.2ab598"]],"l":false},{"id":"5b4ffafb.686684","type":"file in","z":"e9d24fcf.7516d","name":"Credentials","filename":"/config/node-red/flows_cred.json","format":"utf8","x":355,"y":151,"wires":[["f853a265.9502a"]],"l":false},{"id":"91da96d1.300c68","type":"file","z":"e9d24fcf.7516d","name":"Creds","filename":"","appendNewline":false,"createDir":false,"overwriteFile":"true","x":510,"y":151,"wires":[["e0ad5c84.4527a"]]},{"id":"f853a265.9502a","type":"function","z":"e9d24fcf.7516d","name":"Set filename","func":"\n// Add file name from ISO date: 2020-04-25T23:13:54.138Z\nlet hit = (new Date()).toISOString().match(/^(\\d{4})[-](\\d{1,2})[-](\\d{2})[T](\\d{2})[:](\\d{2})/);\n\nmsg.filename = \"/config/node-red/backups/\" + hit[1] + \"-\" + hit[2] + \"/\" + hit[3] + hit[4] + hit[5] + \"_creds.json\";\n\nreturn msg;","outputs":1,"noerr":0,"x":415,"y":151,"wires":[["91da96d1.300c68"]],"l":false},{"id":"e0ad5c84.4527a","type":"file in","z":"e9d24fcf.7516d","name":"Settings","filename":"/config/node-red/settings.js","format":"utf8","x":355,"y":200,"wires":[["bdedd058.1810c"]],"l":false},{"id":"76aa3882.1cfe38","type":"file","z":"e9d24fcf.7516d","name":"Settings","filename":"","appendNewline":false,"createDir":false,"overwriteFile":"true","x":520,"y":200,"wires":[[]]},{"id":"bdedd058.1810c","type":"function","z":"e9d24fcf.7516d","name":"Set filename","func":"\n// Add file name from ISO date: 2020-04-25T23:13:54.138Z\nlet hit = (new Date()).toISOString().match(/^(\\d{4})[-](\\d{1,2})[-](\\d{2})[T](\\d{2})[:](\\d{2})/);\n\nmsg.filename = \"/config/node-red/backups/\" + hit[1] + \"-\" + hit[2] + \"/\" + hit[3] + hit[4] + hit[5] + \"_settings.js\";\n\nreturn msg;","outputs":1,"noerr":0,"x":415,"y":200,"wires":[["76aa3882.1cfe38"]],"l":false}]

(side note: yay for a Node-RED sub category!)

aaiyar · June 13, 2020, 9:57pm

Not a sub-category. As of now, it is just a tag (can be added to a post in any category).

morningz · June 13, 2020, 9:59pm

meh, semantics... i can easily see all threads with NR now... i'll take what I can get, anyone can call it what they want

mike · July 15, 2020, 7:50am

morningz:

nyways, this has been working great and has saved me a few times

gist.github.com

Node-RED: Backup flows and settings on restsrt · GitHub

node-red-backup-on-reboot.json
[{"id":"e0be58b2.7ddf98","type":"file in","z":"e9d24fcf.7516d","name":"Flows","filename":

Thanks for this. I found and used it today. Now backing up my flows/creds/settings.

Question: is your msg.payload = restarted something you do, or a system command. I searched but there's a whole stack of discussion about restarting node red which clouded my results.

morningz · July 15, 2020, 11:41am

I don't remember why that is there to be honest.. it doesn't appear to be actually part of any decisions.

Maybe it was just there from wherever I got the flow from.

erktrek · July 15, 2020, 12:43pm

For one of my residential projects I have an HE and RPi4 running NR. One of my concerns is SD corruption so have a low profile usb drive plugged into the RPi and am running rpi-clone in cron. It clones the disk every month to the usb drive.

If there is an issue I should be able to boot from the USB drive if needed. Another thing I did on the RPi was to create a simple bash script that uses wget to pull backups from the HE hub and store them in a backup dir - rotating the backups as needed. That is running in cron as well.

JasonJoel · July 15, 2020, 1:19pm

I do this for remote RPi backups:

I would do rpi-clone if I wanted local backups to usb, though.

douglaspitman · October 19, 2020, 10:23pm

@morningz I'm using a raspberry pi and no disk. (trying to get network storage to mount but struggling) Where would the backup flow you talk about in 25 store the three files? I'm not a programmer so I am going slow with the stuff I don't understand completely...

morningz · October 20, 2020, 12:46am

You define where it goes in the "file node". This seemed like a handy location when running NR with the Home Assistant integration.

system · September 19, 2022, 5:58pm

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed.