New ol-home0 Crons need to run/trigger ol-www1 ipstats

[mekarpeles]

We need our new Crons on ol-home0 to run or trigger the following via ssh on ol-www1:

source /opt/openlibrary/venv/bin/activate;sudo /opt/openlibrary/venv/bin/python /opt/openlibrary/openlibrary/scripts/ipstats.py /opt/openlibrary/olsystem/etc/openlibrary.yml from ol-www1

Originally posted by @mekarpeles in #2481 (comment)

Related:

• Move ol-home / ol-www ipstats cron job + ol-home solr to ol-home0 #4775

[mekarpeles]

This may have been solved -- I manually updated updated /etc/cron.d/openlibrary to look like:

MAILTO=""
SCRIPTS=/opt/openlibrary/openlibrary/scripts
LOG=/var/log/openlibrary

# OL data dumps
0 20 1 * * openlibrary /olsystem/bin/verify-node.sh ol-www1 && mkdir -p /1/var/lib/openlibrary/sitemaps && rsync -av --delete rsync://ol-home/var_1/tmp/sitemaps/sitemaps /1/var/lib/openlibrary/sitemaps/

PYTHON_EGG_CACHE="/tmp/ol-egg-cache"
# Admin section count updates
0 * * * * www-data /olsystem/bin/verify-node.sh ol-www1 && /olsystem/bin/olenv $SCRIPTS/ipstats.py  /opt/openlibrary/olsystem/etc/openlibrary.yml
59 23 * * * www-data /olsystem/bin/verify-node.sh ol-www1 && /olsystem/bin/olenv $SCRIPTS/ipstats.py  /opt/openlibrary/olsystem/etc/openlibrary.yml

@cdrini + @cclauss -- note that the above is rsyncing to ol-home for sitemaps!!! Probably what we want? But just fyi.

I then used 🙈 forcefully removed /var/run/crond.pid lockfile (as it seemed like things were not behaving correctly) with sudo rm /var/run/crond.pid and then I ran sudo cron restart and then /etc/init.d/cron status to verify it was running.

I then tail'ed /var/log/cron.log and saw:

May  8 02:00:01 ol-www1.us.archive.org CRON[22653]: (www-data) CMD (/olsystem/bin/verify-node.sh ol-www1 && /olsystem/bin/olenv $SCRIPTS/ipstats.py  /opt/openlibrary/olsystem/etc/openlibrary.yml)

Which looks promising!

[mekarpeles]

I re-ran crontab /etc/cron.d/openlibrary on ol-www1 and it looks like the latest up-to-date ol-www1 cron may now be running.

If it is, we can lower the priority of this task until we're ready to migrate ol-www1 to ol-www0 see #4252

[cdrini]

Closed in favour of #7622