Tuesday 17 December 2019

Ezproxy harvest now automated

Just in time for the Christmas break, I have got the harvesting of our ezproxy logs fully automated.

From now on, a shell script will run in the early hours of each morning on our ezproxy server.  This gathers the latest day's worth of log data, reformats it, and then loads it all into our MySQL database.

It means I can leave the process running without manual intervention (which had taken the form of weekly FTPs of log files and manual script-running), and start concentrating on working with colleagues to:

  • come up with a useful dashboard of commonly-needed information
  • devise some more challenging questions to pose about usage patterns with our electronic resources
I will save that fun until 2020.

It should also mean that I can start stepping back from the process, and leave colleagues with a useful new facility for looking at patterns of usage data that have always been unavailable to us in any usable form until now.


No comments:

Post a Comment