System to understand where CI resources are actually being spent

Ideally, we would be able to see how much cpu-hours, ram-hours, and the like are being spent on each job in CI and from what triggers so we could focus our attention on optimizing our resource usage in the right places. That being said, even simple job run counts would help inform some of what we'd like to do.

It would be really cool if we could get real-time and historical graphs of usage and run counts using something like nagios, ganglia, grafana, logstash or some combination.