[NETVIRT-1149] CSIT job log scraper to search for certain data

Mon, 30 Apr 2018 12:02:51 +0000

It is difficult and time consuming to inspect multiple job logs to find data, such as trying to find the first job that an exception appeared, or finding a test failure looking through jobs that are not in the last 30 provided by the jenkins gui that show the pass/fail results. The jenkins gui only keeps the last 30 jobs so it is difficult to correlate the test-patch/gate triggers to the actual job that ran - the test-patch job starts the gate jobs, but only those last 30 test-patch jobs are kept. The logs are there but not the nice, easy gui interface.

The scraper could take such input and then curl for the jobs and look for the specific data.

Scrapers to add:

scrape exceptions, looking for first that a specific exception appeared in, list gerrits
scrape exceptions, looking for first that a specific exception stopped appearing, list gerrits
scrape and generate report showing more than the last 30 test-patch jobs, list test failures and gerrits per job

OpenDaylight JIRA

[NETVIRT-1149] CSIT job log scraper to search for certain data