Menu

SherLog: Error Diagnosis by Connecting Clues from Run-time Logs

We introduce SherLog, a tool that analyzes source code by leveraging information provided by run-time logs to infer what must or may have happened during a failed production run.

Computer systems often fail due to many factors such as software bugs or administrator errors. Diagnosing such production run failures is an important but challenging task since it is difficult to reproduce them in house due to various reasons: (1) unavailability of users’ inputs and file content due to privacy concerns; (2) difficulty in building the exact same execution environment; and (3) non-determinism of concurrent executions on multi-processors.

Therefore, programmers often have to diagnose a production run failure based on logs collected back from customers and the corresponding source code. Such diagnosis requires expert knowledge and is also too time-consuming, tedious to narrow down root causes. To address this problem, we propose a tool, called SherLog, that analyzes source code by leveraging information provided by run-time logs to infer what must or may have happened during the failed production run. It requires neither re-execution of the program nor knowledge on the log’s semantics. It infers both control and data value information regarding to the failed execution.

We evaluate SherLog with 8 representative real world software failures (6 software bugs and 2 configuration errors) from 7 applications including 3 servers. Information inferred by SherLog are very useful for programmers to diagnose these evaluated failures. Our results also show that SherLog can analyze large server applications such as Apache with thousands of logging messages within only 40 minutes.

In Proceedings of the 15th Edition of ASPLOS on Architecture Support for Programming Languages and Operating Systems 2010 (ASPLOS ’10)

Resources

The author’s version of the paper is attached to this posting, please observe the following copyright:© ACM, 2010. This is the author’s version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in the Proceedings of the 15th Edition of ASPLOS on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’10), https://dl.acm.org/citation.cfm?doid=1736020.1736038.

The definitive version of this paper can be found at: https://dl.acm.org/citation.cfm?doid=1736020.1736038.

asplos10-sherlog.pdf