SL-COMP'19
Glossary
Podium
- Best solver has ***** , second has **** , etc.
- A solver with negative score does not receive * , but may receive ☕ due to its good number of solved problems.
RO
- Resourced out in time or memory
Scoring
- The score is computed by 10*solved + (-1)*false-positive + (-10)*false-negative
where:
- false-positive: problem solved with result 'sat' instead the expected 'unsat'; this result is sound for program verification but not precise.
- false-negative: problem solved with result 'unsat' instead of the expected 'sat'; this result is not sound for program verification.
VBS
- Virtually Best Solver: the solver which would be the best for the division.
- It is computed by taking the minimum time for each problem over all solvers.
- The contribution of each solver to VBS is the number of problems the solver is the fastest.