Results of SL-COMP'18 division qf_shls_entl

Overview

Solver config solved time wrong timeout failed unknown
Asterix v18 296 3.7 0 0 0 0
CYCLIST default 57 12.2 0 152 0 87
S2S v2 296 22.4 0 0 0 0
SLEEK default 277 19.6 19 0 0 0
SLIDE v5 1 0.3 0 0 0 295
Songbird v2 296 495.6 0 0 0 0
SPEN PR 289 19.2 5 0 0 2
SPEN TA 290 18.6 4 0 0 2

Asterix

Round 3: July 10th

  • Version: Asterix (id 20618)
  • Configuration: default
  • Pre-processor: SL-ASTERIX (451)
  • Job Id: 29852
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB

Round 2: July 9th

  • Version: Asterix-cpp (id 986)
  • Configuration: default
  • Pre-processor: SL-ASTERIX (435)
  • Job Id: 29779
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB, failed on pre-processor

Round 1: July 8th

  • Version: Asterix-cpp (id 986)
  • Configuration: default.sh
  • Pre-processor: SL-ASTERIX (435)
  • Job Id: 29748
  • Comments: run with 120 sec of timeout and 1 GB, all 'unknown' failed on pre-processor

ComSPEN

Round 3: July 10th

  • Version: COMSPEN (id )
  • Configuration: cspen
  • Pre-processor: SL-ASTERIX (435)
  • Job Id:
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB, pre-processor ok, wait updated binary

Round 2: July 9th

  • Version: COMSPEN (id 20429)
  • Configuration: default
  • Pre-processor: SL-COMSPEN (id 447)
  • Job Id: 29788
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB, pre-processor ok, fails unexpectly and silently

Round 1: July 8th, problem with pre-processor

CYCLIST-SL

Round 3: July 10th

  • Version: CYCLIST (id 1136)
  • Configuration: default
  • Pre-processor: SL-CYCLIST (id 437)
  • Job Id: 29854
  • Page: StarExec
  • Comments: run with 2400 sec of timeout and 4GB

Round 2: July 9th

  • Version: CYCLIST (id 1136)
  • Configuration: default
  • Pre-processor: SL-CYCLIST (id 437)
  • Job Id: 29789
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4GB, 154/296 problems ressourced out

Round 1: July 8th

  • Version: CYCLIST (id 1136)
  • Configuration: default
  • Pre-processor: SL-CYCLIST (id 437)
  • Job Id: 29608
  • Page: StarExec
  • Comments: run with 120 sec of timeout and 1 GB, 155/296 problems ressourced out

S2S

Round 2: July 9th, DONE?

  • Version: S2S v2 (id 20562)
  • Configuration: default
  • Pre-processor: SL-S2S (id 445)
  • Job Id: 29790
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4GB

Round 1: July 8th, absent, problem with pre-processor

Sleek

Round 2: July 9th, DONE?

  • Version: SLEEK (id 20564)
  • Configuration: default
  • Pre-processors: SL-SLEEK (id 438)
  • Job Id: 29791
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB, 0 problems resssourced out

Round 1: July 8th

  • Version: SLEEK (id 20432)
  • Configuration: default
  • Pre-processors: SL-SLEEK (id 438)
  • Job Id: 29612
  • Page: StarExec
  • Comments: run with 120 sec of timeout and 1 GB, 0 problems resourced out

Slide

Round 2: July 9th, DONE?

  • Version: slide-2018-v4 (id 20428)
  • Configuration: SLDinput
  • Pre-processors: SL-SLIDE (id 441)
  • Job Id: 29792
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB, 0 problems resourced out

Round 1: July 8th

  • Version: slide-2018-v4 (id 20428)
  • Configuration: SLDinput
  • Pre-processors: SL-SLIDE (id 441)
  • Job Id: 29615
  • Page: StarExec
  • Comments: run with 120 sec of timeout and 1 GB, 0 problems ressourced out, 1/296 solved

Songbird

Round 3: July 10th

  • Version: Songbird v2 (id )
  • Configuration: songbird.sh
  • Pre-processor: SL-SONGBIRD (id 440)
  • Job Id: 29855
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB

Round 2: July 9th

  • Version: Songbird (id 20581)
  • Configuration: songbird.sh
  • Pre-processor: SL-SONGBIRD (id 440)
  • Job Id: 29784
  • Page: [[][StarExec]]
  • Comments: run with 600 sec of timeout and 4 GB; team require to update

Round 1: July 8th

  • Version: Songbird (id 20462 deleted)
  • Configuration: deleted
  • Pre-processor: SL-SONGBIRD (id 440)
  • Job Id: 29617
  • Comments: run with 120 sec of timeout and 1 GB, 0/296 problems ressourced out, all 'unknown'

SPEN

Round 3: July 10th

  • Version: SPEN v18 (id 20561)
  • Pre-processor: SL-SPEN (id 430)
  • Configuration: qfshls, qfshlid
  • Job Id: 29856
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB

Round 2: July 9th

  • Version: SPEN v18 (id 20561)
  • Pre-processor: SL-SPEN (id 430)
  • Configuration: qfshls
  • Job Id: 29794
  • Page: StarExec
  • Comments: run with 600 sec of timeout and 4 GB, 0 problems ressourced out, unexpected core dumps

Round 1: July 8th

  • Version: SPEN v18 (id 20561)
  • Pre-processor: SL-SPEN (id 430)
  • Configuration: qfshls
  • Job Id: 29606
  • Page: StarExec
  • Comments: run with 120 sec of timeout and 1 GB, 0/296 problems ressourced out
    • fail because of error 'Unable to open /etc/scl/conf/devtoolset-7'

Author: Mihaela Sighireanu

Created: 2018-07-14 Sat 14:18

Validate