Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

nsuite validation fails—how to proceed? #88

Open
heplesser opened this issue Sep 17, 2019 · 1 comment
Open

nsuite validation fails—how to proceed? #88

heplesser opened this issue Sep 17, 2019 · 1 comment
Assignees
@halfflat

Comments

@heplesser
Copy link

On one system I tested, nsuite validation results in

==  Running validation for arbor:
[FAIL] arbor rc-exp2syn-spike/default
[PASS] arbor rc-expsyn/default
[PASS] arbor rc-expsyn/highcurrent

The run.out file is

spike.abserr<0.03: fail

I am unsure how to proceed.
@halfflat
Copy link
Contributor

Apologies for not getting back to you on this!

Our pass/fail criteria are too stringent to be useful in judging validity, but not informative enough to track improvement. The reported fail for arbor rc-exp2syn-spike/default is in fact not severe.

We really hope to address this Very Soon, by moving to quantitative reporting on deviations from reference solutions (issue #79(.

@halfflat halfflat self-assigned this Jan 29, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@halfflat halfflat

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@halfflat @heplesser