Skip to content

Unexpected fault during test does not cause test failure #12089

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
pizi-nordic opened this issue Dec 14, 2018 · 1 comment
Closed

Unexpected fault during test does not cause test failure #12089

pizi-nordic opened this issue Dec 14, 2018 · 1 comment
Assignees
Labels
area: Tests Issues related to a particular existing or missing test bug The issue is a bug, or the PR is fixing a bug priority: medium Medium impact/importance bug

Comments

@pizi-nordic
Copy link
Collaborator

pizi-nordic commented Dec 14, 2018

Describe the bug
Faults during tests are not treated as test failure:

(...)
starting test - test_mutex_lock_timeout                 
***** MPU FAULT *****                                   
  Data Access Violation                                 
  MMFAR Address: 0xe                                    
***** Hardware exception *****                          
Current thread ID = 0x20000468                          
Faulting instruction address = 0xfbbc                   
Fatal fault in thread 0x20000468! Aborting.             
PASS - test_mutex_lock_timeout                          
========================================================
starting test - test_semaphore                          
PASS - test_semaphore                                   
========================================================
starting test - test_mempool                            
***** BUS FAULT *****                                   
  Imprecise data bus error                              
***** Hardware exception *****                          
Current thread ID = 0x20000518                          
Faulting instruction address = 0xf942                   
Fatal fault in thread 0x20000518! Aborting.             
PASS - test_mempool                                     
(...)
===================================================================
PROJECT EXECUTION SUCCESSFUL

To Reproduce
Trigger unexpected fault during test.

Expected behavior
Any unexpected fault should result in test failure.

@pizi-nordic pizi-nordic added the bug The issue is a bug, or the PR is fixing a bug label Dec 14, 2018
@nashif nashif added the priority: medium Medium impact/importance bug label Jan 10, 2019
@nashif nashif self-assigned this Jan 11, 2019
@nashif
Copy link
Member

nashif commented Mar 3, 2019

this type of failures is caught when run in sanitycheck, when we run those tests on the command line there is no way to capture those exceptions, unless the test actually fails because of them.
Sanitycheck on the other hand looks for those exceptions and fails the test even if it reports success.

@nashif nashif closed this as completed Mar 3, 2019
@nashif nashif added the area: Tests Issues related to a particular existing or missing test label Mar 3, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: Tests Issues related to a particular existing or missing test bug The issue is a bug, or the PR is fixing a bug priority: medium Medium impact/importance bug
Projects
None yet
Development

No branches or pull requests

2 participants