From ff85876719777d7e375368f73ec0c150a134f291 Mon Sep 17 00:00:00 2001 From: Daisuke Nojiri Date: Wed, 12 Apr 2017 09:48:10 -0700 Subject: eCTS: Check order and expectation of test results This patch makes the framework verify not only the result but also the execution order of the tests. It also allows each test to specify expected return code and strings printed by TH and DUT. The final test results depends on the return code and the expectation. Therefore, the output now includes 'RESULT' column showing PASS or FAIL: test name TH_RETURN_CODE DUT_RETURN_CODE TH_STR DUT_STR RESULT test_task_switch SUCCESS SUCCESS 1 1 PASS test_task_priority SUCCESS FAILURE 1 1 FAIL test_stack_overflow DID_NOT_END DID_NOT_END 1 1 PASS Additionally, this patch: * Adds CTS_RC_DID_NOT_START and CTS_RC_DID_NOT_END to indicate whether the test did start or end, respectively. * Makes stack overflow test check whether stack overflow was detected and reboot occurred * Removes post_corruption_test and conflict test since now the test results are stricly compared against expected results. * Fixes gpylint errors. BUG=none BRANCH=none TEST=Run gpio, meta, timer, interrupt, and cts/cts.py -m task Change-Id: I3b7005236e705dcac0c8f4711b44c85ff9a4f676 Reviewed-on: https://chromium-review.googlesource.com/538878 Commit-Ready: Daisuke Nojiri Tested-by: Daisuke Nojiri Reviewed-by: Daisuke Nojiri --- cts/interrupt/cts.testlist | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) (limited to 'cts/interrupt/cts.testlist') diff --git a/cts/interrupt/cts.testlist b/cts/interrupt/cts.testlist index 6e0265ed60..0fdaf6fca2 100644 --- a/cts/interrupt/cts.testlist +++ b/cts/interrupt/cts.testlist @@ -4,14 +4,14 @@ */ /* Test interrupt_enable/disable */ -CTS_TEST(test_interrupt_enable) -CTS_TEST(test_interrupt_disable) +CTS_TEST(test_interrupt_enable,,,,) +CTS_TEST(test_interrupt_disable,,,,) /* Test task_wait_for_event */ -CTS_TEST(test_task_wait_event) +CTS_TEST(test_task_wait_event,,,,) /* Test task_disable_irq */ -CTS_TEST(test_task_disable_irq) +CTS_TEST(test_task_disable_irq,,,,) /* Test nested interrupt. Lower priority IRQ is fired, followed by * higher priority IRQ. Handler executions should be nested. @@ -23,7 +23,7 @@ CTS_TEST(test_task_disable_irq) * task_cts ----* *---- * A B C D */ -CTS_TEST(test_nested_interrupt_low_high) +CTS_TEST(test_nested_interrupt_low_high,,,,) /* Test nested interrupt. Higher priority IRQ is fired, followed by * lower priority IRQ. Handlers should be executed sequentially. @@ -35,7 +35,7 @@ CTS_TEST(test_nested_interrupt_low_high) * task_cts ----* *---- * B C A D */ -CTS_TEST(test_nested_interrupt_high_low) +CTS_TEST(test_nested_interrupt_high_low,,,,) /* * Other ideas -- cgit v1.2.1