Book a Demo

Author Topic: Collecting Test Results from Testscripts, how?  (Read 2848 times)

ajabs

  • EA Novice
  • *
  • Posts: 2
  • Karma: +0/-0
  • I love YaBB 1G - SP1!
    • View Profile
Collecting Test Results from Testscripts, how?
« on: November 28, 2007, 06:07:17 am »
Hello,

I have some questions about the possibility to parse test results in EA. I want to build on that functionality without using JUnit/NUnit.

1. My Tests are written in python using nose. I could emulate JUnit/NUnit output, if i knew what EA is matching in
the output.
Can someone give me a hint on what i could try to get the test results into EA?
At the moment, EA thinks all tests have passed, since it seems it cannot parse my output, although i try to emulate NUnit output.

2. So far, I can only manage to create a connection between a "Test" buildscript and Testscript entries on a class, if that class is the result of a transformation. Can I somehow connect Tests assigned to an object to the output of a "Test" buildscript *without* having to transform a class?
At the moment, i reverse engineer a dummyclass from my testclass, transform that dummy class using a NUnit-like Transformation to obtain a model for my testclass.
Then i connect a testscript, and thus get testscript entries generated in my testclass.
Obviusoly, I would like to skip that step and directly link NUnit/JUnit-style output to likenamed tests in my model.
How could I achieve that?

thanks,

Eve

  • EA Administrator
  • EA Guru
  • *****
  • Posts: 8110
  • Karma: +119/-20
    • View Profile
Re: Collecting Test Results from Testscripts, how?
« Reply #1 on: November 28, 2007, 01:03:27 pm »
1. Your output should have...

  • following.
  • Any text up until the string "Tests run:"
  • On a new line the text "Failures"
  • Each failure will then be a number followed by a right parenthis ")" and a fully qualified name (Namespace + class + method) a colon ":" any text until the string "at" any text until the string "in" a file path the string ":line" followed by the line number.
  • No more text should follow.


2. EA looks for classes/methods with the appropriate tagged values to generate the C# attributes that identify the class and method to NUnit.  (A similar thing for JUnit) If you add these tags yourself to your general test methods you should be fine.

ajabs

  • EA Novice
  • *
  • Posts: 2
  • Karma: +0/-0
  • I love YaBB 1G - SP1!
    • View Profile
Re: Collecting Test Results from Testscripts, how?
« Reply #2 on: November 29, 2007, 01:54:09 am »
Simon, thank you for the quick response.

That was the missing link.
The tags feature eluded me somewhat, up to now.
Tags are now set up and working, now off to munge my output....