EclipseZone - Eclipse test-suite ...

The Rich Engineering Heritage Behind Dependency Injection

Andrew McVeigh takes us on a tour of the rich heritage behind dependency injection, what it represents, and tells us why its here to stay.

Java, the OLPC, and community responsibility

The "One Laptop Per Child" project has a great device ready to ship, but there's no Java on there. Let's think about working together to put Java on OLPC!

Replies: 6 - Pages: 1
Threads: [ Previous | Next ]

Reply 1. At 3:40 AM on Aug 5, 2008, Daniel Megert wrote:: Re: Eclipse test-suite
Nikita Lipsky wrote:
> Hello everyone!
>
> Could anybody give me a link to the whole test-suite that is used for
> releasing the Eclipse IDE?
> At this page of eclipsepedia
> --http://wiki.eclipse.org/Automated_Testing#Correctness_tests --
> It is explained how to run the Eclipse tests and short list of plugins
> (not all though) that I will likely need for this.
>
> However, there is no link to how to download and install these
> plugins. I failed to find the plugins by myself: I have found them in
> CVS repository but not in downloadable form. So do they exist in a
> public available binary form?
Each download page contains different downloads. Among them are normally
also the tests.
e.g.
http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/index.php

Dani
>
> Thanx,
> Nikita
>
>
>
>
>
Reply 2. At 4:54 AM on Aug 6, 2008, Nikita Lipsky wrote:: Re: Eclipse test-suite
Thank you very much!

It is exactly what I was looking for

--Nikita

"Daniel Megert" wrote in message
news:g7904k$6a0$1 at build dot eclipse dot org...
> Nikita Lipsky wrote:
>> Hello everyone!
>>
>> Could anybody give me a link to the whole test-suite that is used for
>> releasing the Eclipse IDE?
>> At this page of
>> eclipsepedia --http://wiki.eclipse.org/Automated_Testing#Correctness_tests
>> --
>> It is explained how to run the Eclipse tests and short list of plugins
>> (not all though) that I will likely need for this.
>>
>> However, there is no link to how to download and install these plugins.
>> I failed to find the plugins by myself: I have found them in CVS
>> repository but not in downloadable form. So do they exist in a public
>> available binary form?
> Each download page contains different downloads. Among them are normally
> also the tests.
> e.g.
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/index.php
>
> Dani
>>
>> Thanx,
>> Nikita
>>
>>
>>
>>
>>
Reply 3. At 5:53 AM on Aug 7, 2008, Nikita Lipsky wrote:: Re: Eclipse test-suite
Hello again,

Ok, I have passed the tests and got 44 .html files with results. Is there
any way to combine them together to see overall results in one html file
like
http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/testResults.php ?

There are some failures in results. There is a note in results "failures are
anticipated and checked for with assertions while errors are unanticipated."
So should I think that test passes if it fails by failure not by error?

Is there a way to pass a test (not a group of tests) separately? Do I need
check out the test or the group of tests from CVS for this? Is there any GUI
(plug-in to Eclipse?) for running tests separately and configuring them like
JCK JavaTest harness?

Regards,
--Nikita

"Daniel Megert" wrote in message
news:g7904k$6a0$1 at build dot eclipse dot org...
> Nikita Lipsky wrote:
>> Hello everyone!
>>
>> Could anybody give me a link to the whole test-suite that is used for
>> releasing the Eclipse IDE?
>> At this page of
>> eclipsepedia --http://wiki.eclipse.org/Automated_Testing#Correctness_tests
>> --
>> It is explained how to run the Eclipse tests and short list of plugins
>> (not all though) that I will likely need for this.
>>
>> However, there is no link to how to download and install these plugins.
>> I failed to find the plugins by myself: I have found them in CVS
>> repository but not in downloadable form. So do they exist in a public
>> available binary form?
> Each download page contains different downloads. Among them are normally
> also the tests.
> e.g.
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/index.php
>
> Dani
>>
>> Thanx,
>> Nikita
>>
>>
>>
>>
>>
Reply 4. At 4:08 AM on Aug 11, 2008, Daniel Megert wrote:: Re: Eclipse test-suite
Nikita Lipsky wrote:
> Hello again,
>
> Ok, I have passed the tests and got 44 .html files with results. Is
> there any way to combine them together to see overall results in one
> html file like
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/testResults.php
> ?
>
> There are some failures in results. There is a note in results
> "failures are anticipated and checked for with assertions while errors
> are unanticipated." So should I think that test passes if it fails by
> failure not by error?
Do you have a concrete example? Normally the test should either be green
or red but might log some errors in the console even if the test itself
is green.
>
> Is there a way to pass a test (not a group of tests) separately? Do I
> need check out the test or the group of tests from CVS for this? Is
> there any GUI (plug-in to Eclipse?) for running tests separately and
> configuring them like JCK JavaTest harness?
AFAIK there's no GUI.

You might find some answers here:
http://wiki.eclipse.org/index.php/Platform-releng-faq

Dani
>
> Regards,
> --Nikita
>
>
>
> "Daniel Megert" wrote in message
> news:g7904k$6a0$1 at build dot eclipse dot org...
>> Nikita Lipsky wrote:
>>> Hello everyone!
>>>
>>> Could anybody give me a link to the whole test-suite that is used
>>> for releasing the Eclipse IDE?
>>> At this page of eclipsepedia
>>> --http://wiki.eclipse.org/Automated_Testing#Correctness_tests --
>>> It is explained how to run the Eclipse tests and short list of
>>> plugins (not all though) that I will likely need for this.
>>>
>>> However, there is no link to how to download and install these
>>> plugins. I failed to find the plugins by myself: I have found them
>>> in CVS repository but not in downloadable form. So do they exist in
>>> a public available binary form?
>> Each download page contains different downloads. Among them are
>> normally also the tests.
>> e.g.
>> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/index.php
>>
>>
>> Dani
>>>
>>> Thanx,
>>> Nikita
>>>
>>>
>>>
>>>
>>>
>
Reply 5. At 3:58 AM on Aug 12, 2008, Nikita Lipsky wrote:: Re: Eclipse test-suite

"Daniel Megert" wrote in message
news:g7os1d$3fr$1 at build dot eclipse dot org...

>> There are some failures in results. There is a note in results "failures
>> are anticipated and checked for with assertions while errors are
>> unanticipated." So should I think that test passes if it fails by failure
>> not by error?
> Do you have a concrete example? Normally the test should either be green
> or red but might log some errors in the console even if the test itself is
> green.

See for instance this link:
http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/testresults/html/org.eclipse.releng.tests_linux.gtk.x86.html

There is 1 failtire, sucess rate 80%, however it is reported in the overall
page as all-passed: "(0)"

> You might find some answers here:
> http://wiki.eclipse.org/index.php/Platform-releng-faq
>
Thank you, I will check it.

Regards,
Nikita
Reply 6. At 4:21 AM on Aug 12, 2008, Daniel Megert wrote:: Re: Eclipse test-suite
Nikita Lipsky wrote:
>
> "Daniel Megert" wrote in message
> news:g7os1d$3fr$1 at build dot eclipse dot org...
>
>>> There are some failures in results. There is a note in results
>>> "failures are anticipated and checked for with assertions while
>>> errors are unanticipated." So should I think that test passes if it
>>> fails by failure not by error?
>> Do you have a concrete example? Normally the test should either be
>> green or red but might log some errors in the console even if the
>> test itself is green.
>
> See for instance this link:
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/testresults/html/org.eclipse.releng.tests_linux.gtk.x86.html
>
>
> There is 1 failtire, sucess rate 80%, however it is reported in the
> overall page as all-passed: "(0)"
Yes, that was "fixed" manually on the main page(s) because the reported
error was known/intended. This is also done when a test fails for
unknown reasons and a rerun makes the failure go away: instead of doing
a full rebuild the pages are adjusted manually.

Dani
>
>> You might find some answers here:
>> http://wiki.eclipse.org/index.php/Platform-releng-faq
>>
> Thank you, I will check it.
>
> Regards,
> Nikita