On Tue, 2005-04-05 at 10:55 -0400, Andrew Overholt wrote:
Hi,
I was talking with Billy last night about Eclipse unit tests and I ran the
UI ones this morning. There are 806 tests and we get 152 Errors and 40
Failures. 144 of the 152 Errors are from
org.eclipse.ui.tests.dnd.DragTestSuite in which Billy said to expect errors
(since this is 3.1M5a I'm testing).
I'd like to set things up to run these automatically (Aaron is looking into
it) and get some hard data that we can work with.
I've been working on running them with a headless eclipse as outlined
here,
http://download.eclipse.org/eclipse/downloads/drops/S-3.1M5a-200502191500...
and using 3.0 have been able to run them however using 3.1 M5 I've been
unable to successfully run them due to a number of issues.
First the instructions on the page appear to be incomplete, first the
runtests script requires a directory
test-eclipse/eclipse
which is not created by the script, as well the line
unzip -qq -o -C eclipse-junit-tests-*.zip */plugins/org.eclipse.test*
does not fully expand the tests.
To run them successfully on 3.0.1 I run
unzip eclipse-SDK-*.zip
unzip eclipse-junit-*.zip
mkdir test-eclipse
cp -r eclipse test-eclipse/
./runtests -os linux -ws gtk -arch x86 -vm /usr/lib/jvm/java-1.4.2-
ibm-1.4.2.1//jre/bin/java -noclean
which works, however of M5 using the identical steps (with zips changed
to tar.gz) I get
Buildfile: test.xml
all:
jdttext:
runtests:
setup:
junit:
init:
BUILD FAILED
/notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse-
testing/test.xml:299: The following error occurred while executing this
line:
/notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse-
testing/test.xml:155: The following error occurred while executing this
line:
/notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse-
testing/test.xml:84: The following error occurred while executing this
line:
/notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse-
testing/test.xml:65: The following error occurred while executing this
line:
/notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse-
testing/test-
eclipse/eclipse/plugins/org.eclipse.jdt.text.tests_3.1.0/test.xml:17:
org.eclipse.ant.core.AntSecurityException
Total time: 1 second
Aaron