Skip to content

Jakarta EE 9.1 TCK results

Jump to bottom
Gurunandan Rao edited this page Mar 1, 2022 · 75 revisions

Certification results

Promoted TCK Bundle Location:

Jakarta EE TCK bundle 9.1 Version info wiki - https://github.com/eclipse-ee4j/jakartaee-tck/wiki/Jakarta-EE-9.1-TCKs-JDK-11-and-JDK-8-support

Certification of Standalone EFTL TCK bundles(including DSOL, JAF and MAIL TCK):

CI Job:

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-RC1.zip

JDK version: 11.0

Result : All Tests Pass!

Certification of Standalone EFTL TCK bundles(including DSOL, JAF and MAIL TCK):

CI Job:

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0.zip

JDK version: 1.8

Result : All Tests Pass!

Certification of Platform FULL PROFILE EFTL TCK bundles:

CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification/39/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-RC1.zip

JDK version: 11.0

Result : All Tests Pass!

Certification of Platform FULL PROFILE EFTL TCK bundles:

CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification/40/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0.zip

JDK version: 1.8

Result : All Tests Pass!

Certification of Platform WEB PROFILE EFTL TCK bundles:

CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification-web/29/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/web-6.1.0-RC1.zip

JDK version: 11.0

Result : All Tests Pass!

Certification of Platform WEB PROFILE EFTL TCK bundles:

CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification/40/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/web-6.0.0.zip

JDK version: 1.8

Result : All Tests Pass!

JAXB-TCK EFTL certification

CI Job : https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jaxbtck-certification/11/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-RC1.zip

JDK version: 11.0

Result : All Tests Pass!

JAXB-TCK EFTL certification

CI Job : https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jaxbtck-certification/12/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0.zip

JDK version: 1.8

Result : All Tests Pass!

Certification of Standalone EPL TCK bundles(including CDI, DI, BV glassfish porting kits and DSOL TCK):

CI Job:

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-RC1.zip

JDK version: 11.0

Result : All Tests Pass!

Certification of Standalone EPL TCK bundles(including CDI, DI, BV glassfish porting kits and DSOL TCK):

CI Job:

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0.zip

JDK version: 1.8

Result : All Tests Pass!

Certification of Platform EPL TCK bundles:

CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/jakartaeetck-certification/101/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-RC1.zip

JDK version: 11.0

Result : All Tests Pass!

Certification of Platform EPL TCK bundles:

CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/jakartaeetck-certification/102

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0.zip

JDK version: 1.8

Result : All Tests Pass!

Weekly TCK results

Date : 2021-04-16

Full Platform TCK results with JDK11

CI Job: (https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/55/) with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1425/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1425/pipeline

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-RC1.zip

JDK Version: JDK11

Result: All Test Pass!

Standalone EFTL TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/61/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-RC1.zip

JDK Version: JDK11

Result: All Tests Pass!

Standalone EFTL TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/62/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0.zip

JDK Version: JDK8

Result: All Tests Pass!

Standalone EPL TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/standalonetck-nightly-build-run-910/24

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-RC1.zip

JDK Version: JDK11

Result: All Tests Pass!

Standalone EPL TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/standalonetck-nightly-build-run-910/25/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0.zip

JDK Version: JDK8

Result: All Tests Pass!

Date : 2021-04-08

Full Platform TCK results with JDK11

CI Job: (https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/51/) with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1387/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1387/pipeline

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JDK Version: JDK11

Result: All Tests Pass!

Full Platform TCK results with JDK8

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/52/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1388/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1388/pipeline

Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip

JDK Version: JDK8

Result: All Tests Pass!

Web Profile TCK results with JDK11

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/11/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1390/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1390/pipeline

Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip

JDK Version: JDK11

Result: All Tests Pass!

Web Profile TCK results with JDK8

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/13/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1392/testReport]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1392/pipeline

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/web-6.0.0.zip

JDK Version: JDK8

Result: All Tests Pass!

Standalone TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/54/

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JDK Version: JDK11

Result: All Tests Pass!

Date : 2020-03-29

Full Platform TCK certification

CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification/33/testReport/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-SNAPSHOT-nightly.zip

Result : All Tests Pass.

Web Profile TCK certification CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification-web/24/testReport/

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/web-6.1.0-SNAPSHOT-nightly.zip

Result : All Tests Pass

Certification using Promoted Standalone TCK job runs

The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs

CI Job: https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-standalonetck-certification/lastCompletedBuild/testReport/

EL TCK certification run (post fix) - https://ci.eclipse.org/jakartaee-tck/job/eftl-standalonetck-certification/lastBuild/testReport/

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.1.0-SNAPSHOT-nightly.zip

Result : All Tests Pass!!!

JAXB-TCK certification

CI Job : https://ci.eclipse.org/jakartaee-tck/job/eftl-jaxbtck-certification/10/testReport/

Result : All Tests Pass.

Date : 2021-03-26

Old (from EE 9) Standalone TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/standalonetck-certification/99/ with https://ci.eclipse.org/jakartaee-tck/job/standalonetck-certification/99/testReport/

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JDK Version: JDK11

Results: 3,060 failures:

  1. Common Annotations
  2. Authentication
  3. Authorization
  4. Concurrency
  5. Connector
  6. Expression Language (only signature tests)
  7. JSONB (only signature tests)
  8. JSONP (only signature tests)
  9. Messaging (only signature tests)
  10. Persistence ( only signature tests)
  11. Server Pages (only signature tests)
  12. Standard Tag Library
  13. RESTful Web Services (only signature tests)
  14. Security API
  15. Servlet
  16. SOAP with Attachments
  17. Enterprise Web Services
  18. Transactions

Date : 2021-03-22

Full Platform TCK results with JDK11

CI Job: (https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/50/) with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1346/artifact/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1346/pipeline

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JDK Version: JDK11

Result: All Tests Pass!

Full Platform TCK results with JDK8

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/46/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1338/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1338/pipeline

Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip

JDK Version: JDK8

Result: All Tests Pass!

Web Profile TCK results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/10/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1337/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1337/pipeline

Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip

JDK Version: JDK11

Result: All Tests Pass!

Standalone TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/48/

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JDK Version: JDK11

Results: All Tests Pass!

Date : 2021-03-15

Full Platform TCK results with JDK11

CI Job: (https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/30) with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1297/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1297/pipeline

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JDK Version: JDK11

Result :

Test group Failure count Issue link(s) Comments
ejb 323 https://github.com/eclipse-ee4j/glassfish/issues/23424 https://www.eclipse.org/lists/glassfish-dev/msg00993.html
ejb30/sec 87 https://github.com/eclipse-ee4j/glassfish/issues/23424 https://www.eclipse.org/lists/glassfish-dev/msg00993.html
ejb30/webservice 3 https://github.com/eclipse-ee4j/glassfish/issues/23412 Root cause same as JASPIC TCK NPE failures
jaxrs 46 https://github.com/eclipse-ee4j/jakartaee-tck/issues/653 Fix PR has been merged (https://github.com/eclipse-ee4j/jakartaee-tck/pull/663)
jstl 29 https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 Changes with COMPAT are passing, further testing is in progress(https://ci.eclipse.org/jakartaee-tck/job/guru/job/jakartaee-tck-guru/job/jstl-fix/lastCompletedBuild/testReport/)
securityapi 20 https://github.com/eclipse-ee4j/glassfish/issues/23418 Fix PR has been merged (https://github.com/eclipse-ee4j/glassfish/commit/bed5a76da65c5a8b17257a9e7f68306376ded9a9
servlet 2 Failures are not seen with latest Platform TCK run - https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1314/#showFailuresLink
signaturetest/javaee 4 Fix PR https://github.com/eclipse-ee4j/jakartaee-tck/pull/669 has been merged
webservices12 126 https://github.com/eclipse-ee4j/glassfish/issues/23412 Root cause same as JASPIC TCK NPE failures
webservices13 53 https://github.com/eclipse-ee4j/glassfish/issues/23412 Root cause same as JASPIC TCK NPE failures
Total failure count 693

Note:

  • Issue raised for loading derby classes - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627 has been fixed and closed.
  • Below testsuites ran without any failure's : appclient,assembly,concurrency,connector,ejb30/assembly,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/misc,ejb30/zombie,ejb32,el,integration,jacc,jaspic,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jta,rmiiiop,samples,websocket,xa
  • With the latest run https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1314/, for webservices12, now total test failures are 120.

Full Platform TCK results with JDK8

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/40/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1323/testReport]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1323/pipeline/155

Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip

JDK Version: JDK8

Result :

Test group Failure count Issue link(s)
webservices12 1
Total failure count 1

Note:

  • Below TCK's ran without any failure's : assembly,appclient,concurrency,connector,ejb,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/assembly,ejb30/timer,ejb30/webservice,ejb30/zombie,ejb30/misc,ejb30/sec,ejb32,el,integration,jacc,jaspic,jaxrs,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jstl,jta,rmiiiop,samples,securityapi,servlet,signaturetest/javaee,webservices13,websocket,xa

Web Profile TCK results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/7/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1299/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1299/pipeline/107

Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip

JDK Version: JDK11

Result :

Test group Failure count Issue link(s) Comments
jstl 29 https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 Changes with COMPAT are passing, further testing is in progress(https://ci.eclipse.org/jakartaee-tck/job/guru/job/jakartaee-tck-guru/job/jstl-fix/lastCompletedBuild/testReport/)
securityapi 20 https://github.com/eclipse-ee4j/glassfish/issues/23418 Fix PR has been merged (https://github.com/eclipse-ee4j/glassfish/pull/23423)
signaturetest/javaee 2
Total failure count 51

Note:

  • Below TCK's ran without any failure's : connector,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton/concurrency,ejb30/lite/singleton/dependson,ejb30/lite/singleton/lifecycle,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb32,el,jacc,jaspic,javamail,jaxrs,jdbc,jpa,jsf,jsonb,jsonp,jsp,jta,samples,servlet,websocket

Standalone TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/35/

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JDK Version: JDK11

Test group Failure count Issue link(s) Comments
authentication-tck 38 https://github.com/eclipse-ee4j/glassfish/issues/23412 With 3.0.0-b01 webservices-osgi.jar issue shouldn't be seen. more details can be found here - https://github.com/eclipse-ee4j/glassfish/issues/23412#issuecomment-801129882
restful-ws-tck 14 https://github.com/eclipse-ee4j/jakartaee-tck/issues/640
security-tck 20 https://github.com/eclipse-ee4j/glassfish/issues/23418 Fix PR has been merged
tags-tck 29 https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 Changes with COMPAT are passing, further testing is in progress(https://ci.eclipse.org/jakartaee-tck/job/guru/job/jakartaee-tck-guru/job/jstl-fix/lastCompletedBuild/testReport/)
xml-ws-tck 852 https://github.com/eclipse-ee4j/jakartaee-tck/issues/649 Fix PR has been merged (https://github.com/eclipse-ee4j/jakartaee-tck/pull/662)
Total failure count 953

Note:

  • Below TCK's ran without any failure's: annotations-tck,authorization-tck,concurrency-tck,connectors-tck,expression-language-tck,faces-tck,jsonb-tck,jsonp-tck,messaging-tck,pages-tck,persistence-tck,servlet-tck,soap-tck,transactions-tck,websocket-tck
  • There is a total of 851 errors observed for xml-ws-tck.

CDITCK-Porting run results:

CI Job: https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/120/

Profile: FULL

CI Job: https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/121/

Profile: WEB

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip

JDK Version: JDK11

Result: All Tests Pass!

Date : 2021-03-08

Full Platform TCK results with JDK11

CI Job: eftl-jakartaeetck-run-910/24 with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1275/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1275/pipeline/158

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JDK Version: JDK11

Result :

Test group Failure count Issue link(s)
appclient 12
concurrency 14
ejb 1,444
ejb30/lite/packaging 32
ejb30/lite/tx 163
ejb30/sec 87
ejb30/timer 2
ejb30/webservice 3
ejb32 8
integration 6
jacc 40
jaxrs 46
jbatch 18
jdbc_appclient 1,193
jdbc_ejb 1,193
jdbc_jsp 1,193
jdbc_servlet 1,193
jpa_appmanaged 1,715
jpa_appmanagedNoTx 1,854
jpa_pmservlet 1,863
jpa_puservlet 1,852
jpa_stateful3 1,715
jpa_stateless3 1,865
jstl 121
jta 18
samples 3
securityapi 28
servlet 9
signaturetest/javaee 4
webservices12 126
webservices13 53
xa 45
Total failure count 17,918

Note:

  • Most Full Profile Platform TCK failures are due to derby classes, more details can be found with issue here - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627
  • Below TCK's ran without any failure's : assembly,connector,ejb30/assembly,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/misc,ejb30/zombie,el,jaspic,javaee,javamail,jms,jsf,jsonb,jsonp,jsp,rmiiiop,websocket

Full Platform TCK results with JDK8

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/25/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1281/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1281/pipeline/131

Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip

JDK Version: JDK8

Result :

test group failure count issue link(s)
jaxrs 38
servlet 2
webservices12 1
Total failure count 41

Note:

  • Below TCK's ran without any failure's : assembly,appclient,concurrency,connector,ejb,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/assembly,ejb30/timer,ejb30/webservice,ejb30/zombie,ejb30/misc,ejb30/sec,ejb32,el,integration,jacc,jaspic,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jstl,jta,rmiiiop,samples,securityapi,signaturetest/javaee,webservices13,websocket,xa

Web Profile TCK results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/5/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1272/testReport/]

Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1272/pipeline/107

Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip

Result :

Test group Failure count Issue link(s)
ejb30/lite/packaging 31
ejb30/lite/tx 163
ejb32 8
jacc 24
jdbc 2,386
jpa 1,878
jstl 121
samples 1
securityapi 28
signaturetest/javaee 2
Total failure count 4,642

Note:

  • Most Web Profile Platform TCK failures are due to derby classes, more details can be found with issue here - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627
  • Below TCK's ran without any failure's : connector,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton/concurrency,ejb30/lite/singleton/dependson,ejb30/lite/singleton/lifecycle,ejb30/lite/stateful,ejb30/lite/view,ejb30/lite/xmloverride,el,jaspic,javamail,jaxrs,jsf,jsonb,jsonp,jsp,jta,servlet,websocket

Standalone TCK job build/runs results

CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/25/

CDITCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/119/

Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

Test group Failure count Issue link(s)
authentication-tck 81 https://github.com/eclipse-ee4j/glassfish/issues/23412
authorization-tck 31 https://github.com/eclipse-ee4j/jakartaee-tck/issues/642
pages-tck 2 https://github.com/eclipse-ee4j/jakartaee-tck/issues/624
restful-ws-tck 14 https://github.com/eclipse-ee4j/jakartaee-tck/issues/640
security-tck 20 https://github.com/eclipse-ee4j/glassfish/issues/23418
servlet-tck 2 https://github.com/eclipse-ee4j/jakartaee-tck/issues/625
tags-tck 29 https://github.com/eclipse-ee4j/jakartaee-tck/issues/631
xml-ws-tck 852 https://github.com/eclipse-ee4j/jakartaee-tck/issues/649
cditck-porting 7 https://github.com/eclipse-ee4j/cditck-porting/issues/25
Total failure count 1038

Note:

  • Below TCK's ran without any failure's: annotations-tck,concurrency-tck,connectors-tck,expression-language-tck,faces-tck,jsonb-tck,jsonp-tck,messaging-tck,persistence-tck,transactions-tck,websocket-tck
  • There is a total of 851 errors observed for xml-ws-tck.

JAXB, DSOL, DI, BV TCK run results:

Glassfish Bundle Used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

JAXB-TCK (CI Job): https://ci.eclipse.org/jakartaee-tck/job/jaxb-tck/job/master/82/

DSOL-TCK (CI Job): https://ci.eclipse.org/jakartaee-tck/job/debugging-support-for-other-languages-tck/job/master/258/

DITCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/ditck-porting/job/master/114/

BVTCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/bvtck-porting/job/master/108/

Result: All Tests Pass!

Glassfish Bundle/latest commits used:

commit 26bfe1ac26e7093d02e87b394e94e6ee72ed1345
Merge: f23c73484 17530e319
Author: Gaurav Gupta <[email protected]>
Date:   Sat Mar 6 21:32:32 2021 +0530

    Merge pull request #23409 from arjantijms/subjectdn
    
    Replace the denigrated getSubjectDN by getSubjectX500Principal

Result: ...

Past Results

Note that on a weekly basis, we will update this page and previous results will just appear below (with the latest results always at top).

Clone this wiki locally