Jakarta EE 8 TCK for JAXR job

[m0mus]

To test Jakarta EE 8 compatibility we need to create a Jenkins job on project's Cloud Jenkins instance formally testing the API against the relevant TCK and as needed, relevant CTS subset tests.

For projects that do not already have automated testing, there is provided parameterized Jenkins job that can be invoked to perform these tests. User provides a link to an Eclipse GlassFish test build and sets the test sub-set parameters:

• For CTS -- https://ci.eclipse.org/jakartaee-tck/job/jakartaeetck-certification/
• For Stand-alone TCKs -- https://ci.eclipse.org/jakartaee-tck/job/standalonetck-certification/

Additional instructions and guidance for using and directly running TCKs is available on this wiki. Also in the jakartaee-tck project repository.

[senivam]

For JAXR-API common standalone TCK job was run (standalonetck-certification) and summary is:
results: summary.html

[jim-krueger]

Testing was performed by executing the "TCK_JAXR_GF_Integration" job (https://jenkins.eclipse.org/jakartaee-stable/job/TCK_JAXR_GF_Integration/), placing the resulting glassfish.zip file in a publicly accessible location, and then using that URL as input to run the JAXR tests via Jenkins at (https://ci.eclipse.org/jakartaee-tck/job/eftl-standalonetck-certification/).

Results from run can be seen here: https://ci.eclipse.org/jakartaee-tck/job/eftl-standalonetck-certification/33/testReport/

[kwsutter]

Just a bit more detail...

• After running the "TCK_JAXR_GF_Integration" job, the modified glassfish.zip is an artifact of that build. For example, https://jenkins.eclipse.org/jakartaee-stable/job/TCK_JAXR_PREP_(GF_Integration)/12/artifact/glassfish.zip

• Get the URL for that glassfish.zip artifact and enter that as the first parameter on the standalone certification job.

• Use the following parameters...
  STANDALONETCK_BUILD: EFTL_JAKARTAEE8_PROMOTED
  PROFILE: FULL
  JAKARTAEE_TCKS: Check this box 
  TCKS_TO_RUN: jaxr 
  JAF_TCK: Leave unchecked
  DSOL_TCK: Leave unchecked

• Start the build. This will take about 20-25 minutes. You should results for both the signature tests and the full jaxr TCK.

[jim-krueger]

Thanks for the added details. I could see the build parameters myself (no authority). I made just a couple changes. Here is what is out there now: Running the JAXR TCK requires a UDDI Registry (ex. JWSDP). The easiest way to satisfy this requirement is to do the following: 1. After running this "TCK_JAXR_PREP_(GF_Integration)" job, the modified glassfish.zip is an artifact of that build. For example, https://jenkins.eclipse.org/jakartaee-stable/job/TCK_JAXR_PREP_(GF_Integration)/12/artifact/glassfish.zip 2. Copy the URL for that glassfish.zip artifact and enter it as the first parameter on the standalone certification job. Use the following parameters... STANDALONETCK_BUILD: EFTL_JAKARTAEE8_PROMOTED PROFILE: FULL JAKARTAEE_TCKS: Check this box TCKS_TO_RUN: jaxr JAF_TCK: Leave unchecked DSOL_TCK: Leave unchecked 3. Start the build. This will take about 20-25 minutes. You should results for both the signature tests and the full jaxr TCK.

…

On Tue, Aug 20, 2019 at 6:33 PM Kevin Sutter ***@***.***> wrote: Just a bit more detail... - After running the "TCK_JAXR_GF_Integration <https://jenkins.eclipse.org/jakartaee-stable/job/TCK_JAXR_PREP_(GF_Integration)/>" job, the modified glassfish.zip is an artifact of that build. For example, https://jenkins.eclipse.org/jakartaee-stable/job/TCK_JAXR_PREP_(GF_Integration)/12/artifact/glassfish.zip - Get the URL for that glassfish.zip artifact and enter that as the first parameter on the standalone certification job <https://ci.eclipse.org/jakartaee-tck/job/eftl-standalonetck-certification/> . - Use the following parameters... STANDALONETCK_BUILD: EFTL_JAKARTAEE8_PROMOTED PROFILE: FULL JAKARTAEE_TCKS: Check this box TCKS_TO_RUN: jaxr JAF_TCK: Leave unchecked DSOL_TCK: Leave unchecked - Start the build. This will take about 20-25 minutes. You should results for both the signature tests and the full jaxr TCK. — You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <#28?email_source=notifications&email_token=AHSLZQHBYNDCOKNGE3BK6UTQFR5NHA5CNFSM4HQEM6UKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD4X66VA#issuecomment-523235156>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AHSLZQAYFR4NL4HJVVDHEHDQFR5NHANCNFSM4HQEM6UA> .