Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add three missing llvm-spirv commits from Khronos #8306

Closed
wants to merge 3 commits into from

Conversation

sarnex
Copy link
Contributor

@sarnex sarnex commented Feb 10, 2023

The below three commits are missing from intel/llvm llvm-spirv and it's causing differences in internal testing:
KhronosGroup/SPIRV-LLVM-Translator@352ea14
KhronosGroup/SPIRV-LLVM-Translator@85815e7
KhronosGroup/SPIRV-LLVM-Translator@aded5af

I also had to add a customization to skip interface global variables.

Signed-off-by: Sarnie, Nick [email protected]

@sarnex sarnex changed the title Add two missing comments from upstream to llvm-spirv Add two missing commits from upstream to llvm-spirv Feb 10, 2023
@sarnex sarnex force-pushed the revert branch 2 times, most recently from 23b60eb to b968e93 Compare February 10, 2023 19:28
@sarnex sarnex changed the title Add two missing commits from upstream to llvm-spirv Add three missing llvm-spirv commits from Khronos Feb 10, 2023
@sarnex sarnex temporarily deployed to aws February 11, 2023 07:46 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws February 11, 2023 09:22 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws February 13, 2023 16:54 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws February 13, 2023 18:41 — with GitHub Actions Inactive
@MrSidims
Copy link
Contributor

MrSidims commented Feb 14, 2023

Thanks for doing this!
Unfortunately I don't think we ready for them. Here are the reasons:
KhronosGroup/SPIRV-LLVM-Translator@352ea14 this patch lists GVs in the Interfaces of EntryPoint. Unfortunately there was a bug in IGC, which doesn't handle Interfaces at all. AFAIK the bug is now fixed, but these drivers are not yet in CI.

UPD: ah, missed this from the description: I also had to add a customization to skip interface global variables.

KhronosGroup/SPIRV-LLVM-Translator@85815e7 this patch is addressing SPIR-V 1.4 requirement and we haven't yet switched to it in this repo. There is PR for that #7493 but fresh-new pre-commit runs are showing some tests with very fishy error message failing. I haven't yet investigated them, but it's on my list. Though, probably we still can merge this patch.

There are actually more 'customizations' in intel/llvm, they are being tracked here: #7592 feel free to update the list if you something that was not mentioned.

@sarnex
Copy link
Contributor Author

sarnex commented Feb 14, 2023

@MrSidims You are realy good at sniping my draft PRs

Yeah after looking at these CI failures I came to the same conclusion, I'll close this for now

@sarnex sarnex closed this Feb 14, 2023
@MrSidims
Copy link
Contributor

If you don't mind, I'd re-open it :)

The CI failures I see are not related to GPU driver lacking SPIR-V 1.4 support. Not sure about this very PR though. So it's worth a stand-alone investigation

@MrSidims MrSidims reopened this Feb 15, 2023
@sarnex
Copy link
Contributor Author

sarnex commented Feb 15, 2023

@MrSidims Sure, I still need to investigate the remaining CI issues, I think there were only ~5 test failures

@MrSidims MrSidims temporarily deployed to aws February 15, 2023 19:14 — with GitHub Actions Inactive
@MrSidims MrSidims temporarily deployed to aws February 16, 2023 00:39 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws February 17, 2023 16:21 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws February 17, 2023 16:53 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws February 17, 2023 18:35 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws February 17, 2023 18:39 — with GitHub Actions Inactive
@sarnex
Copy link
Contributor Author

sarnex commented Feb 17, 2023

@bader Any idea what's going on with the OCL x64 failure? I merged sycl HEAD into my branch before running CI.

Starting download for sycl_linux_default
Error: Unable to find an artifact with the name: sycl_linux_default
Run actions/upload-artifact@v1
Error: Path does not exist /localdisk2/github/_work/llvm/llvm/build/results_ocl_x64_default.json
Error: Exit code 1 returned from process: file name '/localdisk2/github/bin.2.301.1/Runner.PluginHost', arguments 'action "GitHub.Runner.Plugins.Artifact.PublishArtifact, Runner.Plugins"'.

@bader
Copy link
Contributor

bader commented Feb 17, 2023

@bader Any idea what's going on with the OCL x64 failure?

No.

I merged sycl HEAD into my branch before running CI.

Please, try it again.

@sarnex sarnex temporarily deployed to aws February 17, 2023 19:55 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws February 17, 2023 20:49 — with GitHub Actions Inactive
@sarnex
Copy link
Contributor Author

sarnex commented Feb 17, 2023

@MrSidims Okay it seems like the 5 failures on OCL CPU are all caused by an old driver. If I use a newer driver locally it works fine.

I have three options here:

  1. Disable these 5 tests on OCL CPU until new driver
  2. Try to upgrade the driver in CI here.
  3. Hold off on this change until new driver

What do you recommend? 2) could turn into a nightmare :)

@MrSidims
Copy link
Contributor

@cdai2 hi, since CPU runtime is now public, may I ask you whether we expect to have it used in intel/llvm for testing?

@sarnex
Copy link
Contributor Author

sarnex commented Feb 21, 2023

Note I didn't test if the open source version works, I only tested an internal version.

@MrSidims
Copy link
Contributor

@sarnex

Disable these 5 tests on OCL CPU until new driver

I see
llvm-foreach: Segmentation fault (core dumped)
so I would vote for 'no'. Do you know, what exactly is missing in the currently used CPU driver?

@sarnex
Copy link
Contributor Author

sarnex commented Feb 21, 2023

@MrSidims

Do you know, what exactly is missing in the currently used CPU driver?

No idea, but I can investigate. Sorry what do you mean by 'vote for no'? Do you support one of the 1-3 options?

@MrSidims
Copy link
Contributor

@MrSidims

Do you know, what exactly is missing in the currently used CPU driver?

No idea, but I can investigate. Sorry what do you mean by 'vote for no'? Do you support one of the 1-3 options?

Sorry :) I would vote for not disabling the tests, until we know, what causes segfault.

@sarnex sarnex temporarily deployed to aws March 10, 2023 17:31 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws March 10, 2023 18:04 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws March 10, 2023 18:46 — with GitHub Actions Inactive
@asudarsa
Copy link
Contributor

Hi @sarnex

Thanks for looking at this. Just a quick comment. Will it make it easier to test/debug if we submit the three PRs separately?

@sarnex
Copy link
Contributor Author

sarnex commented Mar 16, 2023

@asudarsa Unfortunately we can't, they are interdependent. We can't merge this anyway because of the OCL CPU issue.

@sarnex sarnex temporarily deployed to aws March 27, 2023 15:00 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws March 27, 2023 15:37 — with GitHub Actions Inactive
@MrSidims MrSidims marked this pull request as ready for review April 2, 2023 15:08
@MrSidims MrSidims requested a review from a team as a code owner April 2, 2023 15:08
@MrSidims MrSidims marked this pull request as draft April 2, 2023 15:08
@sarnex
Copy link
Contributor Author

sarnex commented Apr 4, 2023

finally new ocl cpu driver, is there hope? let's find out on tonight's episode of i doubt it

@sarnex sarnex temporarily deployed to aws April 4, 2023 20:49 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws April 4, 2023 21:21 — with GitHub Actions Inactive
sarnex added 3 commits April 25, 2023 13:41
The below three commits are missing from intel/llvm llvm-spirv and it's causing differences in internal testing:
KhronosGroup/SPIRV-LLVM-Translator@352ea14
KhronosGroup/SPIRV-LLVM-Translator@85815e7
KhronosGroup/SPIRV-LLVM-Translator@aded5af

Signed-off-by: Sarnie, Nick <[email protected]>
Signed-off-by: Nick Sarnie <[email protected]>
Signed-off-by: Sarnie, Nick <[email protected]>
@sarnex sarnex temporarily deployed to aws April 26, 2023 00:19 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws April 26, 2023 04:43 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws April 26, 2023 13:32 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws April 26, 2023 13:33 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws April 26, 2023 19:08 — with GitHub Actions Inactive
@sarnex sarnex temporarily deployed to aws April 26, 2023 23:08 — with GitHub Actions Inactive
Copy link
Contributor

This pull request is stale because it has been open 180 days with no activity. Remove stale label or comment or this will be automatically closed in 30 days.

@github-actions github-actions bot added the Stale label Sep 15, 2024
Copy link
Contributor

This pull request was closed because it has been stalled for 30 days with no activity.

@github-actions github-actions bot closed this Oct 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants