Merge OpenAI Triton till Feb 1st

[whitneywhtsang]

It is essential to keep up to date with OpenAI Triton, to get the latest features, and reduce the difficulty to upstream our changes to OpenAI Triton.

From previous upstream merges:
Commits to reland:
UTs to fix: #2755, #2968, #3181

This ticket is continuation of:

• Merge OpenAI Triton till Jan 18th #3091

[whitneywhtsang]

Moved up from Jan 16 to Feb 1 Triton version from OpenAI. [#3209, #3210, #3225, #3232, #3236, #3262, #3264, #3272, #3283, #3302, #3311, #3316, #3319, #3330, #3332 ]