-
Notifications
You must be signed in to change notification settings - Fork 28.5k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
… Adds a new job in GitHub Actions to check the output of TPC-DS queries ### What changes were proposed in this pull request? This PR proposes to add a new job in GitHub Actions to check the output of TPC-DS queries. NOTE: To generate TPC-DS table data in GA jobs, this PR includes generator code implemented in #32243 and #32460. This is the backport PR of #31886. ### Why are the changes needed? There are some cases where we noticed runtime-realted bugs after merging commits (e.g. .SPARK-33822). Therefore, I think it is worth adding a new job in GitHub Actions to check query output of TPC-DS (sf=1). ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? The new test added. Closes #32462 from maropu/TPCDSQUeryTestSuite-Branch3.1. Authored-by: Takeshi Yamamuro <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
- Loading branch information
1 parent
53a93fc
commit 4136023
Showing
140 changed files
with
18,614 additions
and
579 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
105 changes: 105 additions & 0 deletions
105
sql/core/src/test/resources/tpcds-query-results/v1_4/q1.sql.out
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,105 @@ | ||
| -- Automatically generated by TPCDSQueryTestSuite | ||
|
|
||
| -- !query schema | ||
| struct<c_customer_id:string> | ||
| -- !query output | ||
| AAAAAAAAAAABAAAA | ||
| AAAAAAAAAAAHBAAA | ||
| AAAAAAAAAAAMAAAA | ||
| AAAAAAAAAAAOAAAA | ||
| AAAAAAAAAABCBAAA | ||
| AAAAAAAAAABEAAAA | ||
| AAAAAAAAAABFAAAA | ||
| AAAAAAAAAACFBAAA | ||
| AAAAAAAAAACFBAAA | ||
| AAAAAAAAAADBBAAA | ||
| AAAAAAAAAADOAAAA | ||
| AAAAAAAAAADPAAAA | ||
| AAAAAAAAAAEABAAA | ||
| AAAAAAAAAAEEAAAA | ||
| AAAAAAAAAAEGBAAA | ||
| AAAAAAAAAAENAAAA | ||
| AAAAAAAAAAFCBAAA | ||
| AAAAAAAAAAFEBAAA | ||
| AAAAAAAAAAFGAAAA | ||
| AAAAAAAAAAFLAAAA | ||
| AAAAAAAAAAFPAAAA | ||
| AAAAAAAAAAGCAAAA | ||
| AAAAAAAAAAGEAAAA | ||
| AAAAAAAAAAGIBAAA | ||
| AAAAAAAAAAGOAAAA | ||
| AAAAAAAAAAHABAAA | ||
| AAAAAAAAAAHGBAAA | ||
| AAAAAAAAAAHHAAAA | ||
| AAAAAAAAAAHMAAAA | ||
| AAAAAAAAAAHPAAAA | ||
| AAAAAAAAAAHPAAAA | ||
| AAAAAAAAAAHPAAAA | ||
| AAAAAAAAAAJAAAAA | ||
| AAAAAAAAAAJEBAAA | ||
| AAAAAAAAAAJMAAAA | ||
| AAAAAAAAAAJPAAAA | ||
| AAAAAAAAAAKBBAAA | ||
| AAAAAAAAAAKGBAAA | ||
| AAAAAAAAAAKHBAAA | ||
| AAAAAAAAAAKLAAAA | ||
| AAAAAAAAAALCAAAA | ||
| AAAAAAAAAALJAAAA | ||
| AAAAAAAAAALJAAAA | ||
| AAAAAAAAAAMABAAA | ||
| AAAAAAAAAAMGAAAA | ||
| AAAAAAAAAAMLAAAA | ||
| AAAAAAAAAAMMAAAA | ||
| AAAAAAAAAANHBAAA | ||
| AAAAAAAAAANMAAAA | ||
| AAAAAAAAAAOBBAAA | ||
| AAAAAAAAAAPDAAAA | ||
| AAAAAAAAAAPKAAAA | ||
| AAAAAAAAAAPLAAAA | ||
| AAAAAAAAABANAAAA | ||
| AAAAAAAAABCCBAAA | ||
| AAAAAAAAABCGAAAA | ||
| AAAAAAAAABDABAAA | ||
| AAAAAAAAABDBAAAA | ||
| AAAAAAAAABDEAAAA | ||
| AAAAAAAAABDEBAAA | ||
| AAAAAAAAABDEBAAA | ||
| AAAAAAAAABDFBAAA | ||
| AAAAAAAAABDOAAAA | ||
| AAAAAAAAABDOAAAA | ||
| AAAAAAAAABEBBAAA | ||
| AAAAAAAAABEDAAAA | ||
| AAAAAAAAABEEAAAA | ||
| AAAAAAAAABEEBAAA | ||
| AAAAAAAAABEIBAAA | ||
| AAAAAAAAABEOAAAA | ||
| AAAAAAAAABFFBAAA | ||
| AAAAAAAAABFHAAAA | ||
| AAAAAAAAABFNAAAA | ||
| AAAAAAAAABFOAAAA | ||
| AAAAAAAAABGAAAAA | ||
| AAAAAAAAABHDBAAA | ||
| AAAAAAAAABHGAAAA | ||
| AAAAAAAAABHGBAAA | ||
| AAAAAAAAABHLAAAA | ||
| AAAAAAAAABIAAAAA | ||
| AAAAAAAAABIBAAAA | ||
| AAAAAAAAABIDBAAA | ||
| AAAAAAAAABIEBAAA | ||
| AAAAAAAAABKLAAAA | ||
| AAAAAAAAABKNAAAA | ||
| AAAAAAAAABKNAAAA | ||
| AAAAAAAAABLJAAAA | ||
| AAAAAAAAABLNAAAA | ||
| AAAAAAAAABMAAAAA | ||
| AAAAAAAAABMEBAAA | ||
| AAAAAAAAABMPAAAA | ||
| AAAAAAAAABNABAAA | ||
| AAAAAAAAABNBAAAA | ||
| AAAAAAAAABNEAAAA | ||
| AAAAAAAAABNEAAAA | ||
| AAAAAAAAABNGAAAA | ||
| AAAAAAAAABNNAAAA | ||
| AAAAAAAAABOEAAAA | ||
| AAAAAAAAABOGBAAA | ||
| AAAAAAAAABPABAAA |
11 changes: 11 additions & 0 deletions
11
sql/core/src/test/resources/tpcds-query-results/v1_4/q10.sql.out
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,11 @@ | ||
| -- Automatically generated by TPCDSQueryTestSuite | ||
|
|
||
| -- !query schema | ||
| struct<cd_gender:string,cd_marital_status:string,cd_education_status:string,cnt1:bigint,cd_purchase_estimate:int,cnt2:bigint,cd_credit_rating:string,cnt3:bigint,cd_dep_count:int,cnt4:bigint,cd_dep_employed_count:int,cnt5:bigint,cd_dep_college_count:int,cnt6:bigint> | ||
| -- !query output | ||
| F W 4 yr Degree 1 4000 1 Low Risk 1 4 1 6 1 4 1 | ||
| M D 4 yr Degree 1 1500 1 Low Risk 1 3 1 4 1 2 1 | ||
| M S College 1 4500 1 High Risk 1 3 1 4 1 3 1 | ||
| M S Primary 1 9500 1 Low Risk 1 3 1 0 1 6 1 | ||
| M S Secondary 1 3000 1 High Risk 1 1 1 1 1 4 1 | ||
| M U 4 yr Degree 1 2000 1 Low Risk 1 3 1 1 1 3 1 |
99 changes: 99 additions & 0 deletions
99
sql/core/src/test/resources/tpcds-query-results/v1_4/q11.sql.out
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,99 @@ | ||
| -- Automatically generated by TPCDSQueryTestSuite | ||
|
|
||
| -- !query schema | ||
| struct<customer_preferred_cust_flag:string> | ||
| -- !query output | ||
| NULL | ||
| NULL | ||
| NULL | ||
| NULL | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| N | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y | ||
| Y |
Oops, something went wrong.