Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor of FAST resource management stage #2647

Closed
wants to merge 103 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
103 commits
Select commit Hold shift + click to select a range
1e5ec02
untested
ludoo Aug 23, 2024
a0f258d
pllan testing
ludoo Aug 23, 2024
86d0e6d
fix stage 2s
ludoo Aug 24, 2024
2ce6176
move providers to their own file
ludoo Aug 24, 2024
1e98cab
single-environment stage 3
ludoo Aug 24, 2024
b4765c7
fixes and moved blocks
ludoo Aug 24, 2024
de43350
stage3 factory
ludoo Aug 26, 2024
88c3c0c
doc
ludoo Aug 28, 2024
fac2d46
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Aug 28, 2024
ae76464
review comments
ludoo Aug 28, 2024
0f4217f
review comments
ludoo Aug 28, 2024
eb407ac
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Aug 28, 2024
8556ae1
tfdoc
ludoo Aug 28, 2024
d3bacf4
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Aug 30, 2024
e8a6ce9
fasts tage 1 tests
ludoo Aug 30, 2024
cbcce82
netsec as stage 2
ludoo Aug 31, 2024
316cc81
fix backported roles
ludoo Aug 31, 2024
03cef39
fix backported roles
ludoo Aug 31, 2024
94d4b4e
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Sep 18, 2024
017be69
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Sep 20, 2024
d53c7f2
tfdoc
ludoo Sep 20, 2024
11c33ae
Merge branch 'master' into ludo/fast-resman-auto-stages
ludoo Sep 20, 2024
91b3977
fixes
ludoo Sep 20, 2024
3b36fd7
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Sep 24, 2024
b4c85bb
fix tag value roles in stage 1
ludoo Sep 24, 2024
67a563a
remove checklist, fix stage 1 tests
ludoo Sep 24, 2024
37ac371
inventory
ludoo Sep 24, 2024
f3447f0
Merge branch 'master' into ludo/fast-resman-auto-stages
ludoo Oct 1, 2024
7353659
Small bugfix
sruffilli Oct 11, 2024
6fdf7e0
refactor context tag values
ludoo Oct 17, 2024
07e69fe
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Oct 18, 2024
091f476
fix previous merge
ludoo Oct 18, 2024
65c2618
fix previous merge
ludoo Oct 18, 2024
1048b2b
fix previous merge
ludoo Oct 18, 2024
6d5888f
support short names for top level automation resources, change top le…
ludoo Oct 18, 2024
5bd2b05
fix new top level context
ludoo Oct 18, 2024
e29695d
roll back merge changes to stage 0 outputs
ludoo Oct 18, 2024
6f29c7e
roll back more merge changes
ludoo Oct 18, 2024
b1c9f7e
linting errors
ludoo Oct 18, 2024
7412fb7
tfdoc
ludoo Oct 18, 2024
4162668
fix tests, roll back merge in tenants stage
ludoo Oct 18, 2024
4a4ba7e
tfdoc
ludoo Oct 18, 2024
5254515
fix inventory
ludoo Oct 18, 2024
ec91824
optional stage 2 env folders and tag bindings
ludoo Oct 18, 2024
6013404
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Oct 18, 2024
f3afc27
tflint
ludoo Oct 18, 2024
d32985c
damn tflint
ludoo Oct 18, 2024
8ca28d2
damn tflint
ludoo Oct 18, 2024
adccd70
tfdoc
ludoo Oct 18, 2024
1fdb13b
fix networking tests
ludoo Oct 18, 2024
fbade44
tflint
ludoo Oct 18, 2024
01949cb
fix test inventories
ludoo Oct 18, 2024
d4f5e00
tfdoc
ludoo Oct 18, 2024
cc92346
use coalesce for project parents
ludoo Oct 18, 2024
b472007
fix billing role conditions
ludoo Oct 19, 2024
5429987
fix billing role conditions
ludoo Oct 19, 2024
10de93f
security stage tested (ngw resources need fixing/porting)
ludoo Oct 19, 2024
3595737
boilerplate
ludoo Oct 19, 2024
afc000a
fix inventory
ludoo Oct 19, 2024
9b0db0c
stage envs and stage linking script
ludoo Oct 19, 2024
0a315a4
initial work on resman docs, update diagram, improve teams folder
ludoo Oct 21, 2024
879349e
resman README
ludoo Oct 21, 2024
93ff64e
fix stage 2 IAM delegation
ludoo Oct 23, 2024
e279aaa
remove checklist from bootstrap
ludoo Oct 23, 2024
f32b22b
stage 1 tests
ludoo Oct 23, 2024
4b149e3
stage 0 1 and 2 tests
ludoo Oct 23, 2024
9b51a12
tflint
ludoo Oct 23, 2024
b6f8f26
tflint
ludoo Oct 23, 2024
726e7cd
tfdoc
ludoo Oct 23, 2024
fdb7d84
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Oct 24, 2024
6f7657a
GCVE stage refactor (untested)
ludoo Oct 26, 2024
e5df260
GCVE stage refactor (untested)
ludoo Oct 26, 2024
35441cf
GCVE stage 3
ludoo Oct 27, 2024
9140136
gcve tests
ludoo Oct 27, 2024
658cc1f
tflint
ludoo Oct 27, 2024
27224dd
tfdoc
ludoo Oct 27, 2024
43ea755
fix links
ludoo Oct 27, 2024
934d3bd
module tests
ludoo Oct 27, 2024
a5b382b
stages README
ludoo Oct 27, 2024
7b67ecd
move network security to stage 2
ludoo Oct 27, 2024
2debdad
network security tests
ludoo Oct 27, 2024
a3d4765
replace stage links in README files
ludoo Oct 27, 2024
ff7cb9d
minimal netsec stage refactor
ludoo Oct 28, 2024
d67b242
use factory for iac org policies, add configurable drs org policy for…
ludoo Oct 28, 2024
75f789d
test mt stage
ludoo Oct 28, 2024
e1cdc02
tfdoc
ludoo Oct 28, 2024
24ab698
fix cicd workflows
ludoo Oct 28, 2024
aa504c8
fix cicd workflows
ludoo Oct 28, 2024
41e7eab
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Oct 29, 2024
06b852d
gke-dev stage
ludoo Oct 29, 2024
0f11147
tflint
ludoo Oct 29, 2024
363b218
remove data platform stage
ludoo Oct 29, 2024
339a864
exclude provider files via tfdoc opts
ludoo Oct 29, 2024
8a5f3de
remove data platform tests and links
ludoo Oct 29, 2024
f041f39
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Oct 29, 2024
6edbbf6
fix merge
ludoo Oct 29, 2024
7fdc4c3
fix resman inventory
ludoo Oct 29, 2024
1031f50
boilerplate
ludoo Oct 29, 2024
c9b8b2c
inventory
ludoo Oct 29, 2024
cfbbf70
Merge branch 'master' into ludo/fast-resman-auto-stages
ludoo Oct 30, 2024
c6e750e
Merge remote-tracking branch 'origin/master' into ludo/fast-resman-au…
ludoo Oct 30, 2024
abde265
extend tests to fast-dev (#2646)
ludoo Oct 30, 2024
0960ea2
Merge remote-tracking branch 'origin/fast-dev' into ludo/fast-resman-…
ludoo Oct 30, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/linting.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,7 @@ on:
pull_request:
branches:
- master
- fast-dev

jobs:
linting:
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ on:
pull_request:
branches:
- master
- fast-dev
workflow_dispatch:
inputs:
terraform_version:
Expand Down
2 changes: 1 addition & 1 deletion blueprints/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ Currently available blueprints:
- **cloud operations** - [Active Directory Federation Services](./cloud-operations/adfs), [Cloud Asset Inventory feeds for resource change tracking and remediation](./cloud-operations/asset-inventory-feed-remediation), [Fine-grained Cloud DNS IAM via Service Directory](./cloud-operations/dns-fine-grained-iam), [Cloud DNS & Shared VPC design](./cloud-operations/dns-shared-vpc), [Delegated Role Grants](./cloud-operations/iam-delegated-role-grants), [Network Quota Monitoring](./cloud-operations/network-quota-monitoring), [Managing on-prem service account keys by uploading public keys](./cloud-operations/onprem-sa-key-management), [Compute Image builder with Hashicorp Packer](./cloud-operations/packer-image-builder), [Packer example](./cloud-operations/packer-image-builder/packer), [Compute Engine quota monitoring](./cloud-operations/compute-quota-monitoring), [Scheduled Cloud Asset Inventory Export to Bigquery](./cloud-operations/scheduled-asset-inventory-export-bq), [Configuring workload identity federation with Terraform Cloud/Enterprise workflows](./cloud-operations/terraform-cloud-dynamic-credentials), [TCP healthcheck and restart for unmanaged GCE instances](./cloud-operations/unmanaged-instances-healthcheck), [Migrate for Compute Engine (v5) blueprints](./cloud-operations/vm-migration), [Configuring workload identity federation to access Google Cloud resources from apps running on Azure](./cloud-operations/workload-identity-federation)
- **data solutions** - [GCE and GCS CMEK via centralized Cloud KMS](./data-solutions/cmek-via-centralized-kms), [Cloud Composer version 2 private instance, supporting Shared VPC and external CMEK key](./data-solutions/composer-2), [Cloud SQL instance with multi-region read replicas](./data-solutions/cloudsql-multiregion), [Data Platform](./data-solutions/data-platform-foundations), [Minimal Data Platform](./data-solutions/data-platform-minimal), [Spinning up a foundation data pipeline on Google Cloud using Cloud Storage, Dataflow and BigQuery](./data-solutions/gcs-to-bq-with-least-privileges), [#SQL Server Always On Groups blueprint](./data-solutions/sqlserver-alwayson), [Data Playground](./data-solutions/data-playground), [MLOps with Vertex AI](./data-solutions/vertex-mlops), [Shielded Folder](./data-solutions/shielded-folder), [BigQuery ML and Vertex AI Pipeline](./data-solutions/bq-ml)
- **factories** - [Fabric resource factories](./factories)
- **GKE** - [Binary Authorization Pipeline Blueprint](./gke/binauthz), [Storage API](./gke/binauthz/image), [Multi-cluster mesh on GKE (fleet API)](./gke/multi-cluster-mesh-gke-fleet-api), [GKE Multitenant Blueprint](./gke/multitenant-fleet), [Shared VPC with GKE support](./networking/shared-vpc-gke/), [GKE Autopilot](./gke/autopilot)
- **GKE** - [Binary Authorization Pipeline Blueprint](./gke/binauthz), [Storage API](./gke/binauthz/image), [Multi-cluster mesh on GKE (fleet API)](./gke/multi-cluster-mesh-gke-fleet-api), [GKE Multitenant](../fast/stages/3-gke-dev), [Shared VPC with GKE support](./networking/shared-vpc-gke/), [GKE Autopilot](./gke/autopilot)
- **networking** - [Calling a private Cloud Function from On-premises](./networking/private-cloud-function-from-onprem), [HA VPN over Interconnect](./networking/ha-vpn-over-interconnect/), [GLB and multi-regional daisy-chaining through hybrid NEGs](./networking/glb-hybrid-neg-internal), [Hybrid connectivity to on-premise services through PSC](./networking/psc-hybrid), [HTTP Load Balancer with Cloud Armor](./networking/glb-and-armor), [Internal Load Balancer as Next Hop](./networking/ilb-next-hop), On-prem DNS and Google Private Access, [PSC Producer](./networking/psc-hybrid/psc-producer), [PSC Consumer](./networking/psc-hybrid/psc-consumer), [Shared VPC with optional GKE cluster](./networking/shared-vpc-gke), [VPC Connectivity Lab](./networking/vpc-connectivity-lab/)
- **serverless** - [Cloud Run series](./serverless/cloud-run-explore)
- **third party solutions** - [OpenShift on GCP user-provisioned infrastructure](./third-party-solutions/openshift), [Wordpress deployment on Cloud Run](./third-party-solutions/wordpress/cloudrun)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ The approach adapts to different high-level requirements:
- least privilege principle
- rely on service account impersonation

The code in this blueprint doesn't address Organization-level configurations (Organization policy, VPC-SC, centralized logs). We expect those elements to be managed by automation stages external to this script like those in [FAST](../../../fast) and this blueprint deployed on top of them as one of the [stages](../../../fast/stages/3-data-platform/dev/README.md).
The code in this blueprint doesn't address Organization-level configurations (Organization policy, VPC-SC, centralized logs). We expect those elements to be managed by automation stages external to this script like those in [FAST](../../../fast).

### Project structure

Expand Down
2 changes: 1 addition & 1 deletion blueprints/data-solutions/data-platform-minimal/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ The approach adapts to different high-level requirements:
- least privilege principle
- rely on service account impersonation

The code in this blueprint doesn't address Organization-level configurations (Organization policy, VPC-SC, centralized logs). We expect those elements to be managed by automation stages external to this script like those in [FAST](../../../fast) and this blueprint deployed on top of them as one of the [stages](../../../fast/stages/3-data-platform/dev/README.md).
The code in this blueprint doesn't address Organization-level configurations (Organization policy, VPC-SC, centralized logs). We expect those elements to be managed by automation stages external to this script like those in [FAST](../../../fast).

## Project structure

Expand Down
106 changes: 0 additions & 106 deletions blueprints/gcve/pc-minimal/README.md

This file was deleted.

58 changes: 0 additions & 58 deletions blueprints/gcve/pc-minimal/gcve-pc.tf

This file was deleted.

39 changes: 0 additions & 39 deletions blueprints/gcve/pc-minimal/main.tf

This file was deleted.

2 changes: 1 addition & 1 deletion blueprints/gke/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ They are meant to be used as minimal but complete starting points to create actu

### Multitenant GKE fleet

<a href="./multitenant-fleet/" title="GKE multitenant fleet"><img src="./multitenant-fleet/diagram.png" align="left" width="280px"></a> This [blueprint](./multitenant-fleet/) allows simple centralized management of similar sets of GKE clusters and their nodepools in a single project, and optional fleet management via GKE Hub templated configurations.
<a href="../../fast/stages/3-gke-dev/" title="GKE multitenant fleet"><img src="../../fast/stages/3-gke-dev/diagram.png" align="left" width="280px"></a> This [blueprint](../../fast/stages/3-gke-dev/) allows simple centralized management of similar sets of GKE clusters and their nodepools in a single project, and optional fleet management via GKE Hub templated configurations.

<br clear="left">

Expand Down
1 change: 0 additions & 1 deletion blueprints/gke/multitenant-fleet/OWNERS

This file was deleted.

Loading
Loading