Skip to main content

Understanding the GCP Resource Hierarchy

Learn how Organizations, Folders, Projects, and Resources fit together, and why the Project ID decision cannot be undone later.

38 Terms

Overview and What You Will Learn

In this lab, you will create a Project with a deliberately chosen Project ID, understand exactly what that ID controls, and see how permissions applied at a Folder level automatically flow down to every Project inside it.

Why This Matters in Production

A team creates a project named test-proj-1 intending to rename it once it moves to production, only to discover the Project ID itself can never be changed - the display name can be updated, but the ID that appears in every resource URL, every billing export, and every API call stays fixed forever. Six months later, production infrastructure is still running under a Project ID that clearly signals "temporary test project" to anyone who looks.

Core Principles

GCP organizes every resource inside a strict four-level hierarchy, and policies set at a higher level automatically apply to everything beneath it.

◈ DIAGRAM
+------------------------------------------+
| Organization (tied to a Workspace or |
| Cloud Identity domain) |
+------------------------------------------+
|
v
+------------------------------------------+
| Folders (optional - group by team, |
| department, or environment) |
+------------------------------------------+
|
v
+------------------------------------------+
| Projects (billing + IAM scoping boundary) |
+------------------------------------------+
|
v
+------------------------------------------+
| Resources (VMs, buckets, databases, etc.) |
+------------------------------------------+

A Project ID is globally unique across all of Google Cloud, chosen once at creation, and never changeable - unlike the Project's display name, which can be updated freely at any time.

Detailed Step-by-Step Practical Lab

  1. Create a Folder to represent a specific environment or team:
Bash
gcloud resource-manager folders create \
--display-name="Engineering Team" \
--organization=YOUR_ORG_ID
  1. Create a Project inside that Folder, with a deliberate, production-appropriate Project ID:
Bash
gcloud projects create checkout-service-prod-2026 \
--name="Checkout Service Production" \
--folder=YOUR_FOLDER_ID
  1. Confirm the Project was created and check both its ID and display name:
Bash
gcloud projects describe checkout-service-prod-2026 \
--format="value(projectId,name)"
  1. Grant a role at the Folder level, so it automatically applies to every current and future Project inside that Folder:
Bash
gcloud resource-manager folders add-iam-policy-binding YOUR_FOLDER_ID \
--member="user:priya.sharma@example.com" \
--role="roles/viewer"
  1. Confirm the inherited permission actually applies at the Project level, even though it was never granted directly there:
Bash
gcloud projects get-iam-policy checkout-service-prod-2026
Note

The output here will show the Viewer role inherited from the Folder, not directly listed as a Project-level binding - this is exactly how policy inheritance works, and it's a common point of confusion when auditing "who has access to this project" without checking the Folder and Organization levels above it too.

  1. List every Project inside the Folder to confirm the hierarchy is organizing things as expected:
Bash
gcloud projects list --filter="parent.id=YOUR_FOLDER_ID"
  1. Clean up:
Bash
gcloud projects delete checkout-service-prod-2026 --quiet
gcloud resource-manager folders delete YOUR_FOLDER_ID

Production Best Practices & Common Pitfalls

Common Mistake

Choosing a casual or placeholder Project ID like test-123 intending to rename it later. The Project ID is permanent - if a project ends up being promoted to production, the only way to get a proper ID is creating an entirely new project and migrating every resource into it.

Tip

Use Folders to mirror your organization's actual structure - by team, by environment, or both - so IAM permissions and Organization Policies can be applied once at the right level rather than repeated individually across dozens of projects.

  • A Project belongs to exactly one Folder (or directly to the Organization), never multiple. If a project's IAM needs differ meaningfully from its current Folder's inherited policies, that's often a signal it belongs in a different Folder, not that it needs individual overrides layered on top.
  • Auditing "who has access" requires checking every level of the hierarchy, not just the Project itself - a permission granted at the Organization or Folder level is invisible if you only look at the Project's own IAM policy.

Quick Reference & Troubleshooting Commands

Command Description
gcloud projects create Create a new Project with a permanent Project ID
gcloud resource-manager folders create Create a new Folder
gcloud projects get-iam-policy View a Project's IAM policy, including inherited bindings
gcloud projects list --filter="parent.id=..." List Projects within a specific Folder

Resources

Artifact Registry

Google Cloud's current, unified package and container image storage service, the successor to the older Container Registry. It supports container images alongside language packages like npm, Maven, and Python packages in one service, and supports cleanup policies to automatically remove old, untagged image versions.

BigQuery

Google Cloud's serverless data warehouse for analytics, priced based on the volume of data a query actually scans rather than pre-provisioned compute capacity. Selecting only needed columns and querying a properly partitioned table's relevant date range are the two highest-impact levers for controlling BigQuery cost.

Bigtable (GCP)

A wide-column NoSQL database built for very high throughput at extremely low latency, suited to time-series data, IoT telemetry, and analytics workloads with massive write volume. It is a specialized tool distinct from Firestore's document model or Cloud SQL's relational model.

Billing Account (GCP)

A separate object from a Project that holds the actual payment method for Google Cloud usage. One Billing Account can be linked to many Projects, all of whose usage is billed to that same account, letting a company centralize payment while individual Projects retain their own separate IAM control over resources.

Cloud Armor

A security policy service attached to a Global External HTTP(S) Load Balancer, filtering malicious requests before they reach the backend. It supports rate-based rules blocking a single source IP exceeding a request threshold, and preconfigured WAF rules blocking common attack patterns like SQL injection, Google's equivalent of AWS WAF or Azure WAF.

Cloud Functions (GCP)

Google Cloud's event-driven, single-purpose compute service, the most granular and shortest-lived compute unit in GCP's compute spectrum. It fits a narrow niche compared to Cloud Run - a specific triggered action like resizing an uploaded image, rather than a full application with multiple routes and business logic.

Cloud Load Balancing

Google Cloud's family of load balancing products, spanning Global External HTTP(S) Load Balancers (public, distributed globally via a single IP), Regional External Load Balancers, and Internal Load Balancers reachable only from within the VPC. The right type depends on traffic type and whether the backend should ever be reachable from the public internet.

Cloud Logging

Google Cloud's service for collecting, storing, and querying log data from every GCP service and custom applications. Its query filter syntax lets logs be narrowed by resource, severity, and specific field values, and Log Sinks can route matching logs to BigQuery, Cloud Storage, or Pub/Sub for long-term retention beyond the default window.

Cloud Monitoring

Google Cloud's metrics, dashboards, and alerting service. An alert policy requires a Notification Channel explicitly attached to actually notify someone when it fires - without one, the policy still evaluates and logs its own firing history, but nobody is ever told, a common and easy-to-miss misconfiguration.

Cloud NAT

A service providing outbound-only internet connectivity for resources with no external IP address, GCP's equivalent of an AWS or Azure NAT Gateway. Cloud NAT requires a Cloud Router in the same region and provides zero inbound connectivity capability - a resource behind it remains completely unreachable from the internet.

Cloud Run

A fully managed, serverless platform for running containerized applications, scaling automatically to zero when idle and billing only for actual invocations. It combines the flexibility of running any container with zero OS management overhead, making it the right default for a standard stateless containerized web service.

Cloud SQL

Google Cloud's managed relational database service, supporting MySQL, PostgreSQL, and SQL Server. It is the right default for a traditional relational workload with moderate scale needs, handling patching, backups, and replication automatically without requiring OS-level access to the underlying database server.

Cloud Spanner

A globally distributed, strongly consistent relational database offering both SQL semantics and horizontal scalability beyond what a single Cloud SQL instance can provide. It is the right choice specifically when a workload needs both relational query capability and massive scale simultaneously, not simply because a workload feels large or important.

Cloud Storage Bucket

The top-level container for objects in Google Cloud Storage, GCP's object storage service equivalent to AWS S3 or Azure Blob Storage. Every object uploaded to Cloud Storage must belong to exactly one bucket, and bucket-level settings control default storage class, location, and access permissions for everything inside it.

Cloud VPN (GCP)

A service connecting an on-premises network to a GCP VPC over an encrypted tunnel, similar to VPN Gateway in Azure or a Site-to-Site VPN in AWS. It requires a Cloud Router as its foundation and is distinct from VPC Network Peering, which connects two GCP VPCs directly rather than an external network.

Compute Engine

Google Cloud's Infrastructure-as-a-Service offering, providing full virtual machines with complete OS-level control. It is the right choice specifically when a workload needs custom software, specific OS configurations, or hardware-level access that GKE and Cloud Run don't expose.

Error Reporting (GCP)

A Google Cloud operations service that automatically aggregates and groups application errors from logs and instrumented code, surfacing recurring error patterns and their frequency without requiring manual log searching for each individual occurrence.

Firestore

A serverless NoSQL document database built for mobile and web application data, flexible schemas, and real-time client synchronization. It is not a strong fit for workloads needing complex relational joins or multi-row transactions across unrelated entities, which point instead to Cloud SQL or Spanner.

GCP Audit Log

A specific category of Cloud Logging entry recording administrative actions and data access. Admin Activity logs (configuration changes) are always enabled and cannot be disabled; Data Access logs (who read or wrote actual data) are disabled by default for most services and must be explicitly enabled before that history exists.

GCP Firewall Rule

A rule defined at the VPC level controlling inbound or outbound traffic, applied using network tags or Service Accounts on instances rather than being tied to a specific subnet boundary. A firewall rule only affects VMs carrying the exact matching tag or identity - a VM without it is entirely unaffected, silently, with no error to flag the mismatch.

GCP Folder

An optional grouping node in the GCP resource hierarchy, sitting between the Organization and individual Projects. Folders are commonly used to group Projects by team, department, or environment, letting IAM permissions and Organization Policies be applied once at the Folder level rather than repeated across every Project inside it.

GCP IAM Role Types

Google Cloud IAM roles come in three types: Basic roles (Owner, Editor, Viewer) which are broad and legacy; Predefined roles curated by Google and scoped to a specific service's specific needs; and Custom roles built from individual permissions for access needs a predefined role doesn't precisely match.

GCP Organization

The top-level node in Google Cloud's resource hierarchy, tied to a Google Workspace or Cloud Identity domain. An Organization contains Folders and Projects, and policies or IAM permissions set at this level automatically apply to everything beneath it across the entire company.

GCP Project

The fundamental unit of organization in Google Cloud - every resource belongs to exactly one Project, which serves as the boundary for billing, IAM permissions, and API enablement. A Project has a permanent, globally unique Project ID chosen at creation and never changeable, distinct from its display name which can be updated freely.

GCP Quota

A default limit on how much of a specific resource (like VM CPUs or API calls) can be used per Project per region, designed to prevent runaway costs and protect shared infrastructure. Quotas can be checked and increased through the Console ahead of a known future need, such as a planned launch event.

GCP Storage Class

A pricing and access tier for Cloud Storage objects - Standard, Nearline, Coldline, or Archive - trading lower storage cost against higher retrieval cost and a longer minimum storage duration. Deleting or overwriting an object before its class's minimum duration elapses still bills as if it were stored the full minimum period.

GKE Autopilot

A mode of Google Kubernetes Engine where Google manages node provisioning, sizing, and patching entirely - you define workloads, and nodes appear automatically to run them, billed per pod resource request rather than per node. It is the lower-effort default for most containerized workloads, versus Standard mode's direct node pool control.

Managed Instance Group

A group of identical Compute Engine VMs created from an Instance Template and managed as a single unit, GCP's equivalent of an AWS Auto Scaling Group or Azure VM Scale Set. A Managed Instance Group can autoscale based on a metric like CPU utilization, adding or removing instances automatically within configured minimum and maximum bounds.

Network Tag (GCP)

A freeform string label attached to a Compute Engine VM at creation time, used to target firewall rules to specific VMs. Network tags are simple but can be forgotten or misspelled at scale, which is why Service Account-based targeting is often preferred for anything security-critical in a growing fleet.

OS Login

A Compute Engine feature that ties SSH access to a user's actual Google Identity and IAM permissions, rather than manually managing individual SSH public keys per VM. Enabling OS Login means revoking a departing employee's GCP access also immediately revokes their SSH access to every VM, with no separate key cleanup needed.

Organization Policy (GCP)

A constraint applied at the Organization, Folder, or Project level that restricts what resources are allowed to look like across everything beneath that level - for example, blocking external IP addresses on VMs or restricting allowed regions. Unlike IAM, which controls who can act, Organization Policy controls what configurations are permitted.

Persistent Disk (GCP)

The block storage attached to a Compute Engine VM, equivalent to an AWS EBS volume or Azure Managed Disk. Persistent Disks come in zonal (replicated within one zone, lower cost) and regional (synchronously replicated across two zones, survives a single zone failure) variants.

Security Command Center

Google Cloud's security posture management service, continuously scanning deployed resources against security best practices and surfacing specific, severity-ranked findings - like a publicly accessible storage bucket - rather than a single opaque score. Findings should be prioritized by actual severity, not treated as a count to minimize.

Service Account (GCP)

An identity used by applications, VMs, and automated processes to authenticate to Google Cloud APIs, rather than by a human user. A Service Account is itself also a resource with its own IAM permissions, and can be attached directly to a VM or impersonated temporarily, both safer alternatives to downloading its long-lived JSON key file.

Shared VPC

A configuration where one Project (the host) owns a VPC network, while other Projects (service projects) attach to it and deploy resources using its subnets. This centralizes network administration in the host Project while letting individual teams in service Projects still manage their own resources independently.

Spot VM (GCP)

A Compute Engine VM using Google's spare, unused capacity at a steep discount, with the trade-off that Google can reclaim the instance with short notice. Spot VMs are appropriate only for fault-tolerant, interruption-tolerant workloads like batch processing, never for customer-facing services needing reliable availability.

VPC (GCP)

A Virtual Private Cloud in Google Cloud is a global resource by default, unlike the regional VPC or VNet model in AWS or Azure - a single GCP VPC can span every region, with individual subnets defined per-region inside it. The default auto-mode VPC pre-creates a subnet in every region, while a custom-mode VPC starts empty until subnets are deliberately defined.

VPC Network Peering

A direct connection between two separate VPCs, potentially in different Projects or Organizations, with traffic never touching the public internet. Peering must be established from both sides to become active, and is explicitly non-transitive - if VPC A peers with B, and B peers with C, A cannot reach C without its own direct peering connection to C.

Explore More in GCP Fundamentals and Resource Governance

All 6 Topics

Frequently Asked Questions

Is Understanding the GCP Resource Hierarchy free to learn on DevOps Network?

Yes - this topic, like everything on DevOps Network, is 100% free with no paywall or sign-up gate.

What does the Understanding the GCP Resource Hierarchy topic cover?

Learn how Organizations, Folders, Projects, and Resources fit together, and why the Project ID decision cannot be undone later.