Secure Private Data Center

Conslidated private data center artifacts.

Hardware

GDC - Google Distributed Cloud

GDC is Google's version of private or hybrid cloud within your own data center. There are 3 main versions of GDC - where GDC Connected and GDC air-gapped are Google provided hardware and software. We will concentrate on GDC software only - for bare metal.

GDCC - Google Distributed Cloud connected (edge)

GDCAG - Google Distributed Cloud air-gapped

GDCS - Google Distributed Cloud software only

There was a historical variant of GDC Hosted (renamed GDC connected (edge) where a POC can be setup to install GDC software only on your own VMs to prep for eventual delivery and integration of the 4 minimum racks in a 300k/month GDC Hosted - https://docs.cloud.google.com/distributed-cloud/hosted/docs/latest/gdch/resources/faq

GDC Component Mapping

Component	Use Case	GCP	GDC	OSS
API Gateway	L7 LB	Apigee	GKE dataplane 2 Gateway API	Ingres
Connect Agent (GKE)	anthos fleet registration	.	Connect Agent	.
Service Mesh	.	.	.	.
VM virtualization	VMs on Kubernetes	GCE	VM Manager	KubeVirt
.	.	.	.	.

GDC Documentation

• https://docs.cloud.google.com/distributed-cloud/docs
• See VM Runtime (wraps Redhat KubeVirt) https://docs.cloud.google.com/kubernetes-engine/distributed-cloud/bare-metal/docs/vm-runtime/enable-disable

GDC Training

• https://partner.skills.google/catalog?keywords=GDC
• https://cloud.google.com/customers/rubin-observatory

GDC software only for Bare Metal

• https://docs.cloud.google.com/kubernetes-engine/distributed-cloud/bare-metal/docs/concepts/about-bare-metal

This GDC software-only for BM looks to be a rebrand of Anthos where on prem CPUs are billed back to the GCP Project.

Lenovo Rack Servers as GDC Simulators

• https://vmware.lenovo.com/content/recipe/SR250%20V3-Raptor%20lake-ESXi9.0.html
• https://serverproven.lenovo.com/
• https://lenovopress.lenovo.com/lp1215.pdf#:~:text=Lenovo%20has%20certified%20the%20ThinkAgile%20VX%20solution,an%20Anthos%20Ready%20virtualized%20platform%2C%20with%20bare%2Dmetal

Lenovo SR250 V3 Rack Server

Lenovo XEON blades are cost effective for GDC simulation and include a secondary management CPU/Software stack for configuraiton - lead time is 30 days for shipping. The following SR250 V3 server can run either Redhat or Ubuntu.

After post shipping diagnostics and setup...

The blades can be installed to a standard 19 inch rack in 1U slots and connected to top of rack switches/routers along with separate redundant power sources.

For smaller rack depths such as 24 inches - the supplied lenovo specific extendable rails must be replaced with fixed 3rd party rails.

TOR Networking

Currently using TPLink 10gbps rack switches and routers.

Software

Kubernetes Installations

AWS - EKS Anywhere

• see https://aws.amazon.com/pm/eks-anywhere/

GCP - Google Distributed Cloud

• see https://github.com/ObrienlabsDev/secure-private-data-center/blob/main/README.md#gdc---google-distributed-cloud

Harbor

• https://goharbor.io/

Openstack

Open Nebula

• Open Nebula - https://en.wikipedia.org/wiki/OpenNebula

Use Cases

• https://github.com/ObrienlabsDev/drone-streaming-extraction?tab=readme-ov-file
• https://github.com/ObrienlabsDev/blog/wiki/Drone-Streaming-Extraction

Issues

• ObrienlabsDev/blog#174

Links

• https://cloud.google.com/blog/topics/hybrid-cloud/using-gdc-sandbox-to-emulate-air-gapped-environments
• GDC on bare metal - https://docs.cloud.google.com/kubernetes-engine/distributed-cloud/bare-metal/docs/downloads
• https://www.supermicro.com/en/solutions/google-distributed-cloud-virtual
• https://cloud.google.com/blog/products/infrastructure-modernization/google-distributed-cloud-edge-appliance-use-cases/
• https://docs.cloud.google.com/kubernetes-engine/distributed-cloud/bare-metal/docs/try/admin-user-gce-vms
• https://www.datacenterdynamics.com/en/news/google-makes-distributed-cloud-edge-hardware-generally-available/
• https://cloud.google.com/blog/products/infrastructure-modernization/google-distributed-cloud-edge-appliance-use-cases/
• GDC Edge Appliance is deprecated - https://docs.cloud.google.com/distributed-cloud/edge-appliance/deprecated-notice
• https://docs.cloud.google.com/distributed-cloud/hosted/docs/latest/appliance/overview

Lenovo Rack Servers

Lenovo SR250 V3 Rack Servers for GDC

Private Cloud: PaaS Kubernetes stack with IaaS provisioning - HA and DR

• https://github.com/ObrienlabsDev/blog/blob/main/google-distributed-cloud.md
• https://github.com/ObrienlabsDev/blog/blob/main/private-cloud.md
• https://github.com/ObrienlabsDev/secure-private-data-center
• ObrienlabsDev/blog#172
• ObrienlabsDev/blog#137
• ObrienlabsDev/blog#171
• ObrienlabsDev/blog#170
• ObrienlabsDev/blog#163
• ObrienlabsDev/blog#174
• Google internal-only L300 Anthos Migration notes - ObrienlabsDev/gcp-infrastructure-as-code#22

Finances

GKE Costs

GKE control planes are per cluster (regardless of size) - at $0.1/hr - with free credits of 74.4 allocated for a single cluster (autopilot or zonal) - https://cloud.google.com/kubernetes-engine/pricing

Anthos Costs

Anthos has a one time credit of 1000US - getting details for new accounts.

References

• ONAP - https://onap.org/
• GoC/SSC Aurora (Cross CSP Kubernetes based LZ for use in Public Sector) - https://github.com/gccloudone-aurora including helm charts - https://github.com/gccloudone-aurora/aurora-platform-charts (not https://github.com/gccloudone/aurora) - tracking ObrienlabsDev/blog#176