Orchestration Software: Executive Summary
Sea Change Series: Orchestration Software In The Mega Data Center
Sea Change Series: Orchestration Software in the Mega Data Center, Amazon, Google, Microsoft, Facebook
Aim to Realign IT Cost Structure 3
Internet Has Grown by a Factor of 100 Over The Past 10 Years 4
Table of Contents 5
Orchestration Software Automates Data Center Infrastructure 14
Software Containers 15
Orchestration Schedulers Manage Containers 16
Orchestration Software Supports Container Automation 17
Realigning Data Center Cost Structures 18
IT Relies On Replacing Virtual Machine: VM Virtualization 19
Microservices 20
Microservices Features 21
Microservices Modules 23
Difficulties with Virtual Machines 24
Hypervisor a Difficulty 25
Virtual Machines Use Bare Metal, Containers Use Orchestration Software 27
Bare Metal an Inefficient Use of Compute Resource 28
Bare Metal Less Efficient 28
Industry Uses Robots Because Manual Labor Is Slow And Error Prone 29
IT processes Replace Manual Labor 30
Mega Data Center Orchestration Software 31
Large Fabric Network Not The Kind Of Environment That Can Be Realistically Configured And Operated In A Manual Way32
To Automate the Data Center Fabric 33
Value of Data Center Fabric 33
Google Shift from Bare Metal To Container Controllers 34
Google Container Controller Shift From Bare Metal In A Mixed Workload And In Nested Compute Units 35
Google Kubernetes Groups Software Containers 36
Fabric Services Inside A Container 37
Architecting Microsoft Cloud 38
Microsoft Managed Clustering and Container Management: Docker and Mesos 39
Microsoft Azure Service Fabric 41
Microsoft Is Seen As The Overall Winner In The Move To Application Containers 42
Microsoft Dublin Cloud 2.0 Mega Data Center 43
Microsoft Data Center, Dublin, 550,000 Square Feet 43
Microsoft Dublin Center Operates at a Power Usage Effectiveness (PUE) of 1.25. 44
Microsoft Data Center Container Area in Chicago. 44
Microsoft 45
Advantages of Using Containers 46
Orchestration Software Used to Create Containers 47
Disadvantages of Using Containers 48
Advantages of Virtual Machines 49
Container Orchestration 50
Use of Containers Eliminate Manual Process 51
IT Pros Increasingly Turn to Chef and Puppet 52
Hardware Containers Do Not Scale 53
Facebook Data Center Positioning 54
IBM Data Center Orchestration Software Automates Application Integration 55
Docker Orchestration & Docker Swarm 56
Docker Container Platform 57
Common Feature Sets For Orchestration Tools 58
Not all Orchestrators Are Created Equal 59
AWS Cloud Container Adoption Criteria 60
AWS Cloud Adoption Methodology 63
AWS Cloud Adoption Framework 64
AWS Market Leader In Cloud Computing 65
Facebook Fabric and Node are Core Structures Leveraging Software Orchestration 66
Apache Mesos Orchestration Software 67
Google Kubernetes Container 68
Google Container Builder Step Toward Building Pluggable Components in a Pipeline 69
Google Programmable Access To Network Stack 70
Google Andromeda Software Defined Networking (SDN)- 71
Google Compute Engine Load Balancing 72
Google Compute Engine Load Balanced Requests Architecture 73
Google Scaling Of The Compute Engine Load Balancing 74
Google Compute Engine (GCE) TCP Stream Performance Improvements 75
Google Cloud Platform TCP Andromeda Throughput Advantages 76
Google Open Sourced Its Container Management System Called Kubernetes 77
Facebook 79
Ability To Move Fast And Support Rapid Growth At The Core Of Facebook Infrastructure Design Philosophy 80
The Right Type of Cloud: Mega Data Centers 82
AWS Has Been Able To Adapt To Change 83
Manual Labor Is Slow And Error Prone 84
Mega Data Center Orchestration Software 86
Amazon, Google, Microsoft, Facebook 87
Cloud 2.0 Mega Data Center Fabric Implementation 87
Fabric and Node are Core Structures Leveraging Software Orchestration 89
Multi-Threading, Dynamic Systems 91
Oracle Multi-Threading Mega Data Center 92
Orchestration Tools Manage A Cluster As A Single Deployment 93
Microservice Monitoring with Google Kubernetes 94
Docker Container 94
Cluster Functions and Pod Benefits 95
Mesosphere DC/OS an Open-Source Project Built on Apache Mesos 96
Mesosphere Enterprise DC/OS Orchestration Software 96
Mesosphere DC/OS Production Containers Uses 97
Mesosphere DC/OS Orchestration Software 97
Mesosphere DC/OS Extending Capabilities Within Container Orchestration 98
Mesosphere DC/OS Certification Compliance 98
Mesosphere Market Leadership Position 99
Mesosphere DC/OS Runs Data Services on One Single Platform 99
Cloud Computing Not Enough: Entire Warehouse Building As A Single Mega Data Center System 100
Red Hat Ansible 101
Red Hat Ansible Architecture, Agents, And Security 102
Red Hat Ansible Advanced Features 102
Red Hat / Ansible 103
Red Hat Ansible Tower 3 Job Run Metrics 104
Cisco Integrated Infrastructure Management 105
Cisco UCS Helps Manage Administrative Costs And Reign In Complexity 106
Mesosphere DC/OS: Mesos Features 108
Heart of DC/OS: Apache Mesos 109
DC/OS Implements Containers 110
WinterGreen Research, 111
WinterGreen Research Methodology 112

List of Figures
Mega Data Center Depends on Orchestration Software to Control Operations, Implement Microservices
Figure 1. Slow Growth Mode of Companies with Enterprise Data Centers 3
Figure 2. Mega Data Center Fabric Implementation 4
Figure 3. Business Innovation and Technology 14
Figure 4. Docker Orchestration Software Creates Containers 15
Figure 5. Docker Compose 16
Figure 6. Mesosphere Marathon 16
Figure 7. Google Kubernetes 16
Figure 8. Orchestration Software Supports Container Automation 17
Figure 9. Orchestration Software Decreases Data Center Cost Structure 18
Figure 10. Files Bundled into a Container 19
Figure 11. Microservices: Suite Of Independently Deployable Service Modules with a Unique Process And Well-Defined, Lightweight Communication Portal: Mechanism To Serve A Business Goal 20
Figure 12. Microservices Distinct Features: Taxi Hailing Example 21
Figure 13. Microservices Market Segments 22
Figure 14. Microservices Modules 23
Figure 15. Hypervisor Virtualization Operating System Interface 24
Figure 16. Hypervisor Virtualization Operating System Interface 25
Figure 17. Virtual Machines Less Efficient Than Containers 26
Figure 18. Difference Between Virtual Machines and Containers 26
Figure 19. Bare Metal Management Replaced by Container Controllers 27
Figure 20. Containers vs. VMs 28
Figure 21. Industrial Robots Eliminate Manual Labor 29
Figure 22. Industry Uses Robots To Replace Manual Labor 29
Figure 23. Data Centers Need The Precision and Automation Similar to that Provided by Multi-Step Sequential Task Industrial Robots 30
Figure 24. Mega Data Center Orchestration Software 31
Figure 25. Single-Fabric Data Center Network Architecture 32
Figure 26. Bare Metal Presents a Lot of Extra Parameters and Metrics, Significantly More than With Containers 34
Figure 27. Nested Compute Units 35
Figure 28. Kubernetes Orchestration Software Groups Containers That Make Up An Application Into Logical Units 36
Figure 29. Kubernetes Orchestration Software Functions 36
Figure 30. Container Features as it integrates with the Service Fabric Runtime 37
Figure 31. Microsoft Setting Up A Secure Service Fabric Cluster in Azure using the Azure Portal. 40
Figure 32. Microsoft Data Center, Dublin, 550,000 Sf 43
Figure 33. Container Area In The Microsoft Data Center In Chicago 44
Figure 34. Microsoft Cloud Network Features 45
Figure 35. Like Physical Containers on a Ship, Software Containers Bring Many Servers Densely Packed 46
Figure 36. Advantages of Using Containers 47
Figure 37. Software Orchestration Container Challenges 48
Figure 38. Manual Process 51
Figure 39. Containers Need Orchestration Software 51
Figure 40. Virtual Machine Data Center Management Tasks: 52
Figure 41. FaceBook Open Compute Project 53
Figure 42. Facebook Data Center Modernization Functions 54
Figure 43. Facebook Altoona Iowa Cloud 2.0 Mega Data Center 54
Figure 44. Manual Process for Application Integration Deployment 55
Figure 45. Feature Sets For Orchestration Tools 58
Figure 46. Issues for Orchestration Software 59
Figure 47. AWS Cloud Container Adoption Criteria 60
Figure 48. AWS Cloud Container 61
Figure 49. AWS Cloud Adoption Framework 62
Figure 50. AWS Market Leader In Cloud Computing 65
Figure 51. Description of the Orchestration Software 67
Figure 52. Advantages of Using the Container Builder Cloud Architecture as a Service: 69
Figure 53. Google Andromeda Cloud High-Level Architecture 70
Figure 54. Google Andromeda Software Defined Networking (SDN)-Based Substrate Functions 71
Figure 55. Google Andromeda Performance Factors Of The Underlying Network 72
Figure 56. Google Compute Engine Load Balanced Requests Architecture 73
Figure 57. Google Compute Engine Load Balancing 74
Figure 58. Google Cloud Platform TCP Andromeda Throughput Advantages 76
Figure 59. IoT: Open Source IoT High Level Platform, OpenStack and Kubernetes 78
Figure 60. Facebook DuPont Fabros Technology Ashburn, VA Data Center 81
Figure 61. Cloud 2.0 Mega Data Centers Support 1.5 Billion Facebook Users Worldwide. 82
Figure 62. AWS Market Leader In Cloud Computing 83
Figure 63. Data Centers Need The Precision and Automation Provided by Multi-Step Sequential Task Industrial Robots 85
Figure 64. Mega Data Center Orchestration Software Functions 86
Figure 65. Multiple Pathways Open To Processing Nodes In The Cloud 2.0 Mega Data Center Functions 90
Figure 66. Dynamic Load Balancing 91
Figure 67. Mesosphere Customer References 96
Figure 68. Mesosphere DC/OS Certification Compliance 98
Figure 69. Cloud Is Not Enough 100
Figure 70. Red hat Ansible Playbook Language Advanced Features 103
Figure 71. Red Hat Ansible Tower 3 Job Run Metrics 104 Cisco UCS Helps Manage Administrative Costs And Reign In Complexity 106
Figure 72. Cisco UCS Helps Manage Administrative Costs And Reign In Complexity 106
Figure 73. Cisco UCS Director Delivers Comprehensive Infrastructure Management and Orchestration 107
Figure 74. Mesosphere DC/OS: Mesos Features: 108
Figure 75. Native Mesos Containerizer Functions 110