文档介绍：京东弹性计算云: 软件定义数据中心与容器集群调度刘海锋内部基础云服务建设广告拍拍金融商城中间件系统数据存储弹性计算云智能硬件国际化新业务挑战: 越来越多的机器 server server server trading OFC Webpage serving server server search advertising server server server hadoop spark mpi server Image serving server Streaming compute 京东弹性计算云之路在线容器 11000+ 战略项目 2014/10 2015/2 2015/618 新数据中心建设 2015/8 Engineering is all about choices Choice I. 虚拟机还是容器?技术没有新旧优劣?统一管理物理机、虚拟机、轻量容器–Docker作为一等公民 Choice II. 激进改造还是逐渐变革?Q: Mesos, es, CoreOS…? ?A : –OpenStack married with Docker ?‘胖容器’–Proprietary container scheduling Choice III. 网络?VLAN + OVS V M 1 s w i t c h n o v a - c o m p u t e n e u t r o n - o p e n v s w i t c h - a g e n t 计算节点 O V S E t h 1 E t h 2 V M 2 n e u t r o n - d h c p - a g e n t n e u t r o n - o p e n v s w i t c h - a g e n t n e u t r o n - l 3 - a g e n t 网络节点 O V S E t h 1 E t h 2 V M 3 计算节点 O V S E t h 1 E t h 2 V M 4 d n s m a s q d n s m a s q e t h 0 1 7 2 . 1 7 . 4 . 1 0 m a n a g e s w i t c h e t h 0 1 7 2 . 1 7 . 4 . 1 1 e t h 0 1 7 2 . 1 7 . 4 . 1 2 V L A N I D c o n v e r t e d w i t h f l o w t a b l e d l _ v l a n = 1 0 1 = > m o d e _ v l a n _ v i d : 1 d l _ v l a n = 1 0 2 = > m o d e _ v l a n _ v i d : 2 V L A N I D c o n v e r t e d w i t h f l o w t a b l e d l _ v l a n = 1 = > m o d e _ v l a n _ v i d : 1 0 1 d l _ v l a n = 2 = > m o d e _ v l a n _ v i d : 1 0 2 O V S V L A N n o v a - c o m p u t e n e u t r o n - o p e n v s w i t c h - a g e n t T r u n k 模式、 B o n d 4 T r u n k 模式、 B o n d 4 T a g 1 T a g 2 T a g 1 T a g 2 T a g 1 T a g 2 V L A N 1 0 1 V L A N 1 0 2 O p e n v S w i t c h N a m e s p a c e n s 1 N a m e s p a c e n s 2 L i n u x S e r v e r O V S w i t h t w o v e t h p a i r s V e t h p a i r V e t h p a i r O p e n v S w i t c h N a m e s p a c e n s 1 N a m e s p a c e n s 2 L i n u x S e r v e r O V S w i t h t w o o v s p o r t s O V S p o r t O V S p o r t Choice IV. 存储?No device-mapper etc. Build our own. Container /export/L0 (tmpfs) /export/L1 (SSD) /export/L2 (SAS) /export/L3 (JFS) L