With the booming of Cloud Compute, OpenStack has been more widely used in Data Center, but in tradition deployment of OpenStack, the traffic must traverse network node to get routing decision. So the network node would be a bottle-neck due to the increasing amount of data flow. In order to solve this problem, this paper propose an extensible design, we create a internal virtual router in each compute node, the internal virtual router just can process the East-West traffic in lay2. With the help of distributed router, the East-West traffic can be delivered directly from the source hypervisor to the destination hypervisor, no longer need to traverse the router in network node to get routing decision, Therefore, North-South and East-West traffic don't impact each other anymore. North-South traffic enjoys all the bandwidth of router in network node exclusively, hence reduce the load of the network node. Experiment results show that OpenStack with distributed router has a much better performance evaluation than original OpenStack. This will dramatically increase the total bandwidth, and also bring other advantages.