Application-Aware SDN Routing for Big Data Networking

Abstract

Big-Data applications need to shuffle their data over a network in a very large amount. The ability to efficiently allocate network resources to quickly finish the shuffle greatly affects the overall processing speed of Big-Data applications. The recent emergence of software-defined networking (SDN) technology makes it easier for the network to integrate with a Big-Data application. The network can allocate network resources based on an application\'s run-time requirements to accelerate the speed of Big-Data delivery. In this paper, we used Hadoop as a Big-Data application platform and designed an application-aware SDN routing scheme for Hadoop to accelerate its MapReduce data shuffling over a network. Our results show that our method can outperform the ECMP-RR scheme by up to 20% and outperform the Spanning Tree method and the Floodlight OpenFlow controller by up to 70%.