Asian Journal of Information Technology
Year:
2016
Volume:
15
Issue:
15
Page No.
2645 - 2655
Efficient Map Reduce Task Scheduling and Micro-Partitioning Mechanism for Optimizing Large Data Analysis
Authors :
A. Kamaleswari
and
P. Thangaraj
References
Alexandraki, A. and M. Paterakis, 2005. Performance evaluation of the deadline credit scheduling algorithm for soft-real-time applications in distributed video-on-demand systems. Cluster Comput., 8: 61-75.
CrossRef | Direct Link | Candan, K.S., J. Kim, P. Nagarkar, M. Nagendra and R. Yu, 2011. RanKloud: Scalable multimedia data processing in server clusters. IEEE. MultiMedia, 18: 64-77.
CrossRef | Direct Link | Dean, J. and S. Ghemawat, 2008. MapReduce: Simplified data processing on large clusters. Commun. ACM, 51: 107-113.
CrossRef | Gonzalez, J.E., Y. Low, H. Gu, D. Bickson and C. Guestrin, 2012. Powergraph: Distributed graph-parallel computation on natural graphs. Proceedings of the Presented as part of the 10th USENIX Symposium on Operating Systems Design and Implementation, October 8-10, 2012, ACM, New York, USA., pp: 17-30.
Hammoud, M. and M.F. Sakr, 2011. Locality-aware reduce task scheduling for MapReduce. Proceedings of the IEEE 3rd International Conference on Cloud Computing Technology and Science, November 29-December 1, 2011, IEEE, Athens, Greece, ISBN: 978-1-4673-0090-2, pp: 570-576.
Hammoud, M., M.S. Rehman and M.F. Sakr, 2012. Center-of-gravity reduce task scheduling to lower mapreduce network traffic. Proceedings of the IEEE 5th International Conference on Cloud Computing, June 24-29, 2012, IEEE, Honolulu, Hawaii, ISBN: 978-1-4673-2892-0, pp: 49-58.
Hindman, B., A. Konwinski, M. Zaharia, A. Ghodsi and A.D. Joseph
et al., 2011. Mesos: A platform for fine-grained resource sharing in the data center. NSDI., 11: 22-22.
Jawad, S.K., 2006. Task scheduling in distributed systems using a mathematical approach. Asia J. Inform. Technol., 5: 69-74.
Direct Link | Polo, J., D. Carrera, Y. Becerra and J. Torres, 2010. Performance-driven task co-scheduling for mapreduce environments. Proceedngs of the Symposium on Network Operations and Management, April 19-23, 2010, Osaka, pp: 373-380.
Polo, J., D. Carrera, Y. Becerra, V. Beltran, J. Torres and E. Ayguade, 2010. Performance management of accelerated MapReduce workloads in heterogeneous clusters. Proceedings of the 39th International Conference on Parallel Processing, September 13-16, 2010, USA., pp: 653-662.
Slagter, K., C.H. Hsu, Y.C. Chung and D. Zhang, 2013. An improved partitioning mechanism for optimizing massive data analysis using MapReduce. J. Super Comput., 66: 539-555.
CrossRef | Direct Link | Zaharia, M., D. Borthakur, J.S. Sarma, K. Elmeleegy, S. Shenker and I. Stoica, 2010. Delay scheduling: A simple technique for achieving locality and fairness in cluster scheduling. Proceedings of the 5th European Conference on Computer Systems, April 13-16, 2010, Paris, France -.