Order Preserving Stream Processing in Fog Computing Architectures

K. Vidyasankar

Abstract


A Fog Computing architecture consists of edge nodes that generate and possibly pre-process (sensor) data, fog nodes that do some processing quickly and do any actuations that may be needed, and cloud nodes that may perform further detailed analysis for long-term and archival purposes. Processing of a batch of input data is distributed into sub-computations which are executed at the different nodes of the architecture. In many applications, the computations are expected to preserve the order in which the batches arrive at the sources. In this paper, we discuss mechanisms for performing the computations at a node in correct order, by storing some batches temporarily and/or dropping some batches. The former option causes a delay in processing and the latter option affects Quality of Service (QoS). We bring out the trade-offs between processing delay and storage capabilities of the nodes, and also between QoS and the storage capabilities.

Keywords


Fog computing, Order preserving computations, Quality of Service

References


F. Bonomi, R. Milito, J. Zhu & S. Addepalli (2012)“Fog computing and its role in the internet of things”, Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing, MCC ’12, pp 13–16, New York, NY, USA, ACM.

F. Bonomi, R. Milito, P. Natarajan & J. Zhu (2014) “Fog computing: A platform for internet of things and analytics”, In N. Bessis and C. Dobre, editors, Big Data and Internet of Things: A Roadmap for Smart Environments, pp169–186, Springer International Publishing, Cham.

C. Chang, S. N. Srirama& R. Buyya (2017)“Indie fog: An efficient fogcomputing infrastructure for the internet of things”,Computer, Vol. 50, No. 9, pp 92–98.

A. V. Dastjerdi& R. Buyya(2016)“Fog computing: Helping the internet of things realize its potential”,Computer, Vol. 49, No. 8, pp 112–116.

K. Vidyasankar (1991)“Unified theory of database serializability”, FundamentaInformatica, Vol. 1, No. 2, pp 145-153.

K. Vidyasankar (2018a)“Distributing computations in fog architectures”, TOPIC’18 Proceedings. Association for Computing Machinery.

K. Vidyasankar (2018b)“Atomicity of executions in fog computing architectures”,Proceedings of the Twenty Seventh International

Conference on Software Engineering and Data Engineering (SEDE-18).

N. Conway (2008)“Transactions and data stream processing”, Online Publication, pages 1–28. http://neilconway.org/docs/stream_txn.pdf .

J. Meehan, N. Tatbul, S. Zdonik, C. Aslantas, U. Cetintemel, J. Du, T. Kraska, S. Madden, D. Maier, A. Pavlo, M. Stonebraker, K. Tufte, & H. Wang (2015) “ S-store: Streaming meets transaction processing”,Proc. VLDB Endow., Vol. 8, No. 13, pp 2134–2145.

I. Botan, P. M. Fischer, D. Kossmann, & N. Tatbul (2012)“Transactional stream processing”, Proceedings EDBT, ACM Press.

L. Gürgen, C. Roncancio, S. Labbé& V. Olive (2006)“Transactional issues in sensor data management”, Proceedings of the 3rd International Workshop on Data Management for Sensor Networks (DMSN’06), Seoul, South Korea, pp 27–32.

M. Oyamada, H. Kawashima, & H. Kitagawa (2013)“Continuous query processing with concurrency control: Reading updatable resources consistently”, Proceedings of the 28th Annual ACM Symposium on Applied Computing, SAC ’13, pp 788–794, New York, NY, USA, ACM.

K. Vidyasankar (2017) “On continuous queries in stream processing”, The 8th International Conference on Ambient Systems, Networks and Technologies (ANT-2017), Procedia Computer Science, pp 640–647. Elsevier.

L. Andrade, M. Serrano& C. Prazeres (2018)“The data interplay for the fog of things: A transition to edge computing with IoT”,Proceedings of the 2018 IEEE International Conference on Communications (ICC), IEEE Xplore.

S. H. Mortazavi, M. Salehe, C. S. Gomes, C. Phillips & E. de Lara (2017)“Cloudpath: A multi-tier cloud computing framework”, Proceedings of the Second ACM/IEEE Symposium on Edge Computing, SEC ’17, pp 20:1–20:13, New York, NY, USA, ACM.

storm.apache.org/releases/1.0.6/Transactional-topologies.html.

Jin Li , Kristin Tufte, VladislavShkapenyuk, VassilisPapadimos, Theodore Johnson & David Maier (2008) “Out-of-Order Processing: A new Architecture for high-performance stream systems”, PVLDB ’08, pp 274-288, VLDB Endowment.

Zhitao Shen, Vikram Kumaran, Michael J. Franklin, Sailesh Krishnamurthy, Amit Bhat, Madhu Kumar, Robert Lerche& Kim Macpherson (2015) “CSA: Streaming engine for internet of things”, Data Engineering bulletin, Vol. 38, No. 4, pp 39-50, IEEE Computer Society.

F. Xhafa, V. Naranjo, L. Barolli& M. Takizawa (2015)“On streaming consistency of big data stream processing in heterogeneous clusters”, Proceedings of the 18th International Conference on Network-Based Information Systems. IEEE Xplore.


Full Text: PDF

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

IT in Innovation IT in Business IT in Engineering IT in Health IT in Science IT in Design IT in Fashion

IT in Industry @ http://www.it-in-industry.com . ISSN (Online): 2203-1731; ISSN (Print): 2204-0595