Cross-Tier and Distributed Caching and Data Management in Massively Distributed Systems

Cross-Tier and Distributed Caching and Data Management in Massively Distributed Systems Download job offer in PDF format Contract type : Fixed-term contract Renewable contract : Yes Level of qualifications required : PhD or equivalent Fonction : Temporary scientific engineer About the research centre or Inria department The Inria Centre at Rennes University is one of Inria's nine centres and has more than thirty research teams. The Inria Centre is a major and recognized player in the field of digital sciences. It is at the heart of a rich R&D and innovation ecosystem: highly innovative PMEs, large industrial groups, competitiveness clusters, research and higher education players, laboratories of excellence, technological research institute, etc. Context Financial and working environment. This engineer position will be in the context of IPCEI-CIS (Important Project of Common European Interest – Next Generation Cloud Infrastructure and Services) DXP (Data Exchange Platform) project involving Amadeus and three Inria research teams (COAST, CEDAR and MAGELLAN). This project aims to design and develop an open-source management solution for a federated and distributed data exchange platform (DXP), operating in an open, scalable, and massively distributed environment (cloud-edge continuum). The position will be recruited and hosted at the Inria Center at Rennes University; and the work will be carried out within the MAGELLAN team in collaboration with other partners. The position is for one year, with the possibility of an extension to 24 months. Assignment Context: The ever-growing number of services and Internet of Things (IoT) devices has resulted in data being distributed across different locations (regions and countries) and different storage tires. Additionally, data exhibits different usage patterns, including cold data (written once and never read), stream data (produced once and consumed by many), and hot data (written once and consumed by many). Furthermore, these data types have different performance and dependability requirements (e.g., low latency for data streams). To ensure the reliability and improve the performance of data-intensive applications, data are either replicated or erasure-coded and distributed across different storage tiers, while frequently accessed data are stored on high-speed devices close to end users (i.e., cached). While much work has investigated data caching, data placement strategies (i.e., deciding what to cache), data movement, cache partitioning, cache eviction [1–8], and cost-efficient data redundancy techniques in caching systems [9], few efforts have focused holistic caching and data management when caches are distributed across heterogeneous platforms (from Edge to Cloud), utilize storage devices with varying performance and cost characteristics, and simultaneously serve diverse workloads, including traditional data services, serverless workflows, and data streaming. The goal of this engineer position is to study, implement, and evaluate novel cross-tier and distributed caching strategies, alongside supporting data management techniques, for hierarchical multi-tier storage systems. The engineer will work closely with a PhD student on this topic. References: [1] Asit Dan and Don Towsley. 1990. An Approximate Analysis of the LRU and FIFO Buffer Replacement Schemes. SIGMETRICS Perform. Eval. Rev. 18, 1 (apr 1990), 143–152. https://doi.org/10.1145/98460.98525 [2] Marek Chrobak and John Noga. 1999. LRU is better than FIFO. Algorithmica 23 (02 1999), 180–185. https://doi.org/10.1007/PL00009255 [3] Blankstein, Aaron, Siddhartha Sen, and Michael J. Freedman. “Hyperbolic caching: Flexible caching for web applications.” 2017 USENIX Annual Technical Conference (USENIX ATC 17). 2017. [4] Cristian Ungureanu, Biplob Debnath, Stephen Rago, and Akshat Aranya. 2013. TBF: A memory-efficient replacement policy for flash- based caches. In 2013 IEEE 29th International Conference on Data Engineering (ICDE). 1117–1128. https://doi.org/10.1109/ICDE.2013.6544902 [5] Orcun Yildiz, Amelie Chi Zhou, Shadi Ibrahim. 2018. Improving the Effectiveness of Burst Buffers for Big Data Processing in HPC Systems with Eley. Future Generation Computer Systems, Volume 86, 2018, Pages 308-318, ISSN 0167-739X, https://doi.org/10.1016/j.future.2018.03.029. [6] G. Aupy, O. Beaumont and L. Eyraud-Dubois, "Sizing and Partitioning Strategies for Burst-Buffers to Reduce IO Contention," 2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS), Rio de Janeiro, Brazil, 2019, [7] ZHANG, Yazhuo, YANG, Juncheng, YUE, Yao, et al. {SIEVE} is simpler than {LRU}: an efficient {Turn-Key} eviction algorithm for web caches. In : 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI 24). 2024. p. 1229-1246. [8] Juncheng Yang, Ziming Mao, Yao Yue, and K. V. Rashmi. GL-Cache: Group-level learning for efficient and high-performance caching. FAST’23, pages 115–134, 2023. [9] RASHMI, K. V., CHOWDHURY, Mosharaf, KOSAIAN, Jack, et al.{EC-Cache}:{Load-Balanced},{Low-Latency} cluster caching with online erasure coding. In : 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). 2016. p. 401-417. Main activities • Study novel cross-tier and distributed caching strategies, alongside supporting data management techniques • Prototype key caching strategies and data management techniques • Run experiments and Evaluation of results • Reporting, disseminating and presenting results. • Participate in project meetings and discussions with other partners. Skills • A solid background in the area of distributed systems • Experience with building systems and tools • Software development skills: Python and Java • Working experience in the areas of data management, storage and caching systems are advantageous • Good collaborative and networking skills • Excellent written and oral communication in English Benefits package • Subsidized meals • Partial reimbursement of public transport costs • Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.) • Possibility of teleworking (after 6 months of employment) and flexible organization of working hours • Professional equipment available (videoconferencing, loan of computer equipment, etc.) • Social, cultural and sports events and activities • Access to vocational training • Social security coverage Remuneration Starting from €2,695 gross per month, based on your experience Apply for this position Share • Facebook • Linkedin • Twitter • Email General Information • Theme/Domain : Distributed Systems and middleware System & Networks (BAP E) • Town/city : Rennes • Inria Center : Centre Inria de l'Université de Rennes • Starting date : 2026-10-01 • Duration of contract : 12 months • Deadline to apply : 2026-10-12 Warning : you must enter your e-mail address in order to save your application to Inria. Applications must be submitted online on the Inria website. Processing of applications sent from other channels is not guaranteed. Instruction to apply Please submit online : your resume, cover letter and letters of recommendation eventually Defence Security : This position is likely to be situated in a restricted area (ZRR), as defined in Decree No. 2011-1425 relating to the protection of national scientific and technical potential (PPST).Authorisation to enter an area is granted by the director of the unit, following a favourable Ministerial decision, as defined in the decree of 3 July 2012 relating to the PPST. An unfavourable Ministerial decision in respect of a position situated in a ZRR would result in the cancellation of the appointment. Recruitment Policy : As part of its diversity policy, all Inria positions are accessible to people with disabilities. Contacts • Inria Team : MAGELLAN • Recruiter : Ibrahim Shadi / Shadi.Ibrahim@inria.fr About Inria Inria, the French national institute for research in digital science and technology, supports the French government in national research and innovation strategies in the digital field, acting as Digital Programs Agency. Inria leads over 300 research and innovation projects with its 3,500 scientists, engineers, and support staff, in partnership with universities and the digital ecosystem (businesses, entrepreneurs, and public stakeholders). Together, we explore strategic fields such as artificial intelligence, cybersecurity, quantum computing, cloud technologies, digital transformation in healthcare, digital twins, and digital technologies for defence. We develop practical solutions such as software, tech startups, partnerships with national companies, and cutting-edge training programmes. Our goal is to drive scientific, technological, and industrial excellence to ensure France’s digital sovereignty.