CARVER Damien
Supervision : Sébastien MONNET
Co-supervision : Julien SOPENA
Advanced consolidation for dynamic containers
The virtualization of computing resources has given birth to Cloud Computing, an effective model for sharing resources.
More recently, lightweight container-based virtualization has become increasingly popular.
Containers provide performance isolation comparable to virtual machines, but promise better resource consolidation thanks to their flexibility.
We are interested in this thesis to evaluate the memory consolidation offered by Linux kernel containers.
Thus, we highlight losses of performance isolation assumed to be guaranteed to an active container. These losses occur during consolidation, i.e. when the unused memory of an inactive container is transferred to a new container that starts.
However, in a non-virtualized environment, this memory consolidation scenario does not result in a degradation of performance for the most active processes.
The state of the art argues that in order to guarantee performance isolation, data structures related to memory management must be duplicated for each container.
However, during consolidation, it becomes difficult to arbitrate the usefulness of memory pages of different containers without global structures.
We therefore propose, as a first step, to measure the memory activity of containers using metrics present in the state of the art.
Then, to ensure the isolation of the most active containers during memory consolidation, we modify the behavior of the Linux kernel in order to reclaim the memory of the containers defined as being the most inactive by the metric.
In a second step, we propose another method for estimating the memory activity of the containers based on a global memory event clock.
This method is more reactive than the previous one because it tries to protect the containers whose memory activity is the most recent.
Defence : 05/17/2019
Jury members :
M. Laurent Réveillère, Professeur à l'Université de Bordeaux [rapporteur]
M. Gilles Grimaud, Professeur à l'Université de Lille 1, [rapporteur]
M. Gilles Muller, Professeur à Sorbonne Université
M. Alain Tchana, Professeur à l'Université de Nice
Mme. Béatrice Bérard, Professeur à Sorbonne Université
M. Jean-Pierre Lozi, Maître de conférences à l'Université de Nice
M. Sébastien Monnet, Professeur à l'Université Savoie Mont Blanc
M. Julien Sopena, Maître de conférences à Sorbonne Université
2017-2020 Publications
-
2020
- F. Laniel, D. Carver, J. Sopena, F. Wajsbürt, J. Lejeune, M. Shapiro : “MemOpLight: Leveraging application feedback to improve container memory consolidation”, NCA 2020 - 19th IEEE International Symposium on Network Computing and Applications, Cambridge / Virtual, United States, pp. 1-10 (2020)
- R. Gouicem, D. Carver, J.‑P. Lozi, J. Sopena, B. Lepers, W. Zwaenepoel, N. Palix, J. Lawall, G. Muller : “Fewer Cores, More Hertz: Leveraging High-Frequency Cores in the OS Scheduler for Improved Application Performance”, 2020 USENIX Annual Technical Conference, Boston / Virtual, United States (2020)
- B. Lepers, R. Gouicem, D. Carver, J.‑P. Lozi, N. Palix, M.‑V. Aponte, W. Zwaenepoel, J. Sopena, J. Lawall, G. Muller : “Provable Multicore Schedulers with Ipanema: Application to Work Conservation”, Eurosys 2020 - European Conference on Computer Systems, Heraklion / Virtual, Greece (2020)
-
2019
- D. Carver : “Advanced consolidation for dynamic containers”, thesis, phd defence 05/17/2019, supervision Monnet, Sébastien, co-supervision : Julien, SOPENA (2019)
- D. Carver, R. Gouicem, J.‑P. Lozi, J. Sopena, B. Lepers, W. Zwaenepoel, N. Palix, J. Lawall, G. Muller : “Fork/Wait and Multicore Frequency Scaling: a Generational Clash”, 10th Workshop on Programming Languages and Operating Systems, Huntsville, Canada, pp. 53-59, (ACM Press) (2019)
- F. Laniel, D. Carver, J. Sopena, F. Wajsbürt, J. Lejeune, M. Shapiro : “Highlighting the Container Memory Consolidation Problems in Linux”, NCA 2019 - 18th IEEE International Symposium on Network Computing and Applications, Cambridge, United States, pp. 1-4, (IEEE) (2019)
-
2017
- D. Carver, J. Sopena, S. Monnet : “ACDC : Advanced Consolidation for Dynamic Containers”, NCA 2017 - 16th IEEE International Symposium on Network Computing and Applications, Cambridge, MA, United States, pp. 1-8 (2017)