Research Interests

My research interests include, but not limited to: Evolutionary Computation, Noisy Optimisation (derivation-free algorithms, dynamic resampling strategies), Game AI (AI for playing games, AI for designing games), and Algorithm Portfolio methods.

Academic & Industrial Projects

Optimisation in uncertain environments

  • Routing problems with uncertainties: I start to explore the problems with uncertainties in smart logistics, in particular, the robust optimisation in routing problems with uncertainties.
  • Dynamic resampling strategies in noisy optimization: Noisy optimization is the optimization of objective functions corrupted by noise, aiming at searching for solutions that achieve optimal expected objective value. In real-world applications, the noise come from various uncertainties that can affect the evaluation of a solution. As a consequence of a lack of knowledge of the uncertainties, black-box noisy optimization is considered. Evolutionary computation techniques are suitable for black-box noisy optimization as they do not require knowledge about the problems. However, there is still a risk of mis-ranking solutions due to the noise, which probably leads to the divergence or slow convergence of algorithms. Resampling, i.e. evaluating a given solution multiple times, can be used to reduce the effect of noise. Designing efficient resampling strategies is challenging.
  • Energy planning (2013-2015): I have worked on an ADEME project, POST ("Plateforme d'Optimisation des Supergrids Transcontinentaux"), which is a collaboration between INRIA and Artelys, a company specialised in optimisation, decision-support and modelling. Besides the research part, I also participated in improving Metis, platform developed by INRIA and Artelys, specialised in the optimisation and modelling in energy investment problem (2013-2015).

AI in Games

  • Procedural Content Generation via Machine Learning.
  • Search-based game design: Automatic level generation, agent evolving and game parameter tuning using black-box noisy optimisation algorithms, such as Evolution Algorithms.
  • General video game playing: Game AI for general video game playing, testing on a wide range of single-player and 2-player games using the General Video Game AI (GVG-AI) platform.

Other projects

  • ''EverydayTravelApp'' (2016-2017): Collaboration with the Essex County Council for developing mobile applications on both iOS and Android platforms, which allow users to view travel conditions across their preferred modes of travel for their highlighted journeys and places, taking into account the status of the traffic (e.g. delay caused by incidents), and propose alternative travel choices. The app is available on Apple Store and Play Store.

Publications

Peer-reviewed Publications

You can also check my publications on Google Scholar.

(♦ indicates that the authors are listed in alphabetical order.)

  1. Jialin Liu, Ke Tang, Xin Yao, ``Robust Optimisation in Uncertain Capacitated Arc Routing Problems: Progresses and Perspectives,'' in IEEE Computational Intelligence Magazine, vol. 16, no. 1, pp. 63-82, Feb. 2021, doi: 10.1109/MCI.2020.3039069. (SCI) [pdf] or [pdf]

  2. Jialin Liu, Sam Snodgrass, Ahmed Khalifa, Sebastian Risi, Georgios N. Yannakakis, Julian Togelius, ``Deep Learning for Procedural Content Generation,'' Neural Computing and Applications (NCAA), vol. 33, pp. 19-37, 2020. (SCI) [pdf]

  3. Jialin Liu, Qingquan Zhang, Jiyuan Pei, Hao Tong, Xudong Feng, Feng Wu, ``fSDEA: Efficient Evolutionary Optimisation for Many-objective Aero-engine Calibration,'' in Complex & Intelligent Systems, 2021. DOI: 10.1007/s40747-021-00374-1 (Accepted) (SCI)

  4. Jialin Liu, Antoine Moreau, Mike Preuss, Jeremy Rapin, Baptiste Roziere, Fabien Teytaud, Olivier Teytaud, ``Versatile Black-Box Optimization,'' Proceedings of the 2020 Genetic and Evolutionary Computation Conference (GECCO 2020), Association for Computing Machinery, New York, NY, USA, 620–628. DOI:https://doi.org/10.1145/3377930.3389838. (EI) [pdf] (♦)

  5. Jacob Schrum, Jake Gutierrez, Vanessa Volz, Jialin Liu, Simon Lucas, Sebastian Risi, ``Interactive Evolution and Exploration Within Latent Level-Design Space of Generative Adversarial Networks,'' Proceedings of the 2020 Genetic and Evolutionary Computation Conference (GECCO 2020), Association for Computing Machinery, New York, NY, USA, 148–156, DOI:https://doi.org/10.1145/3377930.3389821. (EI) [pdf]

  6. Han Zhang, Jialin Liu, Xin Yao, ``A Hybrid Evolutionary Algorithm for Reliable Facility Location Problem,'' Proceedings of the Sixteenth International Conference on Parallel Problem Solving from Nature (PPSN XVI), LNCS 12270, pp. 454–467, 2020. (EI) (Han Zhang was a 2nd year master's student) [pdf] or [pdf]

  7. Tianye Shu, Ziqi Wang, Jialin Liu, Xin Yao, ``A Novel CNet-assisted Evolutionary Level Repairer and Its Applications to Super Mario Bros,'' Proceedings of the 2020 IEEE Congress on Evolutionary Computation (CEC 2020), Glasgow, United Kingdom, 2020, pp. 1-10, doi: 10.1109/CEC48606.2020.9185538. IEEE. (EI) (Tianye Shu and Ziqi Wang were 3rd year UG students) [pdf]

  8. Qingquan Zhang, Feng Wu, Yang Tao, Jiyuan Pei, Jialin Liu, Xin Yao, ``D-MAENS2: A Self-adaptive D-MAENS Algorithm with Better Decision Diversity'', The 2020 IEEE Symposium Series on Computational Intelligence (SSCI 2020). (Accepted) (EI) (Qingquan Zhang was a 1st year master's student)

  9. Chenhao Li, Jiyuan Pei, Qingquan Zhang, Jialin Liu, Xin Yao, ``An Extendable Platform for Routing Problem: Optimisation, Evaluation and Solution Visualisation'', The 2020 IEEE Symposium Series on Computational Intelligence (SSCI 2020). (Accepted) (EI) (Chenhao Li and Jiyuan Pei were final year UG students)

  10. Diego Perez-Liebana, Jialin Liu (*), Ahmed Khalifa, Raluca D. Gaina, Julian Togelius, Simon M. Lucas, ``General Video Game AI: a Multi-Track Framework for Evaluating Agents, Games and Content Generation Algorithms,'' in IEEE Transactions on Games, vol. 11, no. 3, pp. 195-214, Sept. 2019. doi: 10.1109/TG.2019.2901021. [pdf] (SCI)

  11. Jialin Liu and Xin Yao, ``Self-adaptive Decomposition and Incremental Hyperparameter Tuning Across Multiple Problems,'' Proceedings of the 2019 IEEE Symposium Series on Computational Intelligence (SSCI 2019), Xiamen, China, 2019, pp. 1590-1597, doi: 10.1109/SSCI44817.2019.9002966. [pdf] (EI)

  12. Jialin Liu and Olivier Teytaud, ``A Simple Yet Effective Resampling Rule in Noisy Evolutionary Optimization,'' Proceedings of the 2019 IEEE Symposium Series on Computational Intelligence (SSCI 2019), Xiamen, China, 2019, pp. 689-696, doi: 10.1109/SSCI44817.2019.9003078. [pdf] (EI)

  13. Jialin Liu and Olivier Teytaud, ``Efficient Decision Making under Uncertainty in a Power System Investment Problem,'' Proceedings of the 2019 IEEE Symposium Series on Computational Intelligence (SSCI 2019), Xiamen, China, 2019, pp. 697-704, doi: 10.1109/SSCI44817.2019.9003075. [pdf] (EI)

  14. Hao Tong, Jialin Liu and Xin Yao, ``Algorithm Portfolio for Individual-based Surrogate-assisted Evolutionary Algorithms,'' Proceedings of 2019 Genetic and Evolutionary Computation Conference (GECCO 2019), Kyoto, pp. 943-950, ACM Press, doi: 10.1145/3321707.3321715. [pdf] (EI) (Hao Tong was a 2nd year master's student)

  15. Hao Tong, Changwu Huang, Jialin Liu and Xin Yao, ``Voronoi-based Efficient Surrogate-assisted Evolutionary Algorithm for Very Expensive Problems,'' Proceedings of the IEEE Congress on Evolutionary Computation (CEC 2019), Wellington, New Zealand, 2019, pp. 1996-2003, doi: 10.1109/CEC.2019.8789910. [pdf] (EI) (Hao Tong was a 2nd year master's student)

  16. Ivan Bravi, Simon M. Lucas, Diego Perez-Liebana and Jialin Liu, ``Rinascimento: Optimising Statistical Forward Planning Agents for Playing Splendor,'' Proceedings of the IEEE Conference on Games (CoG 2019), London, United Kingdom, 2019, pp. 1-8, doi: 10.1109/CIG.2019.8848028. [pdf] (EI)

  17. Simon M. Lucas, Jialin Liu, Ivan Bravi, Raluca D. Gaina, John Woodward, Vanessa Volz and Diego Perez-Liebana, ``Efficient Evolutionary Methods for Game Agent Optimisation: Model-Based is the Best,'' AAAI-2019 Workshop on Games and Simulations for Artificial Intelligence, 2019. [pdf]

  18. Chiara Sironi, Jialin Liu and Mark Winands, ``Self-Adaptive Monte-Carlo Tree Search in General Game Playing,'' in IEEE Transactions on Games, vol. 12, no. 2, pp. 132-144, June 2020, doi: 10.1109/TG.2018.2884768. [pdf] (SCI)

  19. Chang-Shing Lee, Mei-Hui Wang, Chi-Shiang Wang, Olivier Teytaud, Jialin Liu, Su-Wei Lin, Pi-Hsia Hung, ``PSO-Based Fuzzy Markup Language for Student Learning Performance Evaluation and Educational Application,'' in IEEE Transactions on Fuzzy Systems, vol. 26, no. 5, pp. 2618-2633, Oct. 2018. [pdf] (SCI)

  20. Vanessa Volz, Jacob Schrum, Jialin Liu, Simon M Lucas, Adam Smith, Sebastian Risi, ``Evolving Mario Levels in the Latent Space of a Deep Convolutional Generative Adversarial Network,'' Proceedings of 2018 Annual Conference on Genetic and Evolutionary Computation (GECCO 2018), Kyoto, pp. 221–228, ACM Press. [pdf] (EI) (Best Paper Award of DETA+THEORY+GECH tracks)

  21. Ruben Rodriguez Torrado, Philip Bontrager, Julian Togelius, Jialin Liu and Diego Perez Liebana, ``Deep reinforcement learning for General Video Game AI,'' Proceedings of the IEEE Computational Intelligence and Games Conference (CIG 2018), Maastricht, 2018, pp. 1-8. [pdf] (EI)

  22. Ivan Bravi, Diego Perez, Simon Lucas and Jialin Liu, ``Shallow decision-making analysis in General Video Game Playing,'' Proceedings of the IEEE Computational Intelligence and Games Conference (CIG 2018), Maastricht, 2018, pp. 1-8. [pdf] (EI)

  23. Chiara F. Sironi, Jialin Liu, Diego Perez-Liebana, Raluca D. Gaina, Ivan Bravi, Simon M. Lucas, Mark H.M. Winands, ``Self-Adaptive MCTS for General Video Game Playing,'' Applications of Evolutionary Computation (EvoApplications 2018), Lecture Notes in Computer Science, vol 10784. Springer, Cham. [pdf] (EI)

  24. Simon M. Lucas, Jialin Liu, Diego Perez-Liebana, ``The N-tuple Bandit Evolutionary Algorithm for Game Agent Optimisation,'' Proceedings of the IEEE Congress on Evolutionary Computation (CEC'18), Rio de Janeiro, 2018, pp. 1-9. [pdf] (EI) (shortlisted for Best Paper Award from 347 accepted papers)

  25. Marie-Liesse Cauwet, Jeremie Decock, Jialin Liu, Olivier Teytaud, ``Direct Model Predictive Control: A Theoretical and Numerical Analysis,'' Proceedings of the 20th Power Systems Computation Conference (PSCC 2018), Dublin, 2018, pp. 1-7. [pdf] (EI)

  26. Philipp Rohlfshagen, Jialin Liu, Diego Perez-Liebana and Simon M. Lucas, ``Pac-Man Conquers Academia: Two Decades of Research Using a Classic Arcade Game,'' in IEEE Transactions on Games, vol. 10, no. 3, pp. 233-256, Sept. 2018. [pdf] (SCI)

  27. Raluca D. Gaina, Adrien Couëtoux, Dennis JNJ Soemers, Mark HM Winands, Tom Vodopivec, Florian Kirchgeßner, Jialin Liu, Simon M. Lucas, and Diego Perez-Liebana, ``The 2016 Two-Player GVGAI Competition,'' in IEEE Transactions on Games, vol. 10, no. 2, pp. 209-220, June 2018. [pdf] (SCI)

  28. Jialin Liu, Julian Togelius, Diego Perez-Liebana and Simon M. Lucas, ``Evolving Game Skill-Depth using General Video Game AI Agents,'' Proceedings of the IEEE Congress on Evolutionary Computation (CEC'17), San Sebastian, 2017, pp. 2299-2307. [pdf] (EI)

  29. Jialin Liu, Diego Perez-Liebana and Simon M. Lucas, ``Bandit-Based Random Mutation Hill-Climbing,'' Proceedings of the IEEE Congress on Evolutionary Computation (CEC'17), San Sebastian, 2017, pp. 2145-2151. [pdf] (EI)

  30. Kamolwan Kunanusont, Raluca D. Gaina, Jialin Liu, Diego Perez-Liebana and Simon M. Lucas, ``The N-Tuple Bandit Evolutionary Algorithm for Automatic Game Improvement,'' Proceedings of the IEEE Congress on Evolutionary Computation (CEC'17), San Sebastian, 2017, pp. 2201-2208. [pdf] (EI)

  31. Raluca D. Gaina, Jialin Liu, Simon M. Lucas, Diego Perez-Liebana, ``Analysis of Vanilla Rolling Horizon Evolution Parameters in General Video Game Playing,'' Proceedings of Applications of Evolutionary Computation (EvoApplications 2017), Lecture Notes in Computer Science, vol 10199. Springer, Cham. [pdf] (EI)

  32. Simon M. Lucas, Jialin Liu and Diego Perez-Liebana, ``Efficient Noisy Optimisation with the Multi-sample and Sliding Window Compact Genetic Algorithms,'' 2017 IEEE Symposium Series on Computational Intelligence (SSCI), Honolulu, 2017, pp. 1-8. [pdf] (EI)

  33. Marie-Liesse Cauwet, Jialin Liu (*), Baptiste Rozière, Olivier Teytaud, ``Algorithm Portfolios for Noisy Optimization,'' Annals of Mathematics and Artificial Intelligence (AMAI), vol. 76, no 1-2, p. 143-172. [pdf] (SCI) (♦)

  34. Sandra Astete-Morales, Marie-Liesse Cauwet, Jialin Liu, Olivier Teytaud, ``Simple and Cumulative Regret for Continuous Noisy Optimization,'' Theoretical Computer Science (TCS), vol. 617, p. 12-27. [pdf] (SCI) (♦)

  35. Jialin Liu, Oliver Teytaud, Tristan Cazenave, ``Fast Seed-Learning Algorithms for Games,'' Proceedings of the 9th International Conference on Computers and Games (CG 2016), Lecture Notes in Computer Science, vol 10068. Springer, Cham. [pdf] (EI)

  36. Tristan Cazenave, Jialin Liu, Fabien Teytaud, Olivier Teytaud, ``Learning Opening Books in Partially Observable Games: Using Random Seeds in Phantom Go,'' Proceedings of the IEEE Conference on Computational Intelligence and Games (CIG 2016), Santorini, 2016, pp. 1-7. [pdf] (EI) (♦)

  37. Jialin Liu, Diego Pérez-Liébana and Simon M. Lucas, ``Rolling Horizon Coevolutionary Planning for Two-Player Video Games,'' Proceedings of the 8th Computer Science and Electronic Engineering (CEEC 2016), Colchester, 2016, pp. 174-179. [pdf] (EI)

  38. Jérémie Decock, Jialin Liu and Olivier Teytaud, ``Variance Reduction in Population-Based Optimization: Application to Unit Commitment,'' Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation (GECCO 2015), Madrid, pp. 61–62, ACM Press. [pdf] (EI) (♦)

  39. Tristan Cazenave, Jialin Liu, Olivier Teytaud, ``The Rectangular Seeds of Domineering,'' 2015 IEEE Computational Intelligence and Games Conference (CIG 2015), Tainan, 2015, pp. 530-531. [pdf] (EI) (♦)

  40. Mei-Hui Wang, Chi-Shiang Wang, Chang-Shing Lee, Olivier Teytaud, Jialin Liu, Su-Wei Lin and Pi-Hsia Hung, ``Item Response Theory with Fuzzy Markup Language for Parameter Estimation and Validation,'' Proceedings of IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2015), Istanbul, 2015, pp. 1-7. (EI)

  41. Shih-Yuan Chiu, Ching-Nung Lin, Jialin Liu, Tsan-Cheng Su, Fabian Teytaud, Olivier Teytaud and Shi-Jim Yen, ``Differential Evolution for Strongly Noisy Optimization: Use 1.01^n Resamplings at Iteration n and Reach the −1 Slope,'' Proceedings of IEEE Congress on Evolutionary Computation (CEC'15), Sendai, 2015, pp. 338-345. [pdf] (EI) (♦)

  42. David L. St-Pierre, Jialin Liu and Olivier Teytaud, ``Nash Reweighting of Monte Carlo Simulations: Tsumego,'' Proceedings of IEEE Congress on Evolutionary Computation (CEC'15), Sendai, 2015, pp. 1458-1465. [pdf] and [slides] (EI)

  43. Jean-Joseph Christophe, Jérémie Decock, Jialin Liu and Olivier Teytaud, ``Variance Reduction in Population-Based Optimization: Application to Unit Commitment,'' Proceedings of Biennial International Conference on Artificial Evolution (EA 2015), Lecture Notes in Computer Science, vol 9554. Springer, Cham. [pdf] (EI) (♦)

  44. Cheng-Wei Chou, Ping-Chiang Chou, Jean-Joseph Christophe, Adrien Couetoux, Pierre De Freminville, Nicolas Galichet, Chang-Shing Lee, Jialin Liu, David Lupien Saint-Pierre, Michele Sebag, Olivier Teytaud, Mei-Hui Wang, Li-Wen Wu and Shi-Jim Yen, ``Strategic Choices in Optimization,'' Journal of Computing and Information Science in Engineering (JCISE), vol. 30, no 3, p. 727-747, 2014. [pdf] (SCI) (♦)

  45. Jialin Liu, David L. St- Pierre and Olivier Teytaud, ``A Mathematically Derived Number of Resamplings for Noisy Optimization,'' Proceedings of the 16th Annual Conference on Genetic and Evolutionary Computation (GECCO 2014), Vancouver, pp. 61–62, ACM Press. [pdf] (EI)

  46. Jialin Liu and Olivier Teytaud, ``Meta Online Learning: Experiments on a Unit Commitment Problem,'' Proceedings of European Symposium on Artificial Neural Networks (ESANN 2014), Computational Intelligence and Machine Learning, Bruges (Belgium), 23-25 April 2014. [pdf] or [pdf] (EI)

  47. David Auger, Jialin Liu, Sylvie Ruette, David L. St-Pierre and Olivier Teytaud, ``Sparse Binary Zero-sum Games,'' Proceedings of the Sixth Asian Conference on Machine Learning (ACML 2014), PMLR 39:173-188, 2015. [pdf] (EI) (♦)

  48. Marie-Liesse Cauwet, Jialin Liu and Olivier Teytaud, ``Algorithm Portfolios for Noisy Optimization: Compare Solvers Early,'' Proceedings of the International Conference on Learning and Intelligent Optimization (LION 2014), Lecture Notes in Computer Science, vol 8426. Springer, Cham. [pdf] (EI) (♦)

  49. David L. St-Pierre and Jialin Liu, ``Differential Evolution Algorithm Applied to Non-stationary Bandit Problem,'' Proceedings of IEEE Congress on Evolutionary Computation (CEC'14), Beijing, China, pp. 2397-2403, IEEE. [pdf] (EI)

  50. Sandra Astete-Morales, Jialin Liu and Olivier Teytaud, ``Noisy Optimization Convergence Rates,'' Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation (GECCO 2013), Amsterdam, The Netherlands, pp. 223–224, ACM Press. [pdf] (EI) (♦)

  51. Sandra Astete-Morales, Jialin Liu and Olivier Teytaud, ``Log-log Convergence for Noisy Optimization,'' Proceedings of Biennial International Conference on Artificial Evolution (EA 2013). Lecture Notes in Computer Science, vol 8752. Springer, Cham. [pdf] (EI) (♦)

Technical Reports and Book

  1. [Book] Diego Perez-Liebana, Simon M. Lucas, Raluca D. Gaina, Julian Togelius, Ahmed Khalifa and Jialin Liu, ``General Video Game Artificial Intelligence,'' Morgan and Claypool, 2020. [pdf]

  2. Jialin Liu, Tom Schaul, Pieter Spronck and Julian Togelius, ``Artificial and Computational Intelligence in Games: Revolutions in Computational Game AI (Dagstuhl Seminar 19511)'', Dagstuhl Reports, Volume 9, Issue 12. [Full report]
  3. Vanessa Volz, Dan Ashlock, Simon Colton, Steve Dahlskog, Jialin Liu, Simon M. Lucas, Diego Perez Liebana and Tommy Thompson, ``4.18 Gameplay Evaluation Measures,'' Report of Dagstuhl Seminar Artificial and Computational Intelligence in Games: AI-Driven Game Design, Volume 7, Issue 11, pp. 105-107, 2018. [Full report]

  4. Dan Ashlock, Cameron Browne, Simon Colton, Amy K Hoover, Jialin Liu, Simon M Lucas, Mark J Nelson, Diego Perez Liebana, Sebastian Risi, Jacob Schrum, Adam M Smith, Julian Togelius and Vanessa Volz, ``4.1 Game Search Space Design and Representation,'' Report of Dagstuhl Seminar Artificial and Computational Intelligence in Games: AI-Driven Game Design, Volume 7, Issue 11, pp. 93-95, 2018. [Full report]

  5. David L. St-Pierre, Jean-Baptiste Hoock, Jialin Liu, Fabien Teytaud and Olivier Teytaud, ``Automatically Reinforcing a Game AI,'' Arxiv (2016). [pdf]

Students

PhD student

  • Ivan Bravi (3rd year, Queen Mary University of London, UK), co-supervised with Prof. Simon M. Lucas and Dr. Diego Perez-Liebana

Master student

  • Yang Tao (started in Sept. 2019)
  • Jiyuan Pei (started in Aug. 2020)

Undergraduate students

  • Tianye Shu (4th year, intern at Tencent in 2020)
  • Ziqi Wang (4th year, intern at Huawei in 2020)
  • Chengpeng Hu (4th year, intern at UBTECH in 2020)
  • Yu Zhao (4th year, intern at Tencent in 2020; intern at Wiqun in 2019)
  • Jiyuan Pei (graduated in 2020, currently a master student at SUSTech)
  • Wenxing Lan (graduated in 2020, currently a master student at SUSTech)
  • Ziyuan Ye (graduated in 2020, currently a master student at SUSTech)
  • Haozhi Dong (graduated in 2020, currently a master student at Shenzhen University)
  • Chenhao Li (graduated in 2020, currently at Huawei)
  • Peijun Ruan (graduated in 2020, currently at Shopee)