sample of publications

• articles 

  • A gamified social robotics platform for intensive therapies in neurorehabilitation.  Intelligent Service Robotics.  17:419-443. 2024
  • Clustering-based attack detection for adversarial reinforcement learning.  APPLIED INTELLIGENCE.  54:2631-2647. 2024
  • Automated market maker inventory management with deep reinforcement learning.  APPLIED INTELLIGENCE.  53. 2023
  • DISCRETE UNCERTAINTY QUANTIFICATION FOR OFFLINE REINFORCEMENT LEARNING.  Journal of Artificial Intelligence and Soft Computing Research.  13. 2023
  • A taxonomy for similarity metrics between Markov decision processes.  MACHINE LEARNING.  111:4217-4247. 2022
  • Extending the Evaluation of Social Assistive Robots with Accessibility Indicators: The AUSUS Evaluation Framework.  IEEE Transactions on Human-Machine Systems.  51:601-612. 2021
  • An Automated Planning Model for HRI: Use Cases on Social Assistive Robotics.  SENSORS.  20:6523. 2020
  • Learning adversarial attack policies through multi-objective reinforcement learning.  ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE.  96:1-11. 2020
  • A Socially Assistive Robotic Platform for Upper-Limb Rehabilitation: A Longitudinal Study with Pediatric Patients.  IEEE ROBOTICS & AUTOMATION MAGAZINE.  26:24-39. 2019
  • Reinforcement learning for pricing strategy optimization in the insurance industry.  ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE.  80:8-19. 2019
  • Probabilistic policy reuse for safe reinforcement learning.  ACM Transactions on Autonomous and Adaptive Systems.  13. 2019
  • Developing a robot-guided interactive simon game for physical and cognitive training.  International Journal of Humanoid Robotics.  16. 2019
  • Perceptions or Actions? Grounding How Agents Interact Within a Software Architecture for Cognitive Robotics.  Cognitive Computation.  12:479-497. 2019
  • On-line case-based policy learning for automated planning in probabilistic environments.  INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING.  17:763-800. 2018
  • Modeling, Evaluation, and Scale on Artificial Pedestrians: A Literature Review.  ACM COMPUTING SURVEYS.  50. 2017
  • A three-layer planning architecture for the autonomous control of rehabilitation therapies based on social robots.  Cognitive Systems Research.  43:232-249. 2017
  • Evaluating the Child-Robot Interaction of the NAOTherapist Platform in Pediatric Rehabilitation.  International Journal of Social Robotics.  9:343-358. 2017
  • Emergent behaviors and scalability for multi-agent reinforcement learning-based pedestrian models.  SIMULATION MODELLING PRACTICE AND THEORY.  74:117-133. 2017
  • Planning and execution through variable resolution planning.  ROBOTICS AND AUTONOMOUS SYSTEMS.  83:214-230. 2016
  • The IBaCoP Planning System: Instance-Based Configured Portfolios.  JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH.  56:657-691. 2016
  • A Comprehensive Survey on Safe Reinforcement Learning.  JOURNAL OF MACHINE LEARNING RESEARCH.  16:1437-1480. 2015
  • Asistente Robótico Social Interactivo para Terapias de Rehabilitación Motriz con Pacientes de Pediatría = Socially Interactive Robot for Motor Rehabilitation Therapies with Paediatric Patients.  Revista Iberoamericana de Automatica e Informatica Industrial.  12:99-110. 2015
  • Strategies for simulating pedestrian navigation with multiple reinforcement learning agents.  AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS.  29:98-130. 2015
  • MARL-Ped: A multi-agent reinforcement learning based framework to simulate pedestrian groups.  SIMULATION MODELLING PRACTICE AND THEORY.  47:259-275. 2014
  • Teaching human poses interactively to a social robot.  SENSORS.  13:12406-12430. 2013
  • Using automated planning for improving data mining processes.  KNOWLEDGE ENGINEERING REVIEW.  28:157-173. 2013
  • Integrating Planning, Execution, and Learning to Improve Plan Execution.  COMPUTATIONAL INTELLIGENCE.  29:1-36. 2013
  • A Meta-tool to Support the Development of Knowledge Engineering Methodologies and Projects.  INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING.  22:1055-1083. 2012
  • A review of machine learning for automated planning.  KNOWLEDGE ENGINEERING REVIEW.  27:433-467. 2012
  • Safe Exploration of State and Action Spaces in Reinforcement Learning.  JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH.  45:515-564. 2012
  • Reinforcement learning for decision-making in a business simulator.  INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING.  11:935-960. 2012
  • A Prototype-Based Method for Classification with Time Constraints: A Case Study on Automated Planning.  PATTERN ANALYSIS AND APPLICATIONS.  15:261-277. 2012
  • Control of Autonomous Mobile Robots with Automated Planning.  Journal of Physical Agents.  5:3-13. 2011
  • Probabilistic Policy Reuse for Inter-Task Transfer Learning.  ROBOTICS AND AUTONOMOUS SYSTEMS.  58:866-871. 2010
  • SIMBA: A Simulator for Business Education and Research.  DECISION SUPPORT SYSTEMS.  48:498-506. 2010
  • Learning Teaching Strategies in an Adaptive and Intelligent Educational System through Reinforcement Learning.  APPLIED INTELLIGENCE.  31:89-106. 2009
  • Reinforcement Learning of Pedagogical Policies in Adaptive and Intelligent Educational Systems.  KNOWLEDGE-BASED SYSTEMS.  22:266-270. 2009
  • Nearest Prototype Classification of Noisy Data.  ARTIFICIAL INTELLIGENCE REVIEW.  30:53-66. 2009
  • Two Steps Reinforcement Learning.  INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS.  23:213-245. 2008
  • Local Feature Weighting in Nearest Prototype Classification.  IEEE Transactions on Neural Networks and Learning Systems.  19:40-53. 2008

• book chapters 

  • Business Simulators for Business Education and Research: SIMBA Experience. In: Computer Games as Educational and Management Tools: Uses and Approaches.  IGI GLOBAL. 229-246. 2011
  • A Comparative Study of Discretization Approaches for State Space Generalization in the Keepaway Soccer Task. In: Progress in Education. Volume 21.  NOVA PUBLISHERS. 161-190. 2010

• books 

  • SIMBA: Simulador de Gestión Empresarial [software].  Simuladores Empresariales S.L.. 2012

• conference contributions 

  • A Planning Approach to Repair Domains with Incomplete Action Effects.  153-161. 2023
  • Deep Q-learning market makers in a multi-agent simulated stock market.  1-9. 2021
  • Probabilistic multi-knowledge transfer in reinforcement learning.  471-476. 2021
  • Multi-layered multi-robot control architecture for the robocup logistics league.  120-125. 2020
  • Challenges on the application of automated planning for comprehensive geriatric assessment using an autonomous social robot.  179-194. 2019
  • CLARC: A cognitive robot for helping geriatric doctors in real scenarios.  403-414. 2018
  • Enhancing a robotic rehabilitation model for hand-arm bimanual intensive therapy.  379-390. 2018
  • From high to low level and vice-versa: a new language for the translation between abstraction levels in robot control architectures 2018
  • LifeBots I: Building the software infrastructure for supporting lifelong technologies.  391-402. 2018
  • Task monitoring and rescheduling for opportunity and failure management.  24-31. 2018
  • Task
    Monitoring and Rescheduling for Opportunity and Failure Management.  24. 2018
  • Towards a robust robotic assistant for Comprehensive Geriatric Assessment procedures: updating the CLARC system.  820-825. 2018
  • On the application of classical planning to real social robotic tasks.  38-47. 2017
  • Performance modelling of planners from homogeneous problem sets.  425-433. 2017
  • CLARC: a robotic architecture for comprehensive geriatric assessment.  1-8. 2016
  • NAOTherapist: autonomous assistance of physical rehabilitation therapies with a social humanoid robot.  15-16. 2016
  • Percepts symbols or Action symbols? Generalizing how all modules interact within a software architecture for cognitive robotics.  9-16. 2016
  • Playing with Robots: An Interactive Simon Game.  1085-1095. 2015
  • Therapy Monitoring and Patient Evaluation with Social Robots.  152-155. 2015
  • A General-Purpose Architecture to Control Mobile Robots.  105-116. 2014
  • Goal-directed Generation of Exercise Sets for Upper-Limb Rehabilitation.  38-45. 2014
  • Selective Abstraction in Automated Planning.  133-147. 2014
  • From perception to action and vice versa: A new architecture showing how perception and action can modulate each other simultaneously.  268-273. 2013
  • THERAPIST: Towards an Autonomous Socially Interactive Robot for Motor and Neurorehabilitation Therapies for Children.  374-377. 2013
  • A Kinodynamic Planning-Learning Algorithm for Complex Robot Motor Control.  80-83. 2012
  • Calibrating a Motion Model Based on Reinforcement Learning for Pedestrian Simulation.  302-303. 2012
  • Mining IPC-2011 Results 2012
  • Multi-Agent Reinforcement Learning for Simulating Pedestrian Navigation.  54-69. 2012
  • Variable resolution planning through predicate relaxation 2012
  • A Similarity Function with Local Feature Weighting for Structured Data 2011
  • Autonomous Mobile Robot Control and Learning with the PELEA Architecture.  51-56. 2011
  • Learning and Transferring Relational Instance-Based Policies 2008
  • Prototypes Based Relational Learning 2008
  • The PELA Architecture: Integrating Planning and Learning to Improve Execution 2008