vision through tasks: from the Bongard problems to sandwich making

Constantin A. Rothkopf, Technical University Darmstadt and FIAS

Constantin Rothkopf’s research interests revolve around the distinction between ‘looking’ and ‘seeing’ and how this distinction relates to vision in goal directed behavior. The aim is to better understand the interrelationship between perception and action in humans, i.e. how we use our perceptual systems actively during natural extended behavior to guide decisions and actions with our bodies. This leads to the study of how we use sensory input, specifically vision, form beliefs about the world by carrying out computations on the basis of our cognitive representations, and then employ decision making processes to act in goal directed behavior. To achieve this goal he uses experimental studies in humans as well as computational modeling involving methods from statistical and machine learning. His current focus is on:

  • behavioral studies involving eye tracking of human eye movements during complex naturalistic tasks in natural and virtual environments,
  • building models of tasks and developing algorithms that learn how to solve these tasks in virtual agents,
  • developing models for the representation and quantification of extended sequential human behavior,
  • simulation of learning algorithms in naturalistic virtual environments,
  • developing learning algorithms with an emphasis on the learning of sensory representations for actions.