Research Scientist, AR/VR Input, Human Body Sensing (PhD University Grad)

Facebook | Redmond, WA

Posted Date 12/19/2018
Description At Facebook Reality Labs, our goal is to invent the user input and interface technologies that will drive the next generation of virtual, augmented, and mixed reality experiences. We are looking for a talented Research Scientist with expertise and passion for building advanced sensing systems aimed at solving complex AR/VR input and interaction problems. As a Research Scientist in the Computational Interaction group at Facebook Reality Labs in Redmond WA, you would focus on developing novel wearable sensing solutions for real-time tracking of hand and body movements and actions as well as incorporate contextual, environment, and biological signals to enable rich and expressive body interactions. Our research involves both fundamental research on novel input devices and interaction techniques, as well as evaluations of how specific engineering choices impact the user experience. Researchers are expected to have a strong computational background as well to publish in peer-reviewed conferences and journals. Projects take advantage of internal resources in mechanical, electrical, optical, and software engineering, allowing us to confront scientific questions which cannot be addressed with existing equipment.


  • Plan and execute cutting-edge research agenda to advance novel sensing and sensor fusion solutions for more expressive body interactions

  • Initiate and lead research projects focusing on design and implementation of software and hardware solutions for advanced input sensing systems

  • Collaborate with researchers, engineers, and designers across disciplines (HCI, UX, ML, EE, ME) to solve complex problems and evaluate the effectiveness of developed solutions through user evaluations

  • Interact with peer research and product groups to incorporate scientific advances into larger cross-group efforts

  • Publish and present papers at international conferences and journals, attend top conferences in human-computer interaction, ubiquitous computing, and related fields

  • Mentor and supervise PhD interns


  • Currently has or is in the process of obtaining a PhD degree or completing a postdoctoral assignment in computer science, human-computer interaction, electrical engineering, or related field

  • Demonstrated experience with real-time signal processing and sensor fusion for interactive applications

  • Demonstrated experience of HCI fundamentals

  • Demonstrated track record in design and evaluation of interaction techniques and/or input devices

  • Demonstrated experience in computational research

  • 3+ years of experience in C++/C# or Python

  • Interpersonal experience: cross-group and cross-culture collaboration

  • Must be available to start employment on or after January 1st, 2019

  • Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment


  • Demonstrated ability of applying machine learning models to the real-time sensing problems

  • Demonstrated experience with machine learning frameworks (Caffe, Torch, TensorFlow, or similar)

  • Embedded systems design skills and EE fundamentals

  • Demonstrated experience with 3D graphics software and development (including Unreal or Unity game engines)

  • Proven track record of achieving results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as UIST, SIGCHI, IMWUT, SIGGRAPH, ISMAR, etc.

  • Strong interpersonal and presentation skills: cross-team and cross-cultural collaborations

Share this job


This job board is currently inactive.

Please contact us if you have any questions.