Job Properties
  • Job Type
    Full-time Position
  • Category
    Research & Science
  • Languages
  • Experience Required
  • Degree Required
    • Province
    • Date Posted
      January 11,2022
    • Entrusting Package
    • JSS
    • VISA
    • IMG_6430
    • Career Consultation

    PhD Position Online 3D Scene Representation Learning

    PhD Position Online 3D Scene Representation Learning

    Faculteit/Dienst: Faculteit der Natuurw., Wiskunde & Informatica
    Opleidingsniveau: Master
    Functie type: Promotieplaats
    Sluitingsdatum: 15 February 2022
    Vacaturenummer: 8018
    Are you excited about creating a digital twin of the 3D world around you? The next generation of autonomous cars, robots or mixed reality devices will require an efficient and scalable learned 3D representation of the scene which can jointly serve a multitude of downstream tasks.

    Desirable goals and possible research directions are:
    • learned online scene updates from input data streams, collaborative/crowd-based updating (sequence to vector learning) of a scene representation;
    • rich multi-modal scene representations (geometry, texture, material, semantics, object relations, usage information, etc.);
    • self-supervised/weakly supervised learning with input data reproduction via differentiable rendering techniques;
    • efficient data structures for learned scene encodings;
    • multi-sensor data fusion.

    Autonomous agents need to process large amounts of data and keep previously seen information in memory in an efficient and compressed manner. For example projects which perform some first steps check out the references down below [1-6].

    This fully-funded PhD position is within the Computer Vision Lab at the informatics institute of UvA and ATLAS lab - a collaboration between UvA and TomTom. The goal of ATLAS lab is the development new machine learning-based algorithms for high definition map creation for self-driving vehicles. The ATLAS lab is also part of the Innovation Center for Artificial Intelligence (ICAI) such that there are plenty of possibilities to network and benefit from the participation of related events.

    What are you going to do?

    • Design and implement novel algorithms/data structures for learned 3D scene representations.
    • You will work at the intersection of 3D computer vision, (inverse) graphics, machine learning, and optimization to develop next generation mapping and scene understanding algorithms.
    • Collaborate with other researchers within the lab and TomTom.
    • Pursue and complete a PhD thesis within the appointed duration of four years.
    • Present research results at international conferences and journals.
    • Assist in teaching activities such as lab assistance and student supervision.

    What do we require of you?

    • A Master’s degree in Artificial Intelligence, Computer Science, Mathematics, or a closely related field.
    • A strong scientific and mathematical background in deep learning and computer vision.
    • An interest, passion, self-motivation and excitement in developing new algorithms for large-scale scene understanding.
    • Good programming skills, experience with C++/Python and deep learning frameworks (PyTorch/Tesnorflow/JAX).
    • A good academic record and eagerness to tackle core scientific problems.
    • Fluent in English, both written and spoken.

    Our offer

    A temporary contract for 38 hours per week for the duration of four years (the initial contract will be for a period of 18 months and after satisfactory evaluation it will be extended for a total duration of four years). This should lead to a dissertation (PhD thesis). We will draft an educational plan that includes attendance of courses and (international) meetings. We also expect you to assist in teaching undergraduates and Master students.

    The salary, depending on relevant experience before the beginning of the employment contract, will be €2,443 to €3,122 (scale P) gross per month, based on a fulltime contract (38 hours a week). This is exclusive 8% holiday allowance and 8.3% end-of-year bonus. A favourable tax agreement, the ‘30% ruling’, may apply to non-Dutch applicants. The Collective Labour Agreement of Dutch Universities (CAO NU) is applicable.

    Are you curious about our extensive package of secondary employment benefits like our excellent opportunities for study and development? Take a look here.


    Do you have questions about this vacancy? Or do you want to know more about our organization? Please contact:

    • Dr. Martin R. Oswald, Assistant Professor

    About us

    The Faculty of Science has a student body of around 7,000, as well as 1,600 members of staff working in education, research or support services. Researchers and students at the Faculty of Science are fascinated by every aspect of how the world works, be it elementary particles, the birth of the universe or the functioning of the brain.

    The mission of the Informatics Institute is to perform curiosity-driven and use-inspired fundamental research in Computer Science. The main research themes are Artificial Intelligence, Computational Science and Systems and Network Engineering. Our research involves complex information systems at large, with a focus on collaborative, data driven, computational and intelligent systems, all with a strong interactive component.

    Job application

    The Informatics Institute strives for a better gender balance in its staff. We therefore strongly encourage women to apply for this position.

    Do you recognize yourself in the job profile? Then we look forward to receiving your application by 15 February 2022. You can apply online by using the link below.

    Applications in pdf format should include:
    • a motivation letter and CV, including a list of publications;
    • a CV, including a list of publications if applicable;
    • a link to your Master’s thesis;
    • a complete record of your Bachelor and Master courses, including grades and explanation of grading system;
    • the names and mail addresses of two academic references (no reference letters required, but can be added if available).

    Please mention the months (not just years) in your CV when referring to your education and work experience.

    We will invite potential candidates for interviews within two weeks after the closing date.

    [1] NeuralFusion: Online Depth Fusion in Latent Space,
    Silvan Weder, Johannes L. Schönberger, Marc Pollefeys, and Martin R. Oswald.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
    [2] DeepSurfels: Learning Online Appearance Fusion,
    Marko Mihajlovic, Silvan Weder, Marc Pollefeys, and Martin R. Oswald.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
    [3] NVS-MonoDepth: Improving Monocular Depth Prediction with Novel View Synthesis,
    Zuria Bauer, Zuoyue Li, Sergio Orts-Escolano, Miguel Cazorla, Marc Pollefeys, and Martin R. Oswald. International Conference on 3D Vision (3DV), 2021
    [4] Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects,
    Denys Rozumnyi, Martin R. Oswald, Vittorio Ferrari, and Marc Pollefeys. NeurIPS, 2021
    [5] RoutedFusion: Learned Real-time Depth Map Fusion,
    Silvan Weder, Johannes L. Schönberger, Marc Pollefeys, and Martin R. Oswald.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020
    [6] KAPLAN: A 3D Point Descriptor for Shape Completion,
    Audrey Richard, Ian Cherabier, Martin R. Oswald, Marc Pollefeys, and Konrad Schindler.
    International Conference on 3D Vision (3DV), 2020

    The UvA is an equal-opportunity employer. We prioritize diversity and are committed to creating an inclusive environment for everyone. We value a spirit of enquiry and perseverance, provide the space to keep asking questions, and promote a culture of curiosity and creativity.

    Open Positions from Universiteit van Amsterdam
    Related positions