We offer a position as an
Early Stage Researcher (M/F/D)
in the Marie Skłodowska-Curie Innovative Training Network Project MENELAOSNT in the field
Design of an AIC CMOS vision system for spatio-temporal event detection (ESR2)
Machine learning and, in particular deep learning techniques constitute a unique framework for analog to information (AIC) compression. Nevertheless, the feasibility of a hardware implementation of such power and memory-hungry algorithms calls for new strategies that benefit from the low power features of analog and mixed-signal design techniques. The final goal of this work will be the design of a low Size, Weight and Power (SWaP) AIC CMOS vision system for spatio-temporal event detection through deep learning tracking techniques. The system will comprise a CMOS vision chip with focal-plane processing and a general-purpose embedded hardware such as an FPGA. The CMOS vision chip will acquire the video and provide the detections that trigger the tracking. The baseline of our tracking approach will be state-of-the-art neural networks that learn similarity functions. Compressive deep learning techniques like binary weighting, weight sharing and pruning will be required to fit such networks on the FPGA.
The successful candidate will be employed for a maximum period of three years full-time equivalent and receives a generous financial package plus an additional mobility and family allowance according to the rules for Early Stage Researchers (ESRs) in an EU Marie Sklodowska-Curie Actions Innovative Training Networks (ITN). A career development plan will be prepared for each fellow in accordance with his/her supervisor and will include training, planned secondments and outreach activities in partner institutions of the network. The ESR fellows are supposed to complete their PhD thesis by the end of the 3rd year of their employment. For more information please visit the Marie Sklodowska-Curie Actions Innovative Training Networks website.
- Definition of tasks of interest for ex- and in-situ explorations by the consortium.
- Evaluation of different algorithms for spatial localization of foreground events by the CMOS vision sensor chip through different software frameworks like OpenCV or Caffe.
- Design of the CMOS vision sensor chip.
- Hardware-oriented state-of-the-art siamese neural network for tracking through deep learning compression techniques like binary weighting, pruning, etc.
- FPGA implementation of a hardware-oriented siamese neural network.
- On-board evaluation of the final AIC CMOS vision system for spatio-temporal event detection.
- Master of Science in Electrical Engineering, Electronics Technology, Electrical Engineering Technology, Electrical and Computer Engineering, Physics, Industrial Engineering, Information Technologies or related fields
- ESRs must demonstrate that their ability to understand and express themselves in both written and spoken English is sufficiently high for them to derive the full benefit from the network training. Non-native English speakers are required to provide evidence of English language competency. (TOEFL … )
- enthusiasm, creativity, team-work capacity, hard-working capability, resilience
- INSITU, Santiago de Compostela, Spain, Prof. Dr. P. Arias Sánchez, 6 months, testing of the fabricated devices on mobile platforms.
It is desirable for the applicants to have some basic knowledge on:
- Analog and digital CMOS circuit design with modern CAD tools like Cadence or similar frameworks
- Solid-state semiconductor devices and simulation frameworks (ATLAS, Sentaurus,…)
- Programming languages; C, C++, Python and Matlab
The following scientific publications by members of the USC team provide a more clear insight on the topic of this PhD:
- B. Blanco-Filgueira et al., “Deep Learning-Based Multiple Object Visual Tracking on Embedded System for IoT and Mobile Edge Computing Applications”, IEEE Internet of Things Journal, vol. 6, no. 3, pp. 5423-5431, 2019
- D. Gacía-Lesta et al., “In-pixel Analog Memories for a Pixel-Based Background Subtraction Algorithm on CMOS Vision Sensors”, International Journal of Circuit Theory and Applications, vol. 46, no. 9, pp. 1631-1647, Sept. 2018
- M. Suárez et al., “Low-Power CMOS Vision Sensor for Gaussian Pyramid Extraction”, IEEE International Journal of Solid-State Circuit, vol. 52, no. 2, pp. 483-495, 2017
For further information, please visit: https://citius.usc.es/equipo/persoal-adscrito/paula-lopez-martinez
With more than five centuries of tradition, the University of Santiago de Compostela is a historic institution that projects itself to the future and beyond its frontiers, always attentive to the different demands of society, where it stands as an important academic frame of reference and where it develops its academic and research work. Centuries of history give the University an special capacity to merge the experience, security and confidence with present and future challenges.
In the last decades, the universities of Coruña and Vigo already segregated, the USc student population numbers over 45.000. Nowadays, the University is organized into two Campuses, Santiago and Lugo, which include 30 centres, nearly 80 departments and more than 60 degrees, apart from numerous installations such as research institutes, halls of residence, sports and cultural facilities, libraries, etc. Definitively, with the security and confidence of 500 years of experience, the University of Santiago de Compostela looks towards the future without forgetting its past, promoting new initiatives and putting its knowledge and leadership in the service of the demands of our society.
The position will be located at
University of Santiago de Compostela (USC)
Praza do Obradoiro
15782 Santiago de Compostela, Spain
Supervisor: Prof. Dr. Paula López Martínez
Planned Recruitment date: 1st September 2020.
Eligibility Criteria and Mobility Rule
ESRs must, at the date of recruitment, be in the first four years (full-time equivalent research experience) of their research careers and have not been awarded a doctoral degree. Full-Time Equivalent Research Experience is measured from the date when the researcher obtained the first degree entitling him/her to embark on a doctorate (either in the country in which the degree was obtained or in the country in which the researcher is recruited), even if a doctorate was never started or envisaged. Researchers can be of any nationality.
ESRs must not have resided or carried out their main activity (work, studies, etc.) in the country of the recruiting beneficiary for more than 12 months in the 3 years immediately before the planned recruitment date. Compulsory national service, short stays such as holidays, and time spent as part of a procedure for obtaining refugee status under the Geneva Convention are not taken into account.