Ms Jesin James

2012-2014 - Master of Technology (M. Tech) in Signal Processing. College of Engineering, University of Kerala, India.

Biography

Jesin is a Lecturer in the Department of Electrical, Computer, and Software Engineering at the University of Auckland, New Zealand. The lecturer position is equivalent to Assistant Professor in North American universities.

Jesin's main research areas are speech signal processing, under-resourced languages, machine learning and engineering education.

During 2012-2014 she worked on developing a Text To Speech synthesis system in her mother tongue, Malayalam (language spoken in south India), with special emphasis on developing a prosodic model for the same. Further, during 2014-2016 she worked as a Lecturer in Electronics and Communication Engineering in India, during which she was involved in some student projects, that have been published and presented to wider audience. In 2016, she joined University of Auckland as Ph.D scholar in the Computer systems engineering. She is currently working in the Healthcare Robot project (part of CARES, University of Auckland), with special focus on the development of the speech of the robot in New Zealand English. The aim is to improve the naturalness of the speech and incorporate empathy into the robot voice, to further improve its acceptance.

Jesin strongly believes that if you can combine your passion with your career, you will never feel that you are working. Engineering offers the possibility to combine your passion with technology and make a difference. Jesin enjoys languages, music and interacting with people - and being a lecturer in Electrical, Computer, and Software Engineering working on speech technology for languages is definitely tying everything up nicely.

In terms of her education philosophy, she tries to advocate the Māori concept of ako (The concept of ako describes a teaching and learning relationship, where the educator is also learning from the student and where educators’ practices are informed by the latest research and are both deliberate and reflective) in her teaching. 

 

Jesin is originally from Kerala, India. Malayalam is her mother-tongue. She currently lives in Auckland, New Zealand with her husband.

Qualifications:

PhD, Computer Systems Engineering, The University of Auckland, NZ, 2020 (Submitted) - Emotional speech synthesis for social robots.

MTech, Signal Processing, The University of Kerala, India, 2014

BTech, Electronics and Communication Engineering, Mahatma Gandhi University, India, 2012

 

 

 

 

 

Research | Current

Emotional speech synthesis and recognition

Speech technology for New Zealand English and te reo Māori

Acoustic analysis of speech signals

Human computer interaction

Developing novel Teaching-Learning methods for Signal processing course

Teaching | Current

Digital signal processing (ELECTENG 733)

Distributed Cyber-Physical Systems Design (COMPSYS 725)

 

Postgraduate supervision

Postgraduate supervision:

Sabyasachi Roy - Working on developing Neural-network based text to speech synthesis system in New Zealand English.

Postgraduate supervision opportunities:

Looking for postgraduate research students in the area of speech signal processing (speech synthesis, speech recognition, emotion synthesis and recognition), building speech technology resources for te reo Māori and New Zealand English and using machine learning for speech signal processing applications.

 

Distinctions/Honours

  • Best student paper award obtained at the International Congress of Phonetic Sciences.
  • Received International Speech and Communication Association Travel Grant for attending Interspeech 2018.
  • Received Australasian Speech Science and Technology Association (ASSTA) Travel Grant for attending Interspeech 2018.
  • Received the Colombo Plan Scholarship in Engineering for PhD at University of Auckland.
  • Received the CARES (Centre for Automation and Robotic Engineering Science) seed funding for PhD research.

  • Received project grant from Kerala State council for Science,Technology and Environment, India for completion of a project under guidance.

  • Received the Graduate Aptitude Test in Engineering (GATE) scholarship by the  Ministry of Human Resource Development, Government of India for pursuing Masters degree.

  • Received the Indian Prime Ministers Scholarship for for the academic excellence in All India Senior Secondary School Certificate Examination.

Areas of expertise

Speech Signal Processing

Signals and Systems

Microprocessors and Microcontrollers

Committees/Professional groups/Services

  • Referee for International Journal of Social Robotics, Springer Language Resources and Evaluation Journal, Australasian Speech Science and Technology conference.
  • Group facilitator for Engineer Her Future, University of Auckland.
  • Mentor at Powering Potential, Royal Society of New Zealand.
  • Member of The International Speech and Communication Association (ISCA).
  • Member of The Australasian Speech Science and Technology Association (ASSTA).
  • Member of IEEE Women In Engineering, University of Auckland.

Selected publications and creative works (Research Outputs)

  • Hioka, Y., James, J., & Watson, C. I. (2020). Masker design for real-time informational masking with mitigated annoyance. Applied Acoustics, 159.10.1016/j.apacoust.2019.107073
    URL: http://hdl.handle.net/2292/48677
    Other University of Auckland co-authors: Yusuke Hioka, Catherine Watson
  • Masuda, H., Hioka, Y., James, J., & Watson, C. I. (2019). Protecting speech privacy from native/non-native listeners - effect of masker type. In S. Calhoun, P. Escuderi, M. Tabain, P. Warren (Eds.) Proceedings of the 19th International Congress of Phonetic Sciences, 3070-3074. Melbourne, Australia. Related URL.
    URL: http://hdl.handle.net/2292/48753
    Other University of Auckland co-authors: Catherine Watson
  • James, J., Stoakes, H., & Watson, C. I. (2019). Influence of Prosodic features and semantics on secondary emotion production and perception. In S. Calhoun, P. Escuderi, M. Tabain, P. Warren (Eds.) Proceedings of the 19th International Congress of Phonetic Sciences, 1779-1783. Melbourne, Australia. Related URL.
    URL: http://hdl.handle.net/2292/48751
    Other University of Auckland co-authors: Catherine Watson
  • James, J., MIxdorff, H., & Watson, C. (2019). Quantitative model-based analysis of F0 contours of emotional speech. In S. Calhoun, P. Escudero, M. Tabain, P. Warren (Eds.) Proceedings of the 19th International Congress of Phonetic Sciences, 72-76. Melbourne, Australia. Related URL.
    URL: http://hdl.handle.net/2292/48754
    Other University of Auckland co-authors: Catherine Watson
  • James, J., Tian, L., & Watson, C. I. (2018). An Open Source Emotional Speech Corpus for Human Robot Interaction Applications. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2768-2772. Hyderabad, India. 10.21437/Interspeech.2018-1349
    URL: http://hdl.handle.net/2292/48788
    Other University of Auckland co-authors: Catherine Watson
  • James, J., Watson, C. I., & MacDonald, B. (2018). Artificial Empathy in Social Robots: An analysis of Emotions in Speech. Paper presented at 27th IEEE International Symposium on Robot and Human Interactive Communication (IEEE RO-MAN), Nanjing, PEOPLES R CHINA. 27 August - 31 August 2018. 2018 27TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (IEEE RO-MAN 2018). (pp. 6).
    Other University of Auckland co-authors: Catherine Watson, Bruce MacDonald
  • Hioka, Y., James, J., & Watson, C. (2017). A design of comfortable masking sound for real-time informational masking. INTER-NOISE 2017 - 46th International Congress and Exposition on Noise Control Engineering: Taming Noise and Moving Quiet.
    URL: http://hdl.handle.net/2292/41263
    Other University of Auckland co-authors: Yusuke Hioka, Catherine Watson
  • James, J., Watson, C. I., & Gopinath, D. P. (2016). Exploring Text To Speech Synthesis in Non-Standard Languages. In C. Carignan, M. D. Tyler (Eds.) Proceedings of the Sixteenth Australasian International Conference on Speech Science and Technology, 213-216. Parramatta, Australia: Australasian Speech Science and Technology Association. Related URL.
    Other University of Auckland co-authors: Catherine Watson

Contact details

Primary office location

BUILDING 903 - Bldg 903
Level 3, Room 355
262 KHYBER PASS
NEWMARKET
AUCKLAND 1023
New Zealand