Full time - Researcher / Natural Language Processing (NLP) for Multimodal Machine Learning
The researcher will design and implement multimodal generative AI models that integrate text, audio, and visual data for entertainment content creation. The role involves publishing cutting‑edge research, collaborating with Sony’s entertainment partners, and advancing large‑scale NLP and machine learning techniques within the Tokyo R&D team.
Skills required
About this role
Technology Field
Natural Language Processing
Machine Learning
Position Summary
We are an R&D organization dedicated to the research and development of large-scale generative AI technologies for content creation and production in the entertainment domain, including music, film, and games. Generative AI technologies have the potential to transform both consumer lifestyles and the workflows of professional creators, and are expected to become an essential component of the music, film, and gaming industries in the years ahead. By leveraging opportunities to collaborate directly with world-leading entertainment groups across these industries, our team engages in cutting-edge research and development to contribute to Sony Group’s businesses. For more information about our research activities and publications, please visit: https://sony.github.io/creativeai
Responsibilities
Fundamental research in natural language processing such as multimodal learning, multimodal LLM, music/video understanding, agent, reasoning, controllable generative modeling, deep generative models for discrete data, image/audio captioning, text-to-image/audio, vision-language pre-training, commonsense knowledge graphs, large-scale data development, etc.
You will be responsible for a wide range of activities, including paper submissions to top conferences (e.g. ACL, EMNLP, NeurIPS, ICLR, CVPR, etc.), collaborative research with universities and/or business groups, deployment of developed technologies within Sony and/or to third-party products together with product teams, etc.
You will also contribute to improving the efficiency of content creation in Sony's studios for music, movies, and game services by delivering AI-assisted tools developed by R&D.
Required qualifications
All of the following criteria are required.
■ Master's degree in natural language processing, artificial intelligence, machine learning, or closely related areas OR equivalent practical experience.
■ 3 years of experience with Python, C/C++, and Linux/Unix.
■ 2 years of experience in machine learning fields and NLP, using common frameworks such as PyTorch and TensorFlow.
■ Research ability, as demonstrated by a track record of conference papers, open-source software, or other scientific activities.
■ Ability to speak and write in English fluently and idiomatically.
Preferred qualifications
Qualifiction at the Ph.D level or higher in natural language processing, artificial intelligence, or machine learning is desirable.
Product, Service
Content creation support for movies/music/games, robots (Aibo), etc.
Development Environment
■OS: Windows and Linux
■Language: Python, C/C++, etc.
■PC, Server, Cloud Computing
Application Requirements
Essay: Not Required
Coding Test: Not Required
Required Skills:
Optional Skills:
Similar open roles
