Research Engineer

Introduction
IBM Research Engineers are charting the future of Artificial Intelligence creating breakthroughs in quantum computing discovering how blockchain will reshape the enterprise and much more. Join a team that is dedicated to applying science to some of today’s most complex enterprise challenges whether it’s building state of art LLMs discovering new quantum algorithms and applications or advances in multi cloud computers.

Your Role and Responsibilities
We are seeking an engineer to refine and standardize our large language model training procedures. This role is crucial for enhancing our existing framework encompassing a broad spectrum of tasks from dataset preprocessing to large-scale distributed training techniques such as fine-tuning contrastive fine-tuning instruct tuning etc. The candidate will be instrumental in developing tools and scripts that streamline the entire alignment pipeline ensuring efficiency and consistency.
The engineer will be responsible for supporting all tooling and software engineering efforts to standardize and optimize the instruction tuning pipeline. They should possess the ability to interpret machine learning research and translate it into reliable maintainable software. Additionally the role involves developing specialized pipelines for various tasks such as building RLHF pipelines with unit test-based rewards for low-resource languages and creating effective LLM-generated data pipelines. The ideal candidate will have a passion for programming languages enabling them to tailor data generation and training pipelines to specific languages and if applicable leverage webapp development skills for creating frameworks to collect human data and deploy models in user-centric platforms.

Required Technical and Professional Expertise

• A Master’s degree in computer science AI or related fields from a top institution
• 1-3 years of experience working with modern ML techniques including but not limited to language models data processing instruction tuning model training
• Experience with big data platforms like Ray Spark etc
• Programming experience in one of the following: Python web development technologies
• Growth mindset and a pragmatic attitude

Preferred Technical and Professional Expertise

• Peer-reviewed research at machine learning conferences like NeurIPS CVPR ICML ICLR ICCV/ECCV IROS ICRA
• Experience building software for machine learning systems
• Experience working with open source systems