As a Principal Applied Science Manager on our team, you'll be responsible for and will engage in:
- Driving projects from design through conception, implementation, experimentation and finally shipping to our users. This requires deep diving into data to identify gaps, coming up with heuristics and possible solutions, using LLMs to create the right model or evaluation prompts, and setting up the engineering pipeline or infrastructure to run them.
- Manage a small team of applied scientists, assigning tasks, closely mentoring or guiding them, taking responsibility for their outcome / growth & overall output. Any of the activities below could be delegated or done by the individual oneself – either way, one is expected to know the activity well enough to drive it efficiently.
- Documenting progress & processing, assisting & guiding junior team members, aligning & unblocking them with other stakeholders in timezones.
- Coming up with evaluation techniques, datasets, criteria and metrics for model evaluations. These are often SOTA models or metrics / datasets.
- Hands on own the fine-tuning, use of language models, including dataset creation, filtering, review, and continuous iteration.