Software Engineer Task Author (AI Training)

<strong>About The Role<br><br></strong>Alignerr is building a dataset of expert tasks that train and evaluate advanced AI agents on real enterprise engineering work. As a Task Author based in Bangalore, you will design and calibrate authentic engineering challenges — diagnosing failing integrations from logs, tracing bugs through codebases, and writing and verifying real fixes — that genuinely push the limits of capable AI agents.<br><br>Bangalore's engineering talent is world-class, and this role is designed for working engineers with real industry experience in backend systems, SaaS infrastructure, APIs, or enterprise software. This is not a generalist or instructional role — it requires hands-on engineering skill.<br><br><ul><li>Organization: Alignerr</li><li>Type: Hourly Contract</li><li>Location: Remote</li><li>Commitment: Flexible, task-based<br><br></li></ul><strong>Key Responsibilities<br><br></strong><ul><li>Author realistic engineering task prompts covering integration failures, log-based debugging, bug traces through source code, and configuration or integration fixes</li><li>Write scoring rubrics that define exactly what a correct fix or diagnosis looks like and how it is verified — including live environment validation where applicable</li><li>Set up task environments with realistic codebases, logs, alerts, and system states that place an AI agent in a plausible engineering situation</li><li>Solve each task yourself — write the actual fix and confirm it works — to validate the task is sound and the rubric is accurate</li><li>Calibrate task difficulty by adjusting code complexity, log volume, failure modes, or ambiguity until the task reliably challenges the model to the intended degree</li><li>Review and correct AI-drafted task prompts or rubrics when provided<br><br></li></ul><strong>Qualifications<br><br></strong><ul><li>Working software engineer with hands-on, industry-level experience — this is not a theoretical or instructional role</li><li>Fluency in Git, version control workflows, and code review practices</li><li>Strong debugging skills: comfortable reading logs, using observability tools, and tracing failures through a codebase</li><li>Experience with infrastructure, integrations, and configuration code (APIs, services, config files, CI/CD)</li><li>Ability to write and verify a code fix in a live or simulated environment</li><li>Ability to define precise, checkable correctness criteria for engineering outcomes</li><li>Strong written communication skills in English<br><br></li></ul><strong>Nice to Have<br><br></strong><ul><li>Experience in enterprise SaaS, fintech, or industrial IoT engineering contexts common in Bangalore's tech ecosystem</li><li>Background with monitoring and observability platforms such as Datadog, Grafana, or PagerDuty</li><li>Familiarity with cloud infrastructure on AWS, GCP, or Azure<br><br></li></ul><strong>Why Join Us<br><br></strong><ul><li>Work on cutting-edge AI projects alongside leading research labs</li><li>Fully remote and flexible — work when and where it suits you</li><li>Freelance autonomy with the structure of meaningful, well-defined task-based work</li><li>Contribute directly to how AI systems understand and perform real software engineering</li><li>Potential for ongoing work and contract extension as new projects launch</li></ul>

Back to blog

Other Jobs To Apply

No other job posts for this day.