Open-Source LLM Ops Intern

Join Tech Mahindra in Chandigarh as an Open-Source LLM Ops Intern. This entry-level internship is designed for students and recent graduates who learn best by building, shipping and getting real feedback on self-hosted open-model operations work. About the role As an Open-Source LLM Ops Intern at Tech Mahindra, your core focus will be serving open-weight models on your own GPUs and finding out what throughput, quantisation and batching really cost. You are attached to a named mentor, join the team's stand-ups and reviews, and are trusted with work that matters rather than filler tasks. Questions are encouraged, your output is reviewed properly, and you get the feedback you need to actually improve. What you'll do day to day • Work on serving open-weight models on your own GPUs and finding out what throughput, quantisation and batching really cost alongside the core team • Use Open-Weight Models, vLLM or Ollama, GPU Basics, Quantisation, Docker on live, production-facing problems • Turn your work into clear documentation, notes or decks for reviewers • Take part in reviews and act on the feedback you receive • Collaborate across functions — engineering, product, design or business as the work demands • Follow the team's quality, testing and documentation standards • Track and report your own progress against an agreed plan Skills you'll build You will build practical, demonstrable experience in Open-Weight Models, vLLM or Ollama, GPU Basics, Quantisation, Docker, Python, Load Testing, Linux, Inference Optimisation, Monitoring — the exact toolkit that separates a hireable fresher from a CV full of coursework. No prior work experience is required. Curiosity, problem-solving ability and a willingness to learn matter far more here than a polished résumé, and every one of these skills is taught on the job. Who should apply Students in their final year or recent graduates from B.E./B.Tech (CSE/IT/ECE), MCA or M.Sc (Computer Science) based in or willing to work from Chandigarh. You should be willing to learn Open-Weight Models, vLLM or Ollama, GPU Basics and able to communicate clearly in writing. Personal projects, coursework, certifications or open-source contributions strengthen your application, but none of them are mandatory. Internship details This is a 2-month internship in Chandigarh, Chandigarh, with a stipend of ₹21,000 per month. You will be given a defined project so that you leave with a self-hosted model endpoint with measured throughput. Working hours follow the team's normal business hours and the internship includes a certificate on successful completion. You will finish this internship with practical, demonstrable skills, real project work to point at, and a much clearer sense of how the industry actually operates day to day. Strong performers are considered for a Pre-Placement Offer (PPO) and a full-time role. About this employer — Large enterprise / multinational Tech Mahindra is a large, well-established employer in IT Services & Consulting with a substantial India footprint. Expect a structured internship: formal onboarding, a named mentor, documented processes, defined review checkpoints and the chance to see how analytics works at scale across several business units. • Employer scale: Large enterprise / multinational • Industry: IT Services & Consulting • Careers page: https://careers.techmahindra.com/ (applications go to the company's own site — MyInternships.in never charges a candidate a fee) Eligibility criteria • Education: B.E./B.Tech (CSE/IT/ECE), MCA or M.Sc (Computer Science) • Graduating batch: 2026 or 2027 — final-year students and recent graduates are both eligible • Academics: 60% / 6.0 CGPA and above preferred; consistent academics help, but a strong project or portfolio is weighed alongside marks • Technical skills: Open-Weight Models, vLLM or Ollama, GPU Basics, Quantisation, Docker • Also useful: Python, Load Testing, Linux, Inference Optimisation, Monitoring • Soft skills: clear written and spoken English, ownership of your work, comfort asking questions, and the discipline to check your own work before you ship it • Experience: none required — this is a fresher internship. Academic projects, certifications, GitHub work or a previous internship strengthen an application but are not mandatory • Location: based in Chandigarh, Chandigarh or willing to work from there for the internship period Additional information • Joining date: immediate / rolling — selected candidates usually start within 3-5 weeks of accepting the offer, and start dates can be adjusted around end-semester exams • Working hours: Monday to Friday, standard business hours (about 8-9 hours a day) at the office • Duration: 2 months, with a certificate issued on successful completion • Documents at joining: college ID or degree certificate, a government photo ID, and a No-Objection Certificate from your college where your programme requires one • Equipment: a workstation, software licences and all tool access are provided at the office — you do not need to bring your own machine • Bond: no bond and no service agreement is attached to this internship • Fees: Tech Mahindra and MyInternships.in never charge a candidate any fee at any stage of the application, selection or onboarding process. Report anyone who asks you for money in the name of this internship How to apply Click Apply Now. If you are not logged in you will be asked to sign in and register first, after which you will be taken to Tech Mahindra's official careers page to complete your application. Applications are reviewed on a rolling basis and seats are limited, so apply early. Responsibilities: Work on serving open-weight models on your own GPUs and finding out what throughput, quantisation and batching really cost alongside the core team; Apply Open-Weight Models, vLLM or Ollama, GPU Basics, Quantisation to live, production-facing problems; Document your work clearly for reviewers and stakeholders; Participate in reviews and act on the feedback you receive; Collaborate across engineering, product, design or business as required; Follow the team's quality, testing and documentation standards. Requirements: Pursuing or recently completed B.E./B.Tech (CSE/IT/ECE), MCA or M.Sc (Computer Science); Graduating batch 2026 or 2027 — final-year students and recent graduates welcome; 60% / 6.0 CGPA and above preferred; strong project work is considered alongside academics; Working knowledge of Open-Weight Models, vLLM or Ollama, GPU Basics (or a genuine willingness to learn them); Exposure to Quantisation, Docker, Python is an advantage; Clear written and verbal communication in English, and care with detail in your work; No prior work experience required — this is a fresher-friendly internship; Based in Chandigarh, Chandigarh or willing to work from there for the internship period.