Role Summary
NewStreet is hiring an AI / ML Engineer with 3–5 years of experience to build and maintain production-grade machine learning pipelines. The role focuses on model fine-tuning, retrieval quality, evaluation frameworks, error analysis, and optimizing inference cost and latency.
Key Responsibilities
- Model Pipelines: Build and maintain pipelines for data preparation, model fine-tuning, checkpoint management, and deployment.
- Retrieval Engineering: Develop and optimize retrieval pipelines covering chunking, embeddings, reranking, and quality measurement.
- Model Evaluation: Build golden datasets and regression suites to measure model quality and validate model changes.
- Error Analysis: Analyze incorrect model outputs, identify root causes, and implement improvements beyond prompt-level changes.
- Inference Optimization: Monitor inference cost and latency and optimize model performance within defined production requirements.
- Experiment Standards: Establish consistent practices for running, evaluating, and documenting AI/ML experiments.
- Production Readiness: Review AI/ML experiments and help transition successful solutions to production standards.
Key Qualifications
- Experience: 3–5 years of experience in applied machine learning or equivalent demonstrated production experience through an AI fellowship.
- Python: Strong Python development skills for applied machine learning.
- ML Frameworks: Hands-on experience with PyTorch and the Hugging Face ecosystem.
- Fine-Tuning: Practical experience running model fine-tuning and evaluating its impact on relevant metrics.
- Retrieval: Production experience building and tuning retrieval pipelines using chunking, embeddings, and reranking.
- Evaluation: Experience creating evaluation datasets and regression suites for measuring model quality.
- Research: Ability to evaluate technical research papers and determine their practical production applicability.
About NewStreet
NewStreet is an award-winning fintech company building AI-powered platforms for financial institutions. Established in 2017 and ISO 9001 and ISO 27001 certified, the company serves customers across lending, trade finance, and payments in India, the GCC, and Southeast Asia.