AI Infrastructure Specialist

Role : Senior LLM Engineer (NLP Specialist)

Location : Remote

Duration : 6 Months

Key Responsibilities

• LLM Development & Optimization
• Fine-tune and deploy large language models (GPT, BERT, T5, etc.) and NLP-related tasks with vision language models (Florence-2, PaliGemma) for domain-specific tasks such as text classification, summarization, and entity extraction.
• Advanced NLP techniques, ensuring accurate text recognition of plan annotations (e.g., pipe materials, dimensions).
• Annotation Workflow Integration
• Design custom techniques effective annotations to thereby achieve desired project goal.
• Automate or streamline annotation tasks wherever possible (e.g., partial auto-labeling) to reduce manual effort and error rates.
• Experimentation & Evaluation
• Establish robust evaluation metrics (Perplexity,Precision, recall, F1-score, Levheinstein distance, character array, Bleu score ) for NLP components, including text extraction quality.
• Set up an iterative experimentation framework to track model versioning, data changes, and performance gains over time.
• Data Management & Accountability
• Coordinate with the Project Manager and AI Engineer to ensure new data (annotated or collected) is properly versioned and accessible.
• Implement best practices for dataset growth, including tracking who annotated or curated the data and how these changes affect model performance.
• Deployment & Scalability
• Integrate with existing infrastructure and pipelines, ensuring minimal disruption to ongoing model development.
• Optimize model sizes and queries to reduce latency between input and output (quantization, batch optimization, etc.)

Required Qualifications