Senior AI / Software Engineer
Blackstraw AI · Tampa, FL
–
Focus: Generative AI, multi-agent systems, MLOps, document intelligence
- Architect and deploy generative AI solutions for enterprise clients, integrating commercial and open-source LLMs (OpenAI API, Hugging Face) into production workflows using retrieval-augmented generation and structured prompting.
- Design multi-agent systems in LangChain that coordinate specialized agents for retrieval, extraction, validation, and summarization, with tool use, memory, and guardrails for reliable outputs.
- Build document intelligence pipelines that combine OCR, layout analysis, and LLM-based extraction to convert unstructured documents such as contracts, invoices, and forms into validated structured data.
- Fine-tune and evaluate LLMs on domain-specific datasets; create golden datasets, scoring rubrics, and automated regression tests to track accuracy, hallucination, and consistency across model and prompt versions.
- Lead data annotation and quality workflows, including labeling guidelines, reviewer calibration, and error analysis that feed targeted improvements back into training and evaluation data.
- Own MLOps for AI services: containerized model serving with Docker and Kubernetes on AWS and Azure, CI/CD for models and prompts, and monitoring for latency, cost, and model drift.
- Apply security best practices to AI systems, including PII redaction, role-based access control, and defenses against prompt injection and data leakage.
