C
ML Engineer — Conversational AI (Remote — Worldwide)
PyTorchLLMsNLPPython微服务KubernetesTransformersLangChainVector DatabasesReal-time SystemsDistributed Computing
About the role
As an ML Engineer at Cresta, you will be at the forefront of building the Generative AI engine that empowers contact center agents in real-time. You will develop and deploy large-scale LLM systems that analyze live streaming audio and text to provide instant coaching, automated summarization, and task execution. Your work will directly impact how Fortune 500 companies interact with their customers by turning every conversation into a data-driven opportunity for excellence.
Responsibilities
- Design and implement scalable pipelines for fine-tuning and deploying LLMs to handle live, multi-turn dialogue.
- Optimize low-latency inference for real-time suggest-engines using techniques like quantization and pruning.
- Build and maintain robust evaluation frameworks to measure model performance on domain-specific conversational data.
- Collaborate with Product and Engineering teams to integrate ML-driven features into the core Cresta coaching interface.
- Develop data collection and labeling strategies to continuously improve model accuracy through human-in-the-loop systems.
- Research and apply state-of-the-art techniques in Speech-to-Text (STT) and Natural Language Understanding (NLU).
- Mentor junior engineers and contribute to a culture of technical excellence and rigorous experimentation.
Requirements
- 4+ years of professional experience building and deploying machine learning models in production environments.
- Strong proficiency in Python and deep learning frameworks such as PyTorch or TensorFlow.
- Proven track record working with LLMs, including fine-tuning, prompt engineering, and RAG architectures.
- Experience with real-time data processing and streaming technologies like Kafka or gRPC.
- Solid understanding of NLP fundamentals including sequence labeling, intent recognition, and sentiment analysis.
- Ability to work effectively in a fully remote, global environment with high autonomy and ownership.
- M.S. or Ph.D. in Computer Science, Machine Learning, or a related quantitative field is preferred.
Benefits
Equity, healthcare, remote stipend.
Disclaimer: MMagic.ai connects talented people with AI companies around the world. While we work hard to feature quality opportunities, we don't independently verify employers, candidates, salaries, or hiring outcomes. We encourage you to research each opportunity and company before applying or making an offer.