Find Jobs
Find Jobs Near You – Available Work in Your Location
Skip to job details
CI
Compunnel, Inc.
Senior Manager of Data Science
Career Insights for Data Science Manager
See where this job fits in the broader career landscape. Knowing your career path helps you see what's possible from here.
Scorecard
Based on North Carolina data
Review key factors to help you decide if this role fits your goals. How is this calculated?
What they do
A Data Science Manager manages a team of data scientists, machine learning engineers and big data specialists. They lead data mining and collection procedures, ensure data quality and integrity, build analytic systems and predictive models, and test the performance of data science products.
$144,898 / year median in North Carolina
+22% projected growth
Job Description
Job Summary We are seeking a Senior Manager of Data Science to lead a high-impact team focused on building intelligent systems powered by LLMs and RAG architectures. This role centers on delivering AI agents that generate legal documents, interpret contracts, and autonomously execute multi-step tasks across complex legal workflows. The role will drive strategy, technical execution, and team growth to build next-generation legal assistants capable of grounded reasoning, contextual document drafting, and interaction with structured and unstructured data sources. Key Responsibilities
- Define the roadmap for applying LLMs and agentic AI to real-world legal drafting, summarization, and task automation challenges.
- Evangelize and embed AI-driven change across legal product platforms.
- Translate evolving generative AI capabilities into tangible customer value within the legal domain.
- Architect systems that combine foundation models with RAG pipelines to draft contracts, memos, and pleadings grounded in enterprise knowledge.
- Guide the development of AI agents that perform multi-step reasoning, cite evidence, retrieve domain-specific content, and produce compliant outputs.
- Lead evaluation of model performance for generation, summarization, classification, and dialogue-based workflows with legal constraints in mind.
- Build scalable prompt engineering frameworks and manage fine-tuning or adaptation of models to legal datasets.
- Mentor and grow a multidisciplinary team of LLM-focused Data Scientists and ML Engineers.
- Drive cross-functional collaboration with Legal SMEs, Data Engineers, Product Managers, and Design.
- Establish best practices for evaluation, observability, and responsible use of generative AI.
- Oversee development of infrastructure to support continuous delivery and monitoring of LLM systems in production environments. Required Qualifications
- 3+ years of people management experience leading teams building LLM-based applications, particularly in domains requiring rigor and traceability such as legal, finance, or compliance.
- Hands-on experience delivering systems using LangChain, LLM agent frameworks, vector databases, and prompt orchestration pipelines.
- Strong experience deploying retrieval-augmented generation (RAG) systems for grounded and auditable responses.
- Demonstrated success taking LLM-powered applications from prototype to production.
- Proficiency in Python and LLM tooling, including LangChain, HuggingFace Transformers, OpenAI APIs, and prompt tuning techniques.
- Familiarity with vector databases such as Solr, Elasticsearch, Qdrant, and Weaviate.
- Knowledge of knowledge graphs and hybrid retrieval architectures.
- Working knowledge of Docker, Kubernetes, CI/CD, and model serving tools such as TorchServe, Triton, or Ray Serve.
- Experience with cloud infrastructure on AWS, Azure, or GCP.
- Strong leadership, communication, collaboration, and problem-solving skills. Preferred Qualifications
- Graduate degree in Computer Science, AI, Machine Learning, or equivalent experience.
- 10+ years of post-degree experience, with 4+ years in a data science or applied AI leadership role focused on NLP/LLM systems.
- Prior experience in legal technology, legal AI, or document-intensive domains.
- Familiarity with ethical and legal considerations when deploying generative AI in professional settings.