Make an impact with NTT DATA
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

Your day at NTT DATA

Seeking a talented Solution Architect/BDM for On-Prem/Private AI. Requires deep open source LLM expertise to translate client needs into technical solutions. Responsibilities include assessing needs, recommending LLM tech, sizing opportunities and infrastructure, and collaborating on end-to-end solutions with costing. Needs strategic thinking, strong technical and business skills to drive innovation and client value.

What you'll be doing

Key Roles and Responsibilities:

Solution Architecture & Technical Leadership

• Demonstrate deep expertise in LLMs such as Phi-4, Mistral, Gemma, Llama and other foundation models
• Assess client business requirements and translate them into detailed technical specifications
• Recommend appropriate LLM solutions based on specific business outcomes and use cases
• Experience in sizing and architecting infrastructure for AI/ML workloads, particularly GPU-based systems.
• Design scalable and secure On-Prem/Private AI architectures
• Create technical POCs and prototypes to demonstrate solution capabilities
• Hands-on experience with vector databases (open-source or proprietary), such as Weaviate, Milvus, or Vald etc.
• Expertise in fine-tuning, query caching, and optimizing vector embeddings for efficient similarity searches

Business Development

• Size and qualify opportunities in the On-Prem/Private AI space
• Develop compelling proposals and solution presentations for clients
• Build and nurture client relationships at technical and executive levels
• Collaborate with sales teams to create competitive go-to-market strategies
• Identify new business opportunities through technical consultation

Project & Delivery Leadership

• Work with delivery teams to develop end-to-end solution approaches and accurate costing
• Lead technical discovery sessions with clients
• Guide implementation teams during solution delivery
• Ensure technical solutions meet client requirements and business outcomes
• Develop reusable solution components and frameworks to accelerate delivery

AI Agent Development

• Design, develop, and deploy AI-powered applications leveraging agentic AI frameworks such as LangChain, AutoGen, and CrewAI.
• Utilize the modular components of these frameworks (LLMs, Prompt Templates, Agents, Memory, Retrieval, Tools) to build sophisticated language model systems and multi-agent workflows.
• Implement Retrieval Augmented Generation (RAG) pipelines and other advanced techniques using these frameworks to enhance LLM responses with external data.
• Contribute to the development of reusable components and best practices for agentic AI implementations.

Knowledge, Skills, and Attributes:

Basic Qualifications:

• 8+ years of experience in solution architecture or technical consulting roles
• 3+ years of specialized experience working with LLMs and Private AI solutions
• Demonstrated expertise with models such as Phi-4, Mistral, Gemma, and other foundation models
• Strong understanding of GPU infrastructure sizing and optimization for AI workloads
• Proven experience converting business requirements into technical specifications
• Experience working with delivery teams to create end-to-end solutions with accurate costing
• Strong understanding of agentic AI systems and orchestration frameworks
• Bachelor’s degree in computer science, AI, or related field
• Ability to travel up to 25%

Preferred Qualifications:

• Master's degree or PhD in Computer Science or related technical field.
• Experience with Private AI deployment and fine-tuning LLMs for specific use cases
• Knowledge of RAG (Retrieval Augmented Generation) and enterprise knowledge systems
• Hands-on experience with prompt engineering and LLM optimization techniques
• Understanding of AI governance, security, and compliance requirements
• Experience with major AI providers: OpenAI/Azure OpenAI, AWS, Google, Anthropic, etc.
• Prior experience in business development or pre-sales for AI solutions
• Excellent verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders
• Strong problem-solving abilities and analytical mindset

Location: Delhi or Bangalore

Workplace type:

Hybrid Working

About NTT DATA
NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.

Equal Opportunity Employer
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.