Jeganathan V.

About Me

Seasoned AI/ML architect with over 9 years in IT, specializing in designing, implementing, and scaling complex Al systems and advanced deep learning techniques. Proven ability to build state-of-the-art Generative Al and LLM solutions, including advanced RAG pipelines, multi-agent systems, and model inference optimization. Extensive experience managing the full Al lifecycle-from data engineering and prompt optimization to robust deployment, rigorous evaluation, and achieving compliance in highly regulated industries like pharmaceuticals and healthcare.

AI, ML & LLM

MLFlow NLP UMLS FAISS BERT Pytorch Langgraph LangChain

Frontend

Backend

Database

DevOps

Other

Elasticsearch Redis Pinecone pgvector Postgres Kubeflow Databricks Hive Spark Kafka NLTK spacy S3 Cloud Composer Tensorflow Pyspark Pandas Numpy Dask Transformers Huggingface Sklearn Rust BigQuery Bedrock SageMaker ECS Lambda RAG MCP CrewAl RabbitMQ Celery

Work history

Fractal Analytics
Senior Al Engineer
2022 - 2026 (4 years)
Remote
  • Architected and deployed multi-tenant LLM endpoints using SageMaker LMI containers with VLLM backend and PEFT PPO/GRPO fine-tuning pipelines via Hugging Face PyTorch DLCs, achieving 70% memory reduction and 4x throughput increase for concurrent fine-tuned models serving 10+ tenants.

  • Deployed scalable multi-tenant serving architecture with SageMaker multi-model endpoints with dynamic batching, supports loading isolated LoRA adapters for enterprise clients and improving resource utilization by 3x.

  • Implemented end-to-end pipelines enabling users to import custom data and fine-tune small-to-medium foundation models with PEFT techniques using RL, reducing fine-tuning time from days to hours while maintaining <1% accuracy degradation.

AWS Lambda Bedrock Step FunctionsEKSTransformersVLLM GCPDatabricks Serving Endpoints Propt Registry OpenTelemetry Traching Langgraph LangChain MLFlow Mosaic Al VertexAl BigQuery Cloud Vision AWS Glue
Tiger Analytics
Senior ML Engineer
2020 - 2022 (2 years)
Remote
  • Developed Distributed PyTorch high-throughput training and inference pipelines utilizing SageMaker's distributed libraries to efficiently train large-scale PyTorch models across multiple GPUs, significantly cutting down model iteration time.

  • Developed and optimized PyTorch models for NLP and Computer Vision tasks, managing the full model lifecycle from data preparation to deployment.

  • Automated and Streamlined Model Delivery: Automated CI/CD pipelines (leveraging Jenkins) for rapid, reliable deployment of new PyTorch model versions and inference configurations, resulting in a 75% reduction in deployment times.

SageMaker PytorchNLPDLC Containers Step Function S3Lambda
Lambda Digital
Senior Data Engineer
2018 - 2020 (2 years)
Remote
  • Implemented text preprocessing pipelines for NLP tasks, deploying named entity recognition models to automate information extraction from documents.

  • Built Dockerized pipelines for scalable NLP model deployment, reducing development time by 40% and enhancing reproducibility.

  • Designed monitoring systems with CloudWatch, creating alerts and dashboards to track performance and reduce downtime by 30%.

Axe Logistics & Forwarding Analytics
Data Engineer
2017 - 2018 (1 year)
Remote
  • Developed a Kafka-based stream processing engine to categorize and tag user complaints, improving query resolution time by 25%.

  • Designed big data processing systems using Spark and Hive to ingest and validate over 100,000 records daily, supporting data-driven decision-making.

  • Orchestrated shipment log collection and indexing: Enhanced productivity and maintained service level agreements by meticulously managing log data, contributing to a 15% increase in logistics efficiency

Education

Education
Tensorflow on Google Cloud
Google Cloud
Education
Rapid Apllication Develpemnt on Nvidia Nemo Framework
Nvidia
Education
Generative Al with Large Language Models
Education
AGENTIC AI PIONEER PROGRAM
Analytics Vidya
Education
AWS Certified Solution Architect
AWS
Education
Nvidia Certification - GENAI LLM
Nvidia
Education
Diploma in Data Science
IIT Madras
Education
B.E: Electronics and Communication Engineering
Anna University