WS
Full time
🤖 AI / ML
Senior Data / ML Engineer at Web Spiders
Listed by DevShelfHub
Kolkata (Rajarhat–Newtown), India
Hybrid
Senior · 5–9 yrs
About the Role
Web Spiders is hiring a Senior Data / ML Engineer for its Data Science & Engineering team in Kolkata. In this role you will design, build, and maintain robust, scalable data pipelines and infrastructure on AWS, powering analytics, machine learning, and business-critical reporting.
The ideal candidate combines deep AWS expertise with modern development practices—including AI-assisted coding, containerization, and infrastructure as code.
What you'll do
- Design, develop, and optimize large-scale ETL/ELT pipelines using AWS EMR (Spark), Glue, Lambda, and Step Functions
- Orchestrate complex data workflows with Apache Airflow, ensuring reliability, observability, and SLA adherence
- Architect and manage data storage across S3, Redshift, and RDS
- Build and maintain containerized data applications and microservices using Docker and ECS/Fargate
- Develop event-driven and serverless data processing with Lambda, SQS, SNS, and EventBridge
- Leverage AI-powered coding assistants for development, code review, and documentation
- Implement data quality frameworks, monitoring, and alerting
- Collaborate with Data Scientists to productionize ML models and feature pipelines
- Define and enforce data governance, security, and access-control policies
- Contribute to infrastructure-as-code initiatives
What we're looking for
- Bachelor's or Master's in Computer Science, Engineering, Data Science, or related field
- 5+ years in data engineering; 3+ years hands-on AWS production workloads
- 3+ years with AWS: EMR (Spark/Hadoop), Airflow, S3, Redshift, RDS, Lambda, SageMaker, ECS
- Solid Docker experience and container orchestration
Skills & Technologies
Required
Bachelor's or Master's in Computer Science, Engineering, Data Science, or related field
5+ years in data engineering; 3+ years hands-on AWS production workloads
3+ years with AWS: EMR (Spark/Hadoop), Airflow, S3, Redshift, RDS, Lambda, SageMaker, ECS
Solid Docker experience and container orchestration
Proficiency in Python and SQL; TypeScript is a plus
Ability to use AI-assisted development tools for prototyping, code generation, and testing
Strong data modeling, data governance, and data security practices
Nice to Have
Benefits & Perks
- Health Insurance
- Flexible Leave Policy
- Learning Budget
- EPF / NPS
Why This Role is Good for Experienced Professionals
- Architect large-scale AWS data pipelines and productionize ML models in a product engineering environment.
- Design and optimize large-scale ETL/ELT pipelines with EMR, Glue, Lambda, and Step Functions
- Orchestrate complex workflows with Apache Airflow (MWAA or self-managed)
- Architect data storage across S3, Redshift, and RDS with cost optimization
- Build containerized data applications with Docker and ECS/Fargate
- Develop event-driven serverless solutions with Lambda, SQS, SNS, and EventBridge
- Leverage AI-assisted coding tools (Cursor, Kiro, Claude Code) for rapid development
- Collaborate with Data Scientists to productionize ML models and feature pipelines
- Define data governance, security, and access-control policies
- Contribute to infrastructure-as-code with Terraform, CloudFormation, or CDK
- Full-time role with exposure to US Eastern time zone projects
- Work from office in Rajarhat–Newtown, Kolkata
About Web Spiders
Web Spiders is a technology company delivering CX and product engineering solutions including AI-first web portals, phone AI, chatbots, mobile apps, event tech, and conversational experiences. The Data Science & Engineering team builds the data infrastructure that powers analytics and machine learning across the organization.
- Industry
- Technology
- Company Size
- 500+
- Website
- webspiders.com
🚀 Boost your chances
Skip the queue
Contact the recruiter directly at Web Spiders and follow up personally — most applicants never do.
Browse Recruiter DatabaseFree trial · 40 contacts · ₹0
Job Details
- Type
- Full time
- Level
- Senior
- Experience
- 5–9 years
- Location
- Kolkata (Rajarhat–Newtown), India
- Work Mode
- Hybrid
- Category
- AI / ML
Share this Job
Recruiter Database
Want to stand out? Talk to the recruiter directly.
Most applicants never hear back. Our Recruiter Database gives you direct email access to the people making hiring decisions — so you can follow up personally and actually get noticed.
- Recruiter name, company & direct email address
- Sourced from active job postings across top companies
- Free trial — 40 contacts, no credit card needed