Shubham Mallick

Engineering / Tech Lead | Data Platform | Distributed Systems | Applied AI

Professional Summary

Engineering / Tech lead with 14+ years building production data platforms - mostly on shared infrastructure another team owned. At Atlassian I lead a pod building the partner data and AI layer on the company's central data platform, deciding with platform teams what we reuse, what we extend, and what should go back to them. Before that, owned an enterprise supply-chain data platform at Apple through GA (99.9% SLA, real-time and batch consumers) and ran distributed processing at Qualcomm at 20TB+/day. Hands-on with Spark, Kafka, lakehouse storage, SQL, and cloud infra. I care most about the seams - schema contracts, lineage, SLOs, cost - and usually start alignment with a written doc, not a meeting. Still review code and grow engineers into leads.

Professional Experience

Atlassian
Sep 2025 - Present
Lead Engineering, AI Partner Delivery, GTM Strategy, POD Lead
  • Leading the AI-first partner effort - working with product and sales to scope the highest-value use cases and get teams building on the platform
  • Built the partner data and analytics layer on the central Databricks/Spark platform instead of a separate stack; extended it only where partner data needed it (SQL models, Neo4j for partner relationships)
  • Stood up AI-ready infrastructure enabling GenAI deployment, ML evaluation pipelines, and reliable delivery
  • Sit with data consumers; gaps that belong upstream go to the platform team as a written ask, not a workaround
Salesforce
Jul 2022 - Aug 2025
Staff Engineering, Agentforce & Sales AI, POD Lead
  • Drove GenAI/Agentforce adoption into the Sales AI stack - shipping multi-turn agent workflows with product and eng for ~25-40% performance gains
  • Architected the platform behind it (Spark/EKS/Kafka on AWS) for streaming and batch use; latency down ~70%
  • Built self-service tooling and IaC automation (Terraform/Jenkins) that cut deployment time ~50% and let other teams onboard without waiting on us
  • Set up SLOs, alerting & evaluation hooks (Grafana/Splunk) to catch problems early and iterate off real numbers
Apple Inc.
Jun 2020 - Jul 2022
Technical Lead, Module Owner
  • Led 12-member engineering team [DC-CPT] building an enterprise supply-chain data platform [GA] on AWS - 100GB+ daily, 99.9% SLA, full lifecycle ownership
  • Built real-time pipelines (Kafka) at 1M+ msgs/hour alongside the batch feeds, with shared data quality checks, lineage, and curation workflows
  • On-prem ➜ AWS migration: Data Mesh with domain-owned data, central governance; ~30% cost cut, ~200% scale
  • Defined schema contracts, taxonomies & governance standards for quality and compliance across supply-chain data
  • Built data APIs with semantic models and metadata management serving 10+ internal analytics teams
  • Built on Apple's shared platform, not around it; took gaps to the owning teams as written asks for their roadmap
Qualcomm
Nov 2017 - May 2020
Senior ML, Distributed System Engineer
  • Architected distributed platform processing 20TB+ daily on a multi-PB Hadoop estate (Spark/HIVE/MapR-DB)
  • Built AI/ML training and evaluation pipelines hitting 92% model accuracy; cut infrastructure resource usage 25%
  • Implemented data quality & monitoring frameworks keeping training datasets reliable across analytics workloads
  • Designed orchestration workflows (Airflow) & data transformation frameworks improving pipeline efficiency by 35%
  • Partnered with engineering & analytics teams enabling developer self-service access to 15+ data products
IBM
Dec 2016 - Nov 2017
Advisory Analyst, Azure Cloud SME
  • Led 6-member team partnering across multi-cloud Azure data platform, delivered ahead of schedule
  • Migrated 500GB+ data with 99.9% integrity using Azure Data Factory, Service Bus; established data quality & SLAs
  • Implemented IaC automation and compliance frameworks meeting regulatory requirements across geographic regions
PwC
Oct 2014 - Dec 2016
Senior Developer / Consultant
  • Architected Business-Intelligence platform with OLTP/OLAP optimizations which helps in querying from billion+ rows in ~2-5 sec; delivered dashboards for business analytics teams
  • Built scalable ETL pipelines processing ~50M+ rows daily
  • Implemented logical data modeling & schema versioning improving data consistency by ~40%, across analytics workloads
  • Partnered with business stakeholders across Sales, Finance enabling data-driven decision-making
  • Won STAR Performer for data platform excellence & multiple client appreciation awards
Cognizant
Apr 2012 - Oct 2014
Application Developer
  • Owned 24x7 production reliability for MetLife backend processing and application support
  • Automated processes reducing manual effort by 60%, across 5+ applications